2024-12-16T01:24:12.339Z | <gregsfortytwo> Looks like [https://git.ceph.com](https://git.ceph.com) hasn’t updated in a couple days. Did some VM or particular task break? |
2024-12-16T07:33:50.118Z | <Adam Kraitman> grafana shows that we had a network failure about two hours ago but it was resolved after 20min |
2024-12-16T07:35:46.858Z | <gregsfortytwo> I’m just looking at the branch heads in ceph-ci.git, which are notably behind what’s in <https://github.com/ceph/ceph-ci/branches/active> |
2024-12-16T07:38:26.349Z | <gregsfortytwo> you can see under “heads” it says “2 days ago” for wip-65369, wip-68055, wip-dis-testing.
But on github it has another 20 newer branches which were updated “3 days ago” up to “51 minutes ago” (with a bunch ~18 hours) |
2024-12-16T07:55:35.975Z | <Ronen Friedman> I am still failing in initiating a run. Maybe related to the fact that <https://shaman.ceph.com/builds/ceph/>
does not show my branch in the 'available refs' list (in the right of that page)? |
2024-12-16T09:59:33.703Z | <Igor Golikov> I still have the same issue, teuthology doesnt pull last commit from my branch. <https://git.ceph.com/> shows that cep-ci repo has been updated 2 days ago |
2024-12-16T10:46:53.468Z | <Gabriel BenHanokh> Sepia access is very slow today here.
Does anyone else experience long delays when accessing Sepia? |
2024-12-16T10:47:14.882Z | <Gabriel BenHanokh> Sepia access is very slow today
Does anyone else experience long delays when accessing Sepia? |
2024-12-16T10:59:08.853Z | <Igor Golikov> yes, too slow for me as well |
2024-12-16T12:13:54.955Z | <Adam Kraitman> Where do you experience the slowness ? |
2024-12-16T12:16:18.009Z | <Gabriel BenHanokh> The connection was corrected after reset to my router and sepia vpn |
2024-12-16T14:47:01.471Z | <Adam Kraitman> @Ronen Friedman When was the last time you tried to initiate a run ? please try again |
2024-12-16T15:50:55.596Z | <Ronen Friedman> @Adam Kraitman teuthology.exceptions.ScheduleFailError: Scheduling rfriedma-2024-12-16_15:50:13-rados:standalone-wip-rf-59437-squid-distro-default-smithi failed: Branch 'wip-rf-59437-squid' not found in repo: ceph-ci.git! |
2024-12-16T17:21:02.194Z | <Igor Golikov> This is what I got for my branch. Branches are not pushed to [git](http://git.ceph.com)[.](http://git.ceph.com)[ceph](http://git.ceph.com)[.](http://git.ceph.com)[com](http://git.ceph.com) |
2024-12-16T18:22:10.406Z | <David Galloway> @Zack Cerza Are you back yet? Would love to have a quick chat to figure out where containerized builds are at. 🧵 |
2024-12-16T18:22:49.259Z | <David Galloway> I've given myself an initiative to improve Jenkins builder security but it may be a moot point depending on how far along you are 🙂 |
2024-12-16T18:40:34.360Z | <Adam Kraitman> Added monitoring for the LRC: https://files.slack.com/files-pri/T1HG3J90S-F084X81GBRV/download/image.png |
2024-12-16T19:04:37.019Z | <Joseph Mundackal> @David Galloway - <https://github.com/ceph/ceph/pull/59841/files>
is this what you are looking for |
2024-12-16T19:04:55.691Z | <Joseph Mundackal> afaik - Zac has been focused on caching (sscache) for the builds |
2024-12-16T19:23:38.555Z | <David Galloway> That is helpful, thanks. |
2024-12-16T19:28:12.741Z | <Ronen Friedman> @Adam Kraitman - maybe this helps to solve the mystery: I tried to manually fetch the named branch from ceph-ci, but couldn't clone it. Had to create my ssh key on Teuthology and register it with github. This makes sense - but was never needed when the fetch was part of the teuthology-suite script. So I guess that that script uses a host-wide key to authenticate to github. But why that does not work anymore? and if this is the problem - how to fix? |
2024-12-16T20:23:02.415Z | <David Galloway> Awesome. Thank you! |