ceph - sepia - 2024-11-21

Timestamp (UTC)Message
2024-11-21T00:13:46.856Z
<Zack Cerza> somehow we had ubuntu builders without docker installed; I fixed that up just now and hit rebuild on the failed jenkins build: <https://jenkins.ceph.com/job/ceph-dev-new-setup/86434/>
2024-11-21T00:14:16.872Z
<David Galloway> (How'd you fix that up?)
2024-11-21T00:16:46.807Z
<Samuel Just> thanks!
2024-11-21T00:29:22.214Z
<Zack Cerza> I used Dan's `jenkins-tags.py` from <https://github.com/dmick/tools.git>
```pdsh -w $(./jenkins-tags.py -t bionic -L) 'DEBIAN_FRONTEND=noninteractive sudo apt-get install -y [docker.io](http://docker.io)'```
as one example; a few hosts needed me to individually log in and clean up some half-configured packages
2024-11-21T08:04:39.625Z
<Teoman Onay> @Adam Kraitman Hi, I've the following issues on braggi when running the CI:
```Error while connecting to Libvirt: Error making a connection to libvirt URI qemu:///system:
Call to virConnectOpen failed: authentication unavailable: no polkit agent available to authenticate action 'org.libvirt.unix.manage'```
Was there any changes?
2024-11-21T08:05:20.997Z
<Teoman Onay> Can you check if the `default` network is available?
2024-11-21T08:06:36.750Z
<Teoman Onay> Can you check if the `default` network is available and if the user `jenkins-build`is in the libvirt group. Thx
2024-11-21T12:35:57.116Z
<Ronen Friedman> On a related note: the ARM build blocks my PR for a few hours now (after multiple retries):
<https://github.com/ceph/ceph/pull/60787>
@Rongqi Sun @Dan Mick
2024-11-21T12:42:06.644Z
<Joshua Blanch> I don’t know too much about build systems but what about rocky linux since it also has a long EOL date? 
2024-11-21T14:52:16.253Z
<David Galloway> Seems like maybe you hit a bad builder.  I marked it offline and hit Rebuild.
2024-11-21T14:57:03.552Z
<David Galloway> (Now if I can just remember how to do that correctly)
2024-11-21T15:02:48.917Z
<Ronen Friedman> @David Galloway - it still fails immediately
2024-11-21T15:07:47.315Z
<David Galloway> Hit the same issue on a different builder.  Also marked it offline.  Build's going now.
2024-11-21T15:16:19.520Z
<David Galloway> This broke a number of arm builders.  There's a stuck apt-get transaction holding the dpkg lock.
2024-11-21T16:17:50.697Z
<Zack Cerza> ok, looks like there had been one still affected. fixed.
2024-11-21T16:49:32.317Z
<David Galloway> Sorry, I meant a few arm 64 make check jobs were consistently failing.  e.g., <https://jenkins.ceph.com/job/ceph-pull-requests-arm64/65016/console>

My guess is since apt-get wasn't run with `--non-interactive`, it stopped to ask you a question that couldn't get answered.
2024-11-21T16:49:45.836Z
<David Galloway> I SSHed into confusa12 and 14 and just rebooted them.
2024-11-21T17:00:03.203Z
<Zack Cerza> yeah it looks like that's more or less what happened. I guess the `DEBIAN_FRONTEND` var isn't always respected for some reason
2024-11-21T17:01:00.540Z
<Zack Cerza> the question was "should we restart the docker daemon" and of course there weren't even any containers at the time
2024-11-21T17:43:20.334Z
<John Mulligan> FWIW I finally was able to build ceph in a ubuntu24.04 container. I had to disable `-Wall` (for now) and set WITH_JAEGER to OFF.  I will file issues for the warnings that broke with `-Wall` later.
Now I'm trying to run make check to see what happens there. 🙂

(cc @Zack Cerza @Dan Mick)
2024-11-21T17:46:48.942Z
<John Mulligan> FWIW I finally was able to build ceph in a ubuntu24.04 container. I had to disable `-Werror` (for now) and set WITH_JAEGER to OFF.  I will file issues for the warnings that broke with `-Werror` later.
Now I'm trying to run make check to see what happens there. 🙂

(cc @Zack Cerza @Dan Mick)
2024-11-21T17:47:05.307Z
<John Mulligan> That's `-Werror` not `-Wall` like I wrote. Brain fart.
2024-11-21T17:51:55.188Z
<David Galloway> Restart docker?  I thought docker was missing.
2024-11-21T18:53:30.084Z
<Zack Cerza> it's been years since a lot of these machines have been updated, and the newer [docker.io](http://docker.io) package replaces old docker and docker-ce packages
2024-11-21T18:57:00.757Z
<David Galloway> Oh OHHHH apt’s question

Any issue? please create an issue here and use the infra label.