ceph - ceph-devel - 2024-11-11

Timestamp (UTC)Message
2024-11-11T08:28:42.589Z
<Matan Breizman> Was fs compiled? Can you try running with `MDS=0`?
2024-11-11T10:28:52.976Z
<Markuze> a full do_cmake with 2K targets
2024-11-11T10:29:02.181Z
<Markuze> with MDS=0 something starts
2024-11-11T14:22:35.833Z
<Casey Bodley> that's right
2024-11-11T14:27:55.670Z
<Gregory Orange> Okay, thanks for the confirmation.
2024-11-11T14:39:57.313Z
<Joao Eduardo Luis> I'd check if the ceph-mgr is able to load the module. I've hit some annoyance lately on el9 due to dependencies with the ceph-mgr, but might not be the same thing
2024-11-11T19:00:16.678Z
<Markuze> it looks like a python dependency of some sort that is broken.
I'll share my conclusions once resolved.
2024-11-11T19:01:07.563Z
<gregsfortytwo> is this the cherrypi thing? @Milind Changire was telling me about that today <https://tracker.ceph.com/issues/68802#note-14>
2024-11-11T19:03:34.514Z
<Markuze> it seems different.
What is common between all the Failed runs are the default python3.12 on the system - Fedora40,Ubuntu24.10,Ubuntu24.4.1.

Using pyenv + venv didnt help

I'm trying Ubuntu22.4 now
2024-11-11T19:08:02.289Z
<Joao Eduardo Luis> any chance it's related to cherrypy?
2024-11-11T19:08:49.319Z
<gregsfortytwo> thanks for the help, but look up a couple messages? 😛
2024-11-11T19:09:06.215Z
<Joao Eduardo Luis> yeah, saw that after I replied, sorry
2024-11-11T19:09:18.418Z
<Joao Eduardo Luis> I actually filed an issue with fedora this weekend about this
2024-11-11T19:09:24.269Z
<Joao Eduardo Luis> give me a sec, I'll add this to the ticket
2024-11-11T19:11:42.258Z
<Joao Eduardo Luis> <https://tracker.ceph.com/issues/68802#note-15>
2024-11-11T19:11:42.977Z
<Paulo Castro> What do you mean with the latest ceph ? Can you provide a reference SHA ? I'm on a F40 box and on the squid branch alone I have other sorts of problems (PyO3) with the manager but I could give your SHA a go.
2024-11-11T19:12:33.826Z
<Markuze> CephFS doesnt run for me due to PyO3
2024-11-11T19:13:48.508Z
<Joao Eduardo Luis> for the PyO3 thing there's a still-open PR that aims at addressing that issue: <https://github.com/ceph/ceph/pull/57926>
2024-11-11T19:14:43.729Z
<Paulo Castro> @Joao Eduardo Luis You're right. 👍 Been tracking that chestnut...
2024-11-11T19:16:27.070Z
<Markuze> is it only related to the Dashboard? because even without it I see 12 modules failing to load
2024-11-11T19:16:54.485Z
<Paulo Castro> MGR.
2024-11-11T19:17:01.978Z
<Joao Eduardo Luis> the PyO3 this is apparently a problem to do with cryptography libraries IIRC, which ends up being orthogonal across the mgr
2024-11-11T19:17:11.452Z
<Joao Eduardo Luis> (the python stuff on the mgr I mean)
2024-11-11T19:17:43.619Z
<Markuze> Any workaround besides an older distro?
Been stuck on it for two days
2024-11-11T19:17:57.724Z
<Joao Eduardo Luis> applying that PR is how I get my dev stuff going
2024-11-11T19:18:44.959Z
<Joao Eduardo Luis> it is itself a workaround unfortunately. The problem runs deeper, with the subinterpreters being the issue here AFAICT. @Ernesto Puerta will likely know more.
2024-11-11T19:19:09.534Z
<Markuze> I will test it next. 10x.
My ubunut22.04 is almost ready
2024-11-11T19:19:57.546Z
<Markuze> PyO3 is a rust binding infra.
We have one submodule that is using rust.
2024-11-11T19:20:01.594Z
<Markuze> AFAIK
2024-11-11T19:20:42.632Z
<Joao Eduardo Luis> then I might have misunderstood the root cause
2024-11-11T19:21:02.471Z
<Joao Eduardo Luis> (and I now get the O3 bit of the name)
2024-11-11T19:21:48.245Z
<Markuze> Dont get me wrong I love Rust, but I dont like paying the Tax if we are not actualy using it
2024-11-11T19:23:04.972Z
<Markuze> • BLAKE3 is the only submodule that has .rs files. 
• Also two rs files in the pybind/mgr/dashboiard 
• And two benchamrks for boost
2024-11-11T21:16:30.488Z
<Markuze> To sum-up.
• Ubuntu `22.04` with `python 3.10.12` is working fine.
• venv + python `3.10.15`   failed for me -- it had many missing python dependencies regardless of install-deps.sh -- I might try tomorrow with `3.10.12`
•  It seems that any distro with python 3.12 as default will suffer from PyO3 errors and problems with dependencies.
2024-11-11T21:17:10.907Z
<Markuze> To sum-up.
Ubuntu 22.04 with python 3.10.12 is working fine.
venv + python 3.10.15   failed for me -- it had many missing python dependencies regardless of install-deps.sh -- I might try tomorrow with 3.10.12
 It seems that any distro with python 3.12 as default will suffer from PyO3 errors and problems with dependencies.
2024-11-11T21:39:20Z
<yuriw> <https://tracker.ceph.com/issues/68899> "centos 9 build failing on reef"  FYI
2024-11-11T21:39:30.459Z
<yuriw> @Laura Flores @Dan Mick ^
2024-11-11T21:39:50.659Z
<yuriw> @Laura Flores @Dan Mick ^

Any issue? please create an issue here and use the infra label.