2024-10-17T14:44:02.070Z | <John Mulligan> @Redouane links:
<https://github.com/ceph/ceph/blob/99aa9e005234757b836f20af58d057dd445ab3fc/qa/tasks/cephadm.py#L2149>
<https://github.com/ceph/ceph/blob/99aa9e005234757b836f20af58d057dd445ab3fc/qa/suites/orch/cephadm/smb/tasks/deploy_smb_domain.yaml#L17> |
2024-10-17T14:57:19.266Z | <Redouane> thanks @Adam King |
2024-10-17T19:07:32.629Z | <Eugen Block> You are talking about grafana managed by cephadm as well, right? It's been a while since I last tested it, probably Pacific, but the failover did work just fine. The mgr noticed the outage and changed the dashboard's IP for grafana. I might misremember, I'll try to test it again in newer releases. |
2024-10-17T19:08:11.297Z | <Ken Carlile> I've set up the round robin dns now, we'll see how it does |
2024-10-17T19:13:22.460Z | <Ken Carlile> only odd effect I've noticed is that the pools page doesn't load any longer, but I can't imagine how changing the urls for grafana, prometheus, and alertmanager could affect that. |
2024-10-17T19:13:29.936Z | <Ken Carlile> all of those 3 functions seem to be displaying just fine |
2024-10-17T19:20:47.055Z | <Ken Carlile> .... he says, restarting the dashboard to try and get pools back and suddenly orch isn't working on either the dashboard _or_ the cli... |
2024-10-17T19:38:07.291Z | <Eugen Block> Which ceph version is this again? There’s a bug when navigating to the pools page in the dashboard (I can search for it later) which will be backported to Quincy. Not sure which newer versions have it already. You might need to fail the mgr. |
2024-10-17T19:38:26.638Z | <Ken Carlile> Reef |
2024-10-17T19:38:40.009Z | <Ken Carlile> I've tried failing the mgr a couple of times.. I'm more concerned that ceph orch is suddenly gone |
2024-10-17T19:38:44.436Z | <Ken Carlile> or not working, rather |
2024-10-17T19:39:02.606Z | <Ken Carlile> I've got an issue with cephadm/orch, where I restarted the dashboard service (disable/enable) and suddenly `ceph orch` commands return `Error ENOENT: Module not found` |
2024-10-17T19:41:20.988Z | <Eugen Block> [https://github.com/ceph/ceph/pull/50193](https://github.com/ceph/ceph/pull/50193)
It’s been merged to main, but not sure if 19.2.0 has it. For Reef I’m not sure |
2024-10-17T19:42:24.869Z | <Eugen Block> Oh it definitely should be in Reef. Then it might be something else |
2024-10-17T19:43:19.678Z | <Eugen Block> Did you remove OSDs recently? |
2024-10-17T19:43:57.172Z | <Ken Carlile> oh yes.... |
2024-10-17T19:43:59.664Z | <Ken Carlile> I had one going |
2024-10-17T19:51:06.872Z | <Eugen Block> Then check this tracker if it fits your description: [https://tracker.ceph.com/issues/67329](https://tracker.ceph.com/issues/67329) |
2024-10-17T19:52:16.933Z | <Ken Carlile> sounds about right |
2024-10-17T19:52:19.983Z | <Ken Carlile> now I just have to find the json file |
2024-10-17T19:52:52.269Z | <Eugen Block> [https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/PEJC7ANB6EHXWE2W4NIGN2VGBGIX4SD4/](https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/PEJC7ANB6EHXWE2W4NIGN2VGBGIX4SD4/) |
2024-10-17T19:53:02.192Z | <Eugen Block> It’s a config-key |
2024-10-17T19:54:36.247Z | <Ken Carlile> ah |
2024-10-17T19:55:29.075Z | <Ken Carlile> waitaminute, you helped me with this before. 😄 |
2024-10-17T19:55:36.176Z | <Ken Carlile> I should write this dow... |
2024-10-17T19:55:41.684Z | <Ken Carlile> I should write this down... |
2024-10-17T19:59:35.009Z | <Ken Carlile> that did it, thank you again |
2024-10-17T19:59:36.921Z | <Ken Carlile> going in my notes |
2024-10-17T20:02:12.024Z | <Ken Carlile> it's still grumpy about pools, but this something I will try an fix another time. I've had enough excitement |
2024-10-17T20:26:58.163Z | <Eugen Block> I knew I had posted it here in slack already, but not in which thread or for which user. 😁 |
2024-10-17T20:27:26.622Z | <Ken Carlile> sorry about that! |
2024-10-17T20:34:12.066Z | <Eugen Block> Don’t mention it, currently it comes up every week or sometimes every couple of days. Just this evening I pasted that in the mailing list, so I have the links quickly available at the moment. 😁 |
2024-10-17T20:34:22.173Z | <Ken Carlile> heh, nice |
2024-10-17T20:34:30.657Z | <Ken Carlile> It's in my ceph note wiki page now. |
2024-10-17T20:34:33.997Z | <Ken Carlile> (internal wiki) |
2024-10-17T20:34:46.745Z | <Ken Carlile> along with other various incantations to do dark, unholy things |