ceph - sepia - 2024-08-08

Timestamp (UTC)Message
2024-08-08T00:13:27.759Z
<Zack Cerza> we will probably merge the expiration dates PR tomorrow. once that is deployed, by default jobs that are over two weeks old will be skipped. that should reduce the queue size considerably
2024-08-08T00:23:03.087Z
<Dan Mick> there are 14-year-old issues about it.  It seems to have to do with somehow confusing a hidden authentication token which is supposed to stay with a session, or perhaps that token timing out.  Are either of you (@yuriw or @Ken Dreyer) holding edits to an issue open for a long time before saving them?
2024-08-08T00:23:55.588Z
<yuriw> No
2024-08-08T00:25:06.048Z
<yuriw> builds, runs are every slooow...
2024-08-08T01:04:10.490Z
<yuriw> tracker is again down => `504 Gateway Time-out`
2024-08-08T01:04:50.321Z
<Kyrylo Shatskyy> 😞
2024-08-08T01:05:47.782Z
<Kyrylo Shatskyy> right after I closed some 11 years old ticket, in particular, I set it to "Rejected"
2024-08-08T01:06:21.650Z
<yuriw> now I know why it's down :)
2024-08-08T01:07:41.962Z
<Kyrylo Shatskyy> oh... it's up again
2024-08-08T01:08:16.735Z
<Kyrylo Shatskyy> interesting if I close another one it will down again?
2024-08-08T05:25:07.984Z
<Hemanth Kumar> @Adam Kraitman - <https://tracker.ceph.com/issues/67422> - Created a new request.
2024-08-08T09:48:09.335Z
<kenan.al-shamie> <https://github.com/ceph/keys/pull/495>

I succeeded!! 😄
2024-08-08T14:12:25.469Z
<Ken Dreyer> So this week I've been checking [tracker.ceph.com](http://tracker.ceph.com) every day to see if I've logged out, and of course I cannot reproduce it now 😆 . I'm always logged in.
2024-08-08T14:52:48.190Z
<Casey Bodley> i can ping [teuthology.front.sepia.ceph.com](http://teuthology.front.sepia.ceph.com) but ssh keeps timing out with "Connection closed by 172.21.0.51 port 22"
2024-08-08T15:02:29.482Z
<Adam Kraitman> It was around 10min of downtime I am checking if it's was some DDos attack or something else: https://files.slack.com/files-pri/T1HG3J90S-F07GGJGUY0Z/download/image.png
2024-08-08T15:12:53.171Z
<Casey Bodley> is that working for anyone else?
2024-08-08T15:25:02.865Z
<Kyrylo Shatskyy> yes
2024-08-08T15:25:05.722Z
<Kyrylo Shatskyy> it works for me
2024-08-08T15:35:33.354Z
<Casey Bodley> thanks. got it working
2024-08-08T15:37:40.390Z
<John Mulligan> I'd like to ask for @Anoop C S (<https://github.com/anoopcs9>) to be added to the ceph org and get ceph-ci access, please
2024-08-08T15:51:17.625Z
<Kyrylo Shatskyy> while using Tunnelblick I can see warning:
> • 'compress' was deprecated in OpenVPN 2.5 and has been or may be removed in a later version
> Tunnelblick will use OpenVPN 2.6.12 - OpenSSL v3.0.14 to connect this configuration.
is it something we should worry about?
2024-08-08T19:02:06.414Z
<Sepia OpenShift> [FIRING:1] teuthology (SmithiQueuePaused metrics [teuthology.front.sepia.ceph.com:61764](http://teuthology.front.sepia.ceph.com:61764) teuthology-exporter smithi 527511 openshift-user-workload-monitoring/user-workload teuthology-exporter warning) | https:///console-openshift-console.apps.os.sepia.ceph.com/monitoring/#/alerts?receiver=%23sepia
2024-08-08T19:07:28.449Z
<Zack Cerza> I paused the queue for ~5m to update the dispatcher
2024-08-08T19:15:09.088Z
<Zack Cerza> happened to be watching paddles.front's journal and saw
```Aug 08 19:11:27 paddles smartd[625]: Device: /dev/sda [SAT], SMART Prefailure Attribute: 1 Raw_Read_Error_Rate changed from 63 to 67
Aug 08 19:11:27 paddles smartd[625]: Device: /dev/sda [SAT], SMART Usage Attribute: 195 Hardware_ECC_Recovered changed from 57 to 56```
@Dan Mick / @Adam Kraitman I don't know too much about this, e.g. if we're monitoring it or have a plan to repair / migrate
2024-08-08T19:20:39.667Z
<Dan Mick> Don't know, but it probably won't hurt and will remove the warning if you edit the client configuration.  I don't know exactly how to do that in Tunnelblick
2024-08-08T21:24:44.167Z
<Dan Mick> I get these warnings from Viscosity on Windows; haven't addressed them:
Aug 08 2:20:27 PM: 2024-08-08 14:20:27 WARNING: Compression for receiving enabled. Compression has been used in the past to break encryption. Sent packets are not compressed unless "allow-compression yes" is also set.
Aug 08 2:20:27 PM: 2024-08-08 14:20:27 WARNING: Compression for receiving enabled. Compression has been used in the past to break encryption. Sent packets are not compressed unless "allow-compression yes" is also set.
Aug 08 2:20:27 PM: Note: --cipher is not set. OpenVPN versions before 2.5 defaulted to BF-CBC as fallback when cipher negotiation failed in this case. If you need this fallback please add '--data-ciphers-fallback BF-CBC' to your configuration and/or add BF-CBC to --data-ciphers.
Aug 08 2:20:27 PM: OpenVPN 2.6.10 Windows [SSL (OpenSSL)] [LZO] [LZ4] [AEAD]

Any issue? please create an issue here and use the infra label.