ceph - sepia - 2024-12-10

Timestamp (UTC)Message
2024-12-10T07:36:36.877Z
<Milind Changire> looks like vossi04 has consumed all disk space on /home
2024-12-10T07:43:39.558Z
<gregsfortytwo> Talk to the team about that. Somebody’s probably using /home instead of the bigger drives to run vstart and left it going
2024-12-10T07:44:20.744Z
<Milind Changire> okay
2024-12-10T07:44:56.901Z
<Milind Changire> I can see Igor's jobs running
I'll ping him
2024-12-10T09:53:09.719Z
<Igor Golikov> Hi can anyone share their .conf file for Sepia VPN?
2024-12-10T09:59:55.513Z
<Dan Mick> David has a solution in progress for the sepia VPN outage.  It will involve all sepia users updating their 'ca.crt' file in the OpenVPN configuration (but nothing else).  The server certificate and CA are both updated, but the CA is the only thing present in your configuration that will change.  Look for instructions very soon.
2024-12-10T11:18:42.083Z
<Igor Golikov> Hi, I have updated ca.crt, and tunnelblick connects to the VPN. However, I am not able to connect to the machines, No ping as well. I guess there is a DNS issue, i see in the tunnelblick log:
2024-12-10 13:13:46.374753 *Tunnelblick: Warning: Could not obtain a list of DNS addresses that are expected
I can't use internet on my laptop as well when the vpn connects.
I am connected only with 1 interface on my laptop (LAN)
2024-12-10T11:30:27.864Z
<Igor Golikov> Hi, I have updated ca.crt, and tunnelblick connects to the VPN. However, I am not able to connect to the machines, No ping as well. I guess there is a DNS issue, i see in the tunnelblick log:
2024-12-10 13:13:46.374753 *Tunnelblick: Warning: Could not obtain a list of DNS addresses that are expected
I can't use internet on my laptop as well when the vpn connects.
I am connected only with 1 interface on my laptop (LAN)
Tried with WIFI - same issue.
2024-12-10T14:34:30.458Z
<Patrick Donnelly> ```[root@vossi04 home]# du -csx /home/* | sort -nr | head
du: cannot access '/home/pdonnell/mnt/tmp.xNtBtfc1uP': Transport endpoint is not connected
du: cannot access '/home/pdonnell/mnt/tmp.LQ8WfB905y': Transport endpoint is not connected
du: cannot access '/home/pdonnell/mnt/tmp.PLbjx7kduy': Transport endpoint is not connected
835549096       total
304325304       /home/mchangir
214417860       /home/jcollin
191269760       /home/khiremat
52308204        /home/pdonnell
45583628        /home/rishabh
27638548        /home/igolikov
332     /home/cm
168     /home/xiubli```
2024-12-10T14:34:42.465Z
<Patrick Donnelly> igor was blameless, i only nuked about 50G in his directory
2024-12-10T14:36:03.190Z
<Patrick Donnelly> so sepia vpn pushes a dns server but clearly your machine is not configuring things properly locally
2024-12-10T14:38:39.212Z
<Igor Golikov> which vpn client do you use?
2024-12-10T14:39:09.347Z
<Patrick Donnelly> openvpn
2024-12-10T14:43:46.774Z
<Adam Kraitman> @Igor Golikov I can take a look at this if you want
2024-12-10T15:08:36.725Z
<Milind Changire> ack

Any issue? please create an issue here and use the infra label.