The other night many weeks ago I chose to install Jitsi in one of our streamers.

I log into the OpenStack panel and make a quick resize of the instance.

Midway it barks and doesn’t come up. And nothing I can do from the console or there manages to un-stuck it from that state. So off it goes a ticket to support.

Meanwhile I spin another instance and rebuild the basic services.

In the heat of the night I forgot the set of users and passwords for the ingress streams. They were just there, in a volume attached to a zombie machine that I couldn’t access. And also in a backup disk just a room across, but I forgot about it back then.

Thankfully we got Nginx (and Traefik on the newer boxen) that take care of handling ssl, so inside everything is in the clear. All I had to do was

tcpdump  -n -w dump 'tcp port 8000'

and after a quick run with strings I had all the passwords again.