The other night many weeks ago I chose to install Jitsi in one of our streamers.
I log into the OpenStack panel and make a quick resize of the instance.
Midway it barks and doesn’t come up. And nothing I can do from the console or there manages to un-stuck it from that state. So off it goes a ticket to support.
Meanwhile I spin another instance and rebuild the basic services.
In the heat of the night I forgot the set of users and passwords for the ingress streams. They were just there, in a volume attached to a zombie machine that I couldn’t access. And also in a backup disk just a room across, but I forgot about it back then.
Thankfully we got Nginx (and Traefik on the newer boxen) that take care of handling ssl, so inside everything is in the clear. All I had to do was
tcpdump -n -w dump 'tcp port 8000'
and after a quick run with strings I had all the passwords again.