Well, fuck.

I’m not sure what happened, whether I missed an invoice or not. The old hosting company I’ve been using for 15 years just closed my ticket rather than give me a straight answer. Kind of a weird response to “Hey, are you SURE I have no unpaid balance?” Whatever. I’m apparently paid-up now (and I have the emails if they decide to press the issue), but the the bottom line is the same.

All of our data is gone. All of it. Drives? Gone. On-site backups? Gone. Off-site backups? Was in the process of setting up borgmatic, so never existed. Even the backups I thought I had? Gone.

It’s all gone.

Where to go from here?

I’m slowly getting services back online, but all hosted wikis are going to have to start from scratch. I have no database backups except for the mirrors. I’m sorry, a lot of that was on me for not having my shit together, so here we are.

The wikifarm management scripts were an absolute nightmare, so I’m redoing them to be less of a clusterfuck and to use more modern tooling.

I’m also going to be reinstalling GitLab as a docker container rather than spend a full day recompiling it every fucking time it updates.

Tutorials

I’m probably going to have to go into the Wayback Machine to recover old tutorials. Sorry.

Silver Linings

We’re on a new, (more) reliable host now (Hivelocity), and our datacenter is in Washington State, so all the new censorship laws crawling onto the books in Texas won’t affect us anymore. We’re also using PayPal for AutoPay instead of whatever half-assed system the old DC was using that made my credit card company throw a fit every year.

We also have 5 IPs to play with. Yay.