I broke the site

Monday, January 9th, 2022

Quite badly, for like 12 hours!

On Saturday night I was just finishing up a new feature that lets you favourite a prompt.

It was getting late, and I had a headache, so I made the mistake of pushing the feature live without much thought.

It worked great in my local environment, what could go wrong? I closed my laptop and went to bed.

Sunday morning rolls around, I open my inbox to see this:

Only half of them
Only half of them

50+ messages about account pages being down. Sellers couldn't see their prompts, buyers couldn't see their purchases.

Turns out I'd forgotten to update some database security rules in production for my new "Favourites" feature, and because favourites appear on your account page - it was tanking account pages.

It was a 30 second fix.

Still quite annoying - because of timezones, those 12 hours I was offline overnight was day time for most people - at least it was the weekend I guess.

<< Next
Prev >>