Tarsnap outage postmortem

#1

Post by anderiv » Thu, Jul 27, 2023, 4:33 AM UTC

Tarsnap outage postmortem
mail.tarsnap.com

Re: Tarsnap outage postmortem

#2

Post by mplewis » Thu, Jul 27, 2023, 5:17 AM UTC

I always appreciate seeing a professional, courteous, and honest postmortem like this one.

Re: Tarsnap outage postmortem

#3

Post by cperciva » Thu, Jul 27, 2023, 5:20 AM UTC

blinks

Ok, I really wasn't expecting this to land at the top of HN. I'd love to stick around to answer any questions people have, but it's 10PM and my toddler decided to go to bed at 5PM... so if I'm lucky I can get about 4 hours of sleep before she decides that it's time to get up. I'll check in and answer questions in the morning.

Re: Tarsnap outage postmortem

#4

Post by switch007 » Thu, Jul 27, 2023, 5:20 AM UTC

Not to be that guy, but it’s unreadable either zoomed in or in reader mode either horizontal or landscape on iOS.

Colin, could the website be updated to the 2010s? :P

Re: Tarsnap outage postmortem

#5

Post by gfv » Thu, Jul 27, 2023, 5:31 AM UTC

cperciva wrote: post #3

blinks Ok, I really wasn't expecting this to land at the top of HN. I'd love to stick around to answer any questions people have, but it's 10PM and my toddler decided to go to bed at 5PM... so if I'm lucky I can get about 4 hours of sleep before she decides that it's time to get up. I'll check in and answer questions in the morning.

How long do you keep the transaction logs before rewriting them?

I too had a few EC2 instances go down with signs of being severed from the EBS in the recent couple of weeks; mine were in eu-west.

Re: Tarsnap outage postmortem

#6

Post by ehPReth » Thu, Jul 27, 2023, 5:40 AM UTC

switch007 wrote: post #4

Not to be that guy, but it’s unreadable either zoomed in or in reader mode either horizontal or landscape on iOS. Colin, could the website be updated to the 2010s? :P

This should work in reader mode: https://pastebin.com/raw/hanm8mgG

Re: Tarsnap outage postmortem

#7

Post by memefrog » Thu, Jul 27, 2023, 5:45 AM UTC

switch007 wrote: post #4

Not to be that guy, but it’s unreadable either zoomed in or in reader mode either horizontal or landscape on iOS. Colin, could the website be updated to the 2010s? :P

It's a mailing list archive. Use a real computer.

Re: Tarsnap outage postmortem

#8

Post by Semaphor » Thu, Jul 27, 2023, 5:46 AM UTC

switch007 wrote: post #4

Not to be that guy, but it’s unreadable either zoomed in or in reader mode either horizontal or landscape on iOS. Colin, could the website be updated to the 2010s? :P

Just FYI, Firefox Reader mode works great with it.

Re: Tarsnap outage postmortem

#9

Post by stigz » Thu, Jul 27, 2023, 5:58 AM UTC

cperciva wrote: post #3

blinks Ok, I really wasn't expecting this to land at the top of HN. I'd love to stick around to answer any questions people have, but it's 10PM and my toddler decided to go to bed at 5PM... so if I'm lucky I can get about 4 hours of sleep before she decides that it's time to get up. I'll check in and answer questions in the morning.

Why would I use your service over restic?

God bless you Colin, but reading this, it appears you're the only one in charge of the infrastructure for this service. I'm glad you're clear about no SLA, but this seems like a big liability between me and my backups.

Re: Tarsnap outage postmortem

#10

Post by TheDong » Thu, Jul 27, 2023, 5:58 AM UTC

switch007 wrote: post #4

Not to be that guy, but it’s unreadable either zoomed in or in reader mode either horizontal or landscape on iOS. Colin, could the website be updated to the 2010s? :P

It's not Colin's fault that you're using a browser that can't render an html rendition of an email which has been widely in use since before iOS existed.

This is entirely Safari's fault for not having good compatibility with a common existing webpage format.

Anyway, if you're the intended audience (someone using tarsnap), you also received a copy to your email address, where you can read the text with your email reader of choice.