Live data from Hacker News

AWS says it can't restore some data from mideast facilities struck by Iran

wsj.com

91–100 of 468 posts

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#91
post #18

No disaster recovery plan? No offsite backups? Someone failed to applied the most basic principles that have existed for decades.

If a AWS customer chooses to store their data in a single AZ, that is a design choice. AWS is not taking a daily copy of a entire regions S3 cluster and driving it to some warehouse for a "just in case" situation. That is why Multi-AZ exists.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#92
post #68

Earlier quoted context omitted.

Works unless local laws specifically block you doing that which they do for some classes of data in some countries. Multi-cloud in the same country (if that exists in the country and is far enough apart) maybe .

Do cloud providers even share data center locations so you can assess the "far enough" bit yourself?

No - and usually the reason is so they cannot be targeted.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#93
post #12

Earlier quoted context omitted.

War did not randomly came. America intentionally caused it. And has lawless goverment and unaccountable tech industry making it bad place for data.

[flagged]

Poor Russia, forced to invade Ukraine! My heart bleeds for the Russian army, so cruelly dragged across the borders into another country and forced to fight its way out.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#94
post #9

Earlier quoted context omitted.

For me-south-1 (Bahrain), all 3 data centres providing the redundancy were blown up by Iran.[1] The redundancy was localised to small geographic area and a single government--something customers of AWS were hopefully aware of when they entrusted AWS with their data. It's always buyer beware for any claims of availability. Engineers completing a FMECA[2] will (or should) always state upfront what type of failure modes…

As far as I know, the attacks happened at different times. If Amazon knew that they had lost some data redundancy, shouldn’t they have been quickly mirroring that out of the region?

Most likely, their own data residency terms prohibit this. It would be interesting to know if, when 2 out of 3 AZs got destroyed, customers got a heads up to move their data to a different region?

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#95

This is the flipside of data residency requirements that countries are now starting to require. If the EU wants to keep data in the EU, then great, but when the war comes and energy and infrastructure are hit, people would have wished for backups in North America, Asia, and the middle east.

The EU is big enough to house multiple regions for multiple cloud providers, all in the same jurisdiction (so they can actually be used within data sovereignty requirements). Not true for most of the other places in Asia/UK/South America/etc.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#96

Earlier quoted context omitted.

That depends on the data. If this is EBS or single-AZ S3, then from Amazon's perspective this was correct. Backup responsibly (for any data that does need to be backed up) lives with the customer, and Amazon has no way of knowing about that. EBS data data is unrecoverable, and that's what's reported. Now if this was multi-AZ S3 or whatever then this would be significant. The article does not tell us what products wer…

I was unaware that Amazon even sold single AZ S3. 20% discount. Doesn't seem worth it. By the time I commit to purchasing S3 space, it has to be important data. I get that S3 is convenient and reasonably performant, but it is not cheap at all.

That’s simply not true. I use S3 (well GCS mostly) for data that I wouldn’t be upset if it’s lost. And I pay the zonal discount for it.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#97

It was always a bad bet for billionaires like Bezos to become Trump enablers. You weren't buying a seat at the table, or the privilege of being left alone, you were just signing yourself up to be force-fed shit sandwiches over and over (And the shit-to-bread ratio gets worse as time goes on) You should have used your considerable resources to fight. If only billionaires would oppose aspiring tyrants with the same zea…

He had little choice. The Trump tariffs could've been a massive, massive blow to Amazon, so I'm sure he felt he had to get out in front of them and buy some influence with the incoming administration.

See also Tim Cook. Doesn't make it right to suck up to Trump, but it was, and unfortunately still is, a rational move.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#98
post #85
post #74

Earlier quoted context omitted.

> to-do list becomes securing weapons, vehicles and fuel. I toured a datacenter once back in the early 2000s and they showed me 30 days of generator fuel storage. When i asked them why 30 days and not 35 they replied "we're such a major customer of both electricity and fuel that if we don't get electricity or fuel for 30 days there's way bigger problems than your website not being online" hah.

That's probably already true for 7 days or less

7 days of unreliable electricity wouldn't be unheard of for a very large storm

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#99
They say "some" data, i wonder what percentage that really is. I haven't seen pictures but I find it hard to imagine all of me-south-1 was completely leveled to the point where's there's just nothing left. On the other hand, if you have 100 rows of racks and then randomly take out a contiguous 10% across both rows and columns it may be functionally equivalent to taking out everything.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#100
post #18

No disaster recovery plan? No offsite backups? Someone failed to applied the most basic principles that have existed for decades.

If you had data at two facilities in different countries hundreds of miles apart (about 250 miles between Dubai and Bahrain), that would count as offsite backup most of the time.

Certainly, this event will inform people's disaster recovery plans, but when you're also looking at data residency requirements, small countries, and state level military action against your hosting provider, it can be hard to keep your data.

Post reply on HN