I wonder if this will cause a mini cyber insurance crisis. I don't think any of those data loss plans have been tested at scale.
AWS says it can't restore some data from mideast facilities struck by Iran
291–300 of 468 posts
Re: AWS says it can't restore some data from mideast facilities struck by Iran
#292They guaranteed 11 9's durability, didn't they? e: Yep https://aws.amazon.com/s3/storage-classes/
If they haven't changed it recently, 11 nines is the durability target by design, but it is not set in any SLA. the S3 SLA is focused on availability.
Re: AWS says it can't restore some data from mideast facilities struck by Iran
#293Earlier quoted context omitted.
The problem is that lots of people seem to be under the impression that they are doing it right because they are using AWS. They don't realize that AWS is a toolbox, not a 'ready made solution for redundancy against all catastrophes you are possibly exposed to'. They use that to their advantage by pricing such solutions at a level that people will either pay through the nose or will be left without recourse when AWS…
Yep, a lot of non-technical leaders believe that 'cloud' is synonymous with 'DR strategy' or even 'backup'. "We won't have to worry about being offline if our server goes down if we move to the cloud!" Some of these people fundamentally don't understand what the cloud is, their assumption is cloud means easy button that solves all your infrastructure and uptime problems.
[deleted]
Re: AWS says it can't restore some data from mideast facilities struck by Iran
#294This interview with an AWS leader isn’t aging well, from CBS Sunday morning: Pogue asked, "I don't mean to give anyone ideas, but let's say I figured out that one of these unmarked buildings was an AWS data center, and I blew it up. Are you saying that it's so backed up and redundant that you probably wouldn't notice?" Wood replied, "Yeah, you wouldn't notice. I mean, we might be a bit upset, but you wouldn't notice!…
That is actually surprising to me. Claims like that are pretty common, they make sense and they should be true, so even though I don't really know AWS (/Backblaze/Azure/whatever) redundancy planning in enough detail, I used to trust them. It's really worrying when they outright say it will be ok, and then a week later it turns out to be not ok.
[deleted]
Re: AWS says it can't restore some data from mideast facilities struck by Iran
#295Earlier quoted context omitted.
> This is the first administration in a long time with the cohones to do something about it. Containment worked WAY WAY better than "doing something about it" and surrendering the strait to them. They "solved it" by aerosolizing asbestos everywhere and still have no cleanup plan. Sometimes containment works much better, which is why intelligent foreign policy worked the problem from that angle. Wasn't victory declare…
> Containment worked WAY WAY better than "doing something about it" and surrendering the strait to them. We haven't surrendered anything to them. It's an open secret that the U.S. has been moving oil out of the Strait all along. Of course, all the IRGC does is attack civilian ships because it is unable to do anything against the U.S. Navy, and knows it would face immense pain if it directly attacked American military…
I think you accidentally swapped "the U.S." and "Iran" in your comment.
Re: AWS says it can't restore some data from mideast facilities struck by Iran
#296Earlier quoted context omitted.
That is actually surprising to me. Claims like that are pretty common, they make sense and they should be true, so even though I don't really know AWS (/Backblaze/Azure/whatever) redundancy planning in enough detail, I used to trust them. It's really worrying when they outright say it will be ok, and then a week later it turns out to be not ok.
The devil is always in the details. Somehow I feel that when we offload the responsibility to some one else we get this feeling that the other person/entity would be doing full diligence and whatever else is required to carry out the job perfectly. However in reality most of the times they just do the bare minimum to pass your evaluation criteria to get the job.
Especially with Amazon, who are well known for squeezing every last bit of profit from their employees, contractors etc., it doesn't really sound surprising. "Offsite backups?! Sure, you could have had that if you had found the right page in the AWS console and if you would have paid 50% extra!"
Re: AWS says it can't restore some data from mideast facilities struck by Iran
#297Earlier quoted context omitted.
Yep, a lot of non-technical leaders believe that 'cloud' is synonymous with 'DR strategy' or even 'backup'. "We won't have to worry about being offline if our server goes down if we move to the cloud!" Some of these people fundamentally don't understand what the cloud is, their assumption is cloud means easy button that solves all your infrastructure and uptime problems.
You are pointing the fingers at the wrong people. Cloud providers pushed this idea onto executives via their marketing and conferencing channels. Not disimilar to how AI naratives are pushed on executives these last two years.
You just have to take a look at the Rube Goldberg-esque abomination that is the AWS web interface for a few minutes to realize that it's not that simple. Granted, most executives won't do that...
Re: AWS says it can't restore some data from mideast facilities struck by Iran
#298Earlier quoted context omitted.
That is actually surprising to me. Claims like that are pretty common, they make sense and they should be true, so even though I don't really know AWS (/Backblaze/Azure/whatever) redundancy planning in enough detail, I used to trust them. It's really worrying when they outright say it will be ok, and then a week later it turns out to be not ok.
The devil is always in the details. Somehow I feel that when we offload the responsibility to some one else we get this feeling that the other person/entity would be doing full diligence and whatever else is required to carry out the job perfectly. However in reality most of the times they just do the bare minimum to pass your evaluation criteria to get the job.
its also the fact that a lot of fundamental systems work in trade offs.
Do you want performance, or correctness.
Well, if you want performance you use write through caching and in the case of distributed storage: more nodes confirming the block before returning. Huge performance cost.
Outsourcing this just means someone else makes these tradeoffs, they will prioritise the general case- and they’re even more incentivised to move the needle towards things that are most visible to the end user.
In this case, performance.
You won’t notice that theres a third commit server off-site (unless that site is bombed), but you will notice slower writes- and the general case says that people will express comparative dissatisfaction with weaker performance and use it as a justification to use another provider.
Re: AWS says it can't restore some data from mideast facilities struck by Iran
#299Ahhh the downside of “data sovereignty” rules and the de-globalization meme strikes again. I’d bet a bajillion dollars the reason this happened is due to government thinking it’s a good idea to make it illegal to store data outside their country.
Hey EU, take note of this next time you create silly data residency requirements that don’t allow data to travel outside your region. Encryption is an easy solution to multi-region residency…as long as the European Commission doesn’t stupidly keep trying to make encryption illegal too!
Hint: Russia absolutely knows where your data centers are.
Re: AWS says it can't restore some data from mideast facilities struck by Iran
#300Earlier quoted context omitted.
Isn’t the problem that multiple datacenters in one zone were blown up?
Yes, this, and the article seems pretty clear that only "some data stored exclusively in Bahrain" is affected. Add to that the option to store data with reduced redundancy (in S3, for example), and I don't really see what the drama is about. Amazon only claims "99.999999999% durability" per year, even for the properly replicated stuff.[0] [0] https://docs.aws.amazon.com/AmazonS3/latest/userguide/DataDu...
> stored exclusively in
Now I'm thinking about legal/contractual rules that might force that kind of geographic risk.
I mean, logically you could have the Allowable Location send pre-encrypted backups to anywhere in the world, except (A) laws and regulations aren't always logical and (B) you still have the problem of keeping the decryption keys somewhere safe without leaving the key jurisdiction.