Live data from Hacker News

AWS says it can't restore some data from mideast facilities struck by Iran

wsj.com

281–290 of 468 posts

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#282
post #73

This interview with an AWS leader isn’t aging well, from CBS Sunday morning: Pogue asked, "I don't mean to give anyone ideas, but let's say I figured out that one of these unmarked buildings was an AWS data center, and I blew it up. Are you saying that it's so backed up and redundant that you probably wouldn't notice?" Wood replied, "Yeah, you wouldn't notice. I mean, we might be a bit upset, but you wouldn't notice!…

Unless you have a synchronous like setup where you don’t acknowledge data writes unless the remote has aconowledged them first, you will lose data in case your datacenter is hit by a warhead.

Now, there are a few things to consider:

- AWS best practices recommend multiple AZs for workloads and cross-region backups for things like databases and other “stateful” data

- You have to read the fine-print on what AWS offers in terms of recovery: do they reffer to their own infrastructure when they say “you won”t notice” or your data

When Google’s Paris colocation facility was flooded and all AZs there went dark, they sent an email saying “restore from backup in another region and if we can restore your data, we will make it availbale to you”. They did not even issue credits for the downtime.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#283

Earlier quoted context omitted.

There's something reassuring in this for me. There's a lot of magic & handwaving from hyperscalers like AWS about redundancy. I always wondered about some of the engineering to make this absolutely (and literally) bullet proof. At the end of the day most of their answers when you push hard enough involved paying 2-3x to run everything across multiple zones/regions, and lots of awareness in your application to handle…

> I think it's good that when a data center blows up the data is lost. Noteworthy for future skynet situation, etc. Doesn’t really apply, because the only reason data was lost is because customers chose not to replicate it to other regions, either because of legal data residency requirements, cost, or just not bothering. If Skynet wants to make sure it’s backed up, none of that prevents it from doing so. Although it…

AWS promises to keep data safe without requiring cross region redundancy. If you choose not to trust them that's valid but then why use them at all?

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#284

Earlier quoted context omitted.

Is there not more than one data center in your country? Is the power feed at your office too small to put a computer there?

I think both of these things are (very) often true, but it is also true that if I'm going to have backups, it is (all other things being equal) better to minimize correlated risk. The assumption in a lot of these conversations is that having the data "in one place" (ie inside a country) was "safer" than having it in "somewhere else". The tougher counterintuitive argument was that it can be safer to have data stored i…

> I think both of these things are (very) often true,

You think most countries have one data center or less, and most offices have less than two hundred watts of electricity supply?

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#285

[flagged]

Can you post the specs on your missile defense system for your home lab? How are you dealing with the rise of low-cast swarm attacks from drones? Is it land-based, sea-based or space-based and at what point of the trajectory do you target and do you use jamming?

If you have servers on multiple continents that's enough to become immune to attacks like this. You don't need missile defense.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#286

Earlier quoted context omitted.

Yes and no. For example if you are doing Azure, technically Azure can see tenant traffic I believe and you need to use both a Platform Key and CMK for data rest. VMs need encryption at host turned on too. There is nothing to say that a determined adversary may still get at your data so it needs to stay in country.

Yeah same with AWS - they say they can't see my custom KMS key but... this stuff all lives on their servers, not on my servers. AWS definitely have the ability to see my KMS keys and decrypt my data but I assume that they won't unless a judge tells them to.

You should do some research before making assertions like this. You might learn a thing or 3.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#287
post #189

Earlier quoted context omitted.

That's fair, and it sounds like we aren't that far apart. It is, in fact, about control. So I'll restate my central theme as "until the idea of enforceable data sovereignty requirements were enshrined in law, the cloud providers did not and would not delegate control of any body of data to 'controllers' that weren't in jurisdictions where they could be influenced/coerced to compromise that data". Was this a slippery…

Yep, exactly. There's a peculiarly unsatisfying kind of vindication that comes from making "slippery slope" arguments, and then watch them play, and now you are now both a) technically correct, and b) fucked. You'll excuse me if I have a brief "I told you so" moment about a scenario about Amazon's UAE datacenters being bombed without bakcups because of a US-instigated Iranian conflict, where -- if I'd ever dared to d…

Data loss is better than data theft for many people

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#288

Earlier quoted context omitted.

>Quite often a senior leadership issue because backing stuff up results in $$$ spent, which makes shareholders unhappy. This is true. The latter half of your comment is not. At best they have a duty to shareholders. But your assertion would mean every time a company posted a loss and the price went down the execs would be in legal trouble, which is nonsense.

Shareholder nuisance lawsuits can happen basically any time the stock goes down... or doesn't go up enough, and often companies will settle instead of the expensive fighting...

[deleted]

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#289

Earlier quoted context omitted.

You can always selfhost

... in the UAE, so only less risky if your office is remote enough it doesn't also make a nice target (like, say, located within/near Dubai's Internet City).

They're not firing nukes yet. Missiles don't blow up a whole building, let alone a city.

Re: AWS says it can't restore some data from mideast facilities struck by Iran

#290

11.3 Force Majeure. Except for payment obligations, neither party nor any of their affiliates will be liable for any delay or failure to perform any obligation under this Agreement where the delay or failure results from any cause beyond its reasonable control, including acts of God, labor disputes or other industrial disturbances, electrical or power outages, utilities or other telecommunications failures, earthquak…

It's not terrorism because it's self-defence and it's not war because Donald Trump says so

It's beyond the reasonable control of Jeff Bezos. Even though he supports trump with billions of dollars, he didn't ask for this particular war.
Post reply on HN