Live data from Hacker News

Leaked Emails Show Google Expected Military Drone AI Work to Grow Exponentially

theintercept.com

521–527 of 527 posts

Re: Leaked Emails Show Google Expected Military Drone AI Work to Grow Exponentially

#521
"I Have No Mouth, and I Must Scream" by Harlan Ellison

> The story takes place 109 years after the complete destruction of human civilization. The Cold War had escalated into a world war, fought mainly between China, Russia, and the United States. As the war progressed, the three warring nations each created a super-computer (with AI) capable of running the war more efficiently than humans.

> The machines are each referred to as "AM", which originally stood for "Allied Mastercomputer", and then was later called "Adaptive Manipulator". Finally, "AM" stands for "Aggressive Menace". One day, one of the three computers becomes self-aware, and promptly absorbs the other two, thus taking control of the entire war. It carries out campaigns of mass genocide, killing off all but four men and one woman.

> The survivors live together underground in an endless complex, the only habitable place left. The master computer harbors an immeasurable hatred for the group and spends every available moment torturing them. AM has not only managed to keep the humans from taking their own lives, but has made them virtually immortal.

https://en.wikipedia.org/wiki/I_Have_No_Mouth,_and_I_Must_Sc...

Re: Leaked Emails Show Google Expected Military Drone AI Work to Grow Exponentially

#522

I don't see anything wrong for a company of a particular country helping their military. GE, Siemens, Mitsubishi and all tech giants of that era did that with pride during WWII. Then why can't Google, Facebook for USA? Perhaps the illusion of globalization is making us perceive Google, Facebook and other international giants as global companies. Although, geniuses from around the world have significant contributions…

So, Siemens also built the deep packet inspection system for Iran (in a joint venture together with Nokia) and was accused of complicity in human rights violations (by Amnesty International, among other organisations).

After being called out, both companies posted an apology/explanation on their websites, where they claimed they didn't know that building a deep packet inspection system for Iran would result in human rights violations.

After having been developed for Iran, the system was also sold to Egypt. This is one reason why the Black Mirror-esque tracking/surveillance situation in China should scare everyone: This system now exists. Consider the inefficiency of government IT projects when they need to be built, compared to when they can be bought. I don't know if China would sell it, of course, but the mere existence and that it can now be deployed elsewhere, which is of course still no small task because a lot of it is probably very specific to China, but even then, scary as hell.

But I digress. So you say they helped their military with pride during WWII (what side was Siemens on, btw?)

Is there really nothing wrong with Siemens developing DPI infrastructure for a country that is known for its human rights abuses? (Siemens claiming not knowing what it would be used for is either a bullshit excuse or a dangerous lack of foresight).

So is there also really nothing wrong with Google developing AI for flying military robot plane-missile-things for this other country that is also known for human rights abuses? (just not on its own citizens, usually)

Anyway, my point is, it doesn't matter whether a corporation supports its own military/country when developing technology that comes strong ethical questions (which is the case for military drones, or DPI).

Google should consider their own choice in the light of whether this technology will be used for good things, not just whether the military of the particular country they're developing it for considers it a good thing, because usually the military considers whatever grants them more power to be good things.

Google should also consider that there is no "when a war breaks loose", that's not how the world works today. Besides, the USA claims to be currently "at war" anyway.

So when they develop modern weapons for the US military, they should consider that in the light of what the US military is doing right now and what it has been doing recently, not in the light of them taking the noble high ground in a hypothetical future war situation that conveniently has a clear "good side" and a clear "bad side".

Because before that hypothetical future war will happen those weapons WILL have been used for whatever the US military pleases currently. And that's not always good things.

Re: Leaked Emails Show Google Expected Military Drone AI Work to Grow Exponentially

#523
post #77

Earlier quoted context omitted.

I have this queasy feeling that the U.S. is killing people who aren't actually taking up arms against it. If doing so shaves a few percent off the error rate that's saving innocent lives, but it's also becoming an essential part of a process that kills innocent people? I'd prefer standing against the slaughter.

You should change your reference point, assuming drone warfare is coming and is not banned in some way who would you rather be the world leader in that space? Alibaba and China or Google and the US?

Uh, that question sounds like your typical US Elections; No good answers and there's an implication we're supposed to pick the "least bad" one.

Thank goodness the world is just slightly too big to be manipulated into a two-party deadlock.

Re: Leaked Emails Show Google Expected Military Drone AI Work to Grow Exponentially

#524

Earlier quoted context omitted.

That’s the problem with preemptive strikes against individuals who aren’t part of a nation that declared war against you.. who’s t say they wouldn’t have attacked you? The metrics are inpossible, and the government is free to redefine people who were in the wrong place at the wrong time as probably guilty anyways.

Killing someone who, if left alive, might kill you is arguably a worst justification than those used by actual terrorists. It throws away the very pretext of correcting a wrong, perceived or otherwise. As software developers we should see the problem here with "premature optimization". It's an incredibly inefficient use of resources with limited success in addressing unplanned situations. Sounds a lot like the war in…

Have you ever seen an engineer waste hours and days on a premature optimization? I have.

Have you seen the same thing sometimes turn later into remarkable prescience, correctly anticipating some future problem and solving it before it happens? I've seen that too.

Government and policy are rarely about certainty. They're generally and risks and probabilities, anticipated costs and expected values. That's the domain of statement and spies, and not for people who like clear certainties.

Re: Leaked Emails Show Google Expected Military Drone AI Work to Grow Exponentially

#525

Earlier quoted context omitted.

A company has only one feedback point in the long run (people leave or die over that timeframe, so you can only count on the lowest common denominator there) and that is money. If that doesn't tell you something about a company's core motivation, then I'm afraid I can't make clear to you why counting on anything but economic incentives as motivation for a company's actions is naive at best.

You’re argument is that every company _must_ be involved in corruption and law breaking, simply because there is profit to be found in doing so. This isn’t simply naive, it has no basis in reality whatsoever.

I have literally never encountered a large company that doesn't have good tax deals in some country or other. Good in the order of "pays basically no taxes". What do you want to call that? "Just good business"?

Re: Leaked Emails Show Google Expected Military Drone AI Work to Grow Exponentially

#526
post #516

Earlier quoted context omitted.

Leaving aside Pax Americana to look at more settled history: none of those events were peaceful in global terms. There's a reason the general term is pax imeperia . The Pax Romana was 200 years of relative quiet after 700 years of effectively constant war, and followed by another 200 years of war. The thing most historians stress is just how far from peaceful it was. In practice, Roman-held lands were at peace becaus…

Thank you for this response. I don't argue that the way to that peace hasn't been historical bloody, but the pandemics can't be blamed on the empires. Those were inevitable as population and trade grew, a byproduct of urbanization.

> the pandemics can't be blamed on the empires. Those were inevitable as population and trade grew, a byproduct of urbanization.

Fair point. I guess my thought was that empires increase the risk of pandemics, since they tend to come alongside expanded travel and trade. Periods of peaceful empire see population and trade increase faster than technological growth would predict, and disease becomes a frequent limit on their durations. But it's certainly not an intended consequence, and the risk would be rising with urbanization and technological growth regardless.

It's something that worries me about global connectivity, and I think it's a widely underestimated risk. But it's hardly a risk I could hold against Pax Americana; in an era of consumer plane travel nothing short of utter isolationism would constrain the risk. At least in a relatively peaceful world we have proactive monitoring and countries that can work together on treatment and vaccines.

Re: Leaked Emails Show Google Expected Military Drone AI Work to Grow Exponentially

#527
post #329

Earlier quoted context omitted.

Yes and no. It's true, we ought to find ways to work together that rely on concepts like mutually assured stability instead of MAD. And there's evidence of altruism's superiority even on a biological level. There are some species of bacteria that when they run out of food will form a protective spore to wait for better times or form a stalk to move to a new location to find food. Those whose bodies form the base of t…

State monopoly for violence is itself a solution to a coordination problem.

I'm not aware of any other solution.
Post reply on HN