Live data from Hacker News

Christopher Nolan wants Oppenheimer to be a cautionary tale for Silicon Valley

theverge.com

41–50 of 63 posts

Re: Christopher Nolan wants Oppenheimer to be a cautionary tale for Silicon Valley

#41

I think the problem is that you need to find a very good counter-argument to the rationalization of "If I don't invent it, someone else will"

There is none for nukes as it involves the zero sum game of war. Because you'll die if you don't. Russia and Japan were already developing nukes independent of the US, as the theory for nuclear fission was well known. Logic says to fire immediately if you opponent can't, as eventually you'll lose advantage, a scenario that scared the Soviets to whits end, despite the US not doing so. So you either make your defense or be at the whim of your opponent. Being moral and dead isn't a very good outcome is it?

Overall, the history of nukes lends credence to the idea of keeping doors open, to naively and hopefully trying to avoid zero sum games. The US decided against Kyoto to keep Japan postwar. It's willing to go fire the nukes in defense of Japan today. The US didn't annihilate the Soviets post WW2, despite offense. Khrushchev talked an idiot out of nuclear war and a Soviet operator said the sensors were wrong. But it's only something a single side can control, and it's not assured that you won't end up with a cruel or zealous antagonist, who at best will pause to thoughts of their own death, or you need to make pay to have any hope afterwards.

Re: Christopher Nolan wants Oppenheimer to be a cautionary tale for Silicon Valley

#43

Had the atom bomb never been built we'd be on WW5 by now, not much of a 'cautionary' tale. I for one have learned to stop worrying and love the bomb, I'll take the current situation over rotting in a foxhole any day

It turns out you have to abstract put the gun to the head of humanity form them to realize that pulling the trigger is a bad idea.

It's sad, but its very true. I also stopped worrying and love the bomb, and I'm willing to justify the US nuclear bomb usages on many grounds, namely that even after they were dropped, Japan almost did a military coup against their own emperor to keep the war going. https://en.wikipedia.org/wiki/Ky%C5%ABj%C5%8D_incident

Re: Christopher Nolan wants Oppenheimer to be a cautionary tale for Silicon Valley

#44
post #23

Earlier quoted context omitted.

I think a good starting point for this discussion is clarifying the implicit false dichotomy: it's either moral or moral, technology is either good or bad. To quote Melvin Kranzberg "Technology is neither good nor bad; nor is it neutral". Just because technology requires people to create it and to use it, does not mean that it has no impact on us (an by extension it also means that it's creation has impacts). To take…

If I invent something that can be used for good, but others use it for bad, does it reflect on my character? Does my good intentions absolve me of the harm my invention did? Or, the opposite? If I invent something fully intending to do harm with it, but others find non-harmful uses for it, does that absolve me of my original intentions to cause harm? A gun may not be good or bad, but the intention of the person who i…

This takes us back down the road of binary outcomes though.

The intentions of the inventor are one thing to examine. The outcomes of the inventions another. And the notion that something is “moral”, may not have answers in practice, even if there might be an answer in principle. Even if those answers could be found, they could only be found after enough time had passed to judge the outcome fairly. But it is unpalatable to retroactively assign moral judgement for actions the originator could not have possibly predicted (there’s a different version of this thought experiment that imagines we could perfectly predict the future, but that seems less useful here).

I do think that the moral peril of certain actions/decisions is proportional to the potential risk. There are few discoveries as dangerous as that of splitting atoms, and the more obvious the danger, the more reasonable it seems to judge the original act of invention.

When questions like “will we explode the universe?” seem reasonable to ask, that seems like a good sign an invention is not something that should exist in an ideal world.

Most inventions don’t have these kinds of stakes, and the effects of their use are local to the actors using them, at which point it seems more reasonable to judge the actions of individual users than the invention/inventor.

Re: Christopher Nolan wants Oppenheimer to be a cautionary tale for Silicon Valley

#45
post #31

Kinda odd phrasing from Nolan there. "The rise of companies over the last 15 years bandying about words like ‘algorithm,’ not knowing what they mean in any kind of meaningful, mathematical sense." That's a description of scriptwriters and journalists. Tech companies know well what they mean when they say algorithm, especially what they mean mathematically. It's the non-tech class that talks about algorithms as if the…

I agree. It doesn't make Nolan look good. But he's probably just trying to generate publicity.

I suspect that facebook's contribution to Myanmar was more as a place of organization and evidence of opponents, than the feeds somehow generated most of the zeitgeist to slaughter. It kinda ignores the other causes of zeitgeist/organization and absolves the villains of the affair in doing so. But the idea latched on to some journalist.

The Soviet Union had a semi/automated system for firing if Moscow got blown up before making a decision.

https://en.m.wikipedia.org/wiki/Dead_Hand

They're is an air of vanity to the media and researchers who compare AI to nukes. It's sorta like Nolan making a film about Oppenheimer, in the hope to associate with them.

Re: Christopher Nolan wants Oppenheimer to be a cautionary tale for Silicon Valley

#46

I think that his statement highlights a misunderstanding of the capabilities of ML in the near future. It's an honest mistake since all the startups chasing pumps in investment are selling the idea of terrifying power. A more apt parallel, in my opinion, is that of solar geoengineering. We are doing what Oppenheimer wish we did: ignore its existence. However, the allure, now as it was then, is that it's too little ef…

> It isn't an existential imperative to the global North so it has been dismissed.

See also: USAF’s “Weather as a Force Multiplier: Owning the Weather in 2025” (PDF, 1996): https://web.archive.org/web/19970429012543/http://www.au.af....

Re: Christopher Nolan wants Oppenheimer to be a cautionary tale for Silicon Valley

#47
Why a cautionary tale? The manhattan project was a succees. Does anyone doubt that if a similar war broke out nukes won't be used?

Just look at the number of civilians the japanese killed (nanjing massacare is arguably worse than the holocaust) and they would have kept doing that. Assuming all lives are equal, nukes saved a crapton of lives.

I think it is hypocritical to say cluster and fire bombs that have high rates od civilian casualty and even chemical weapons were ok but nukes somehow are not.

Moreover, can you imagine the world we would live in without nukes? A whole lot of countries would be fighting a whole lot of wars were it not for the fear of starting a nuclear war. Even now, without nukes, do you think there is a chance the US would be attacking Russia over Ukraine? Or if there is a war with China, do you think there would be more or less casualities if there was no nukes? Short of multipe nukes hitting multiple cities on both sides continually, a drawn out conventional war would kill more people, especially with other WMDs still in play. Cholrine gas was used on civilians as early as WW1.

You gotta understand, in a major war like WW2 where losing means nazis and imperial japanese invade the US homeland, most people have no problem nuking their cities (self included). Youe choice is between your children and family or theirs. This isn't like vietnam/iraq/afghanistan which are wars of ideology and interference not wars of self defense. Also keep in mind that most japanese would have fought tooth and nail (civilians included) against an american invasion. Many killed themselves and their own families simply because their land was invaded and they felt dishonored.

Re: Christopher Nolan wants Oppenheimer to be a cautionary tale for Silicon Valley

#49
post #46

I think that his statement highlights a misunderstanding of the capabilities of ML in the near future. It's an honest mistake since all the startups chasing pumps in investment are selling the idea of terrifying power. A more apt parallel, in my opinion, is that of solar geoengineering. We are doing what Oppenheimer wish we did: ignore its existence. However, the allure, now as it was then, is that it's too little ef…

> It isn't an existential imperative to the global North so it has been dismissed. See also: USAF’s “Weather as a Force Multiplier: Owning the Weather in 2025” (PDF, 1996): https://web.archive.org/web/19970429012543/http://www.au.af....

Fortunately we are all pretty far away from an existential war. That's the only thing keeping us alive after Oppenheimer's grand success. Even if a nation crumbles the things that replace it need to at least offer the trappings of a legitimate state if they don't wan to be immediately crushed by nuclear superpowers (assuming they themselves are a nuclear superpower or adjacent to one).

So the cutting edge isn't what's physically most effective, but what's most effective while also being within the gray and constantly shifting "acceptable" range. It's nice that we don't have to go all out, but as soon as scarcity or existential threats enter the picture things can get very ugly quickly. Best to steer clear of such things if possible. I consider chemical, biological, and weather weapons all in the same class of "you better not if you don't want to start a world war".

Re: Christopher Nolan wants Oppenheimer to be a cautionary tale for Silicon Valley

#50

Earlier quoted context omitted.

> inventing it for the purposes of Regardless of how the sentence continues, there is no such thing. There is making inventions in the world as it currently is, and what follows from that. edit: since the page http://tech.mit.edu/V105/N16/weisen.16n.html is down atm, I have to quote it instead of linking it: > People have a series of rationalizations. People say for example that science and technology have their own…

> Regardless of how the sentence continues, there is no such thing. Maybe you misunderstood what I was trying to say? I was not talking about the inventions themselves but the intent of the inventor Sometimes a person (or organization) sits down and says "I want to accomplish so I am going to put resources towards finding a way to do that" can be anything from "a new way of preserving apples" to "a way to kill a whol…

> I was not talking about the inventions themselves but the intent of the inventor

I know. And I say that "there is no such thing" in the sense of it having a meaningful impact on the outside world. It's solely something for the inventor in private to be happy or sad about. There isn't even a point in telling the world their intention. That's like telling the desert to be green and thinking you did something.

> If it turns out that your new way of preserving apples also can be weaponized, is that really your fault for inventing it?

Yes. Partly anyway, of course the main fault is always with people "pulling the trigger". For the reasons laid out above. Weizenbaum couldn't possibly spell it out more clearly, and your response was basically giving an example for what intent is. We know, the response is that it's a fallacy. To just repeat the original thing doesn't change the response to it.

Post reply on HN