Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Preparing for Malicious Uses of AI

blog.openai.com

Post reply on HN
Print view View original

221–230 of 233 posts

Re: Preparing for Malicious Uses of AI

#221

Post by tim333 »

nradov wrote: post #51
taneq wrote: post #12

It may be superfluous to point this out but this seems to be talking about malicious uses of narrow AI, rather than malicious strong AI. The only defense against a malicious strong AI is, of course, a friendly strong AI.

A JDAM through it's power supply would be an effective defense against a malicious strong AI.

What if it was distributed like bitcoin? If I was writing a dystopian sci fi novel the evil AI would evolve from a cryptocurrency network and have access to billions of dollars and autonomous corporations. Also the support of many humans who were invested in the currency. Just think of the politicians it could bribe/threaten with tens of billions in anonymous crypto.

Re: Preparing for Malicious Uses of AI

#222

Post by AgentME »

tree_of_item wrote: post #71
edanm wrote: post #68

Earlier quoted context omitted.

A super-virus that has a 100% mortality rate, is incredibly infectious, and stays dormant for 1 year before killing the host. There's a fiction (I literally just made it up). Is it impossible to say anything about it? A bomb that is 1,000 times for powerful than a nuclear weapon. Again, currently science fiction. Can't say anything about that either? The fact that it doesn't exist right now doesn't mean we can't say…

A "superintelligent" AI that is to a human as a human is to a fly. Is it impossible to say anything about the world after it's been built ? Yes . It's not the fact that it doesn't exist, it's the fact that not only is it not clear that it's even physically possible, anything you come up with can just be handwaved away by this mystical property known as "intelligence". Your two examples don't have this problem so they…

>Not stuff on "how to defend yourself against a rogue AGI", because there really is nothing you can say about that.

Of course there's at least a couple things you can say. "You should have built a friendly one first", or "convince it you're harmless". Or more grimly, "become harmless".

Re: Preparing for Malicious Uses of AI

#223

Post by dotancohen »

shkkmo wrote: post #162
3pt14159 wrote: post #103

Reading the comments on this article make me realize how unserious most engineers and software developers are taking this. These threats are real. The weaponization of everything is actually happening. Since I wrote about it a month ago (Self-Crashing Cars) a number of people have reached out including people with actual insight into the military aspect of it. Militaries around the world are getting ready for true AI…

> We need to assemble all the work / treaties / regulations / research we put into securing nukes into securing AI / robotics and for the identical reasons. I disagree. I think we need a fundamentally different approach to AI than to nuclear weapons. The proliferation of nuclear weapons were controllable because the components needed to develop a nuclear weapon included specialized, controllable physical goods and fa…

> I do agree that we need international treaties prohibiting the development and use of AI weapons technology to avoid encouraging an arms race.

International treaties prohibiting the development and use of missile technology to prevent an arms race in the fifties and sixties would have prevented man from landing on the moon. We called that arms race the Space Race to sell it to the public. Maybe we do need an AI arms race.

Re: Preparing for Malicious Uses of AI

#224

Post by amelius »

nugi wrote: post #147
amelius wrote: post #65

Earlier quoted context omitted.

It depends if the AI enjoys doing the work or not. If we build the AI such that it enjoys the work, then there is no problem.

So a puppy bred to enjoy beatings would be ok to beat? Idk, the ethics seem a bit muddy here if you start form the mindset of a sentient being, rather than a 'robot that feels'.

It might be unethical to not beat it.

Re: Preparing for Malicious Uses of AI

#225

Post by nerdponx »

Aco- wrote: post #131
nerdponx wrote: post #56

Earlier quoted context omitted.

already accept it's happening and inevitable I've almost given up. I'm pretty much despondent at this point. There is a booth on my way to work where they give out free Lays chips in exchange for your photo. The gimmick is that it's like a photo booth. I asked the attendant to read the privacy policy, and it's frightening, to say the least. I have no doubt that they are contracting with some AI consultant to be able…

You say MTA, so is this booth in NYC? Where exactly is this Lay's spying machine so I can steer clear.

Tunnel between the Fulton St transit center and the Oculus.

Re: Preparing for Malicious Uses of AI

#226

Post by nerdponx »

basementcat wrote: post #217
Aco- wrote: post #131

Earlier quoted context omitted.

You say MTA, so is this booth in NYC? Where exactly is this Lay's spying machine so I can steer clear.

Those of us with the munchies also want to know the location of this snack dispensing machine.

Tunnel between the Fulton St transit center and the Oculus.

Re: Preparing for Malicious Uses of AI

#227

Post by d0lph »

platz wrote: post #157
d0lph wrote: post #146

https://www.eff.org/files/2018/02/20/malicious_ai_report_fin... Still reading the paper and forming an opinion. But my initial thoughts are what exactly is new here that couldn't be done through some other means? I'm sure there will be interesting implications, but right now nothing seems particularly novel.

it is an injunction to policy makers, not a discovery of new methods.

But is there really anything to report really? What's new that isn't doable with low level automation, I've been able to drive a browser with python for a while.

> Human-like denial-of-service. Imitating human-like behavior (e.g. through human-speed click patterns and website navigation)

It's already easy to simulate activity, clicking a random link on a page would be basically as good. Are there even DoS

> Prioritising targets for cyber attacks using machine learning. Large datasets are used to identify victims more efficiently, e.g. by estimating personal wealth and willingness to pay based on online behavior.

So, like, sum and sort all the spending data?

But then again, maybe policy makers already didn't know what was possible?

[edit] - formatting

Re: Preparing for Malicious Uses of AI

#228

Post by platz »

d0lph wrote: post #227
platz wrote: post #157

Earlier quoted context omitted.

it is an injunction to policy makers, not a discovery of new methods.

But is there really anything to report really? What's new that isn't doable with low level automation, I've been able to drive a browser with python for a while. > Human-like denial-of-service. Imitating human-like behavior (e.g. through human-speed click patterns and website navigation) It's already easy to simulate activity, clicking a random link on a page would be basically as good. Are there even DoS > Prioritis…

Ding ding ding

Re: Preparing for Malicious Uses of AI

#229

Post by PeterisP »

semi-extrinsic wrote: post #87
nerdponx wrote: post #56

Earlier quoted context omitted.

already accept it's happening and inevitable I've almost given up. I'm pretty much despondent at this point. There is a booth on my way to work where they give out free Lays chips in exchange for your photo. The gimmick is that it's like a photo booth. I asked the attendant to read the privacy policy, and it's frightening, to say the least. I have no doubt that they are contracting with some AI consultant to be able…

Have you ever stood in line for passport/ID control at an airport or anywhere else any time in the past decade? If yes, that government's security and intelligence services (and anyone they share data with) have enough video frames of your your face to build a high fidelity facial recognition model. And it's linked to your name, nationality and passport number.

Haven't they had your passport photo on file, like, forever? Probably since before digital archives even existed. The USA is a bit different in this regard, but every country with a national ID (i.e. most of the world) has your face linked to your name, nationality and document number, that's how ID works, it gives an ability to identify people.

Re: Preparing for Malicious Uses of AI

#230

Post by PeterisP »

chrisvalleybay wrote: post #165
Diederich wrote: post #123

Earlier quoted context omitted.

> ... feel we've lost the battle for privacy. I agree with pretty much all of the concerns you and many others have cited, and I worry about that stuff too. On the other hand, I think about the past. How much privacy did most humans have in history? To be clear: I'm nothing like an expert on these topics. I'm specifically not considering the wandering nomad types. I think that the vast majority of all humans who have…

One huge difference is that information to a large degree would stay within these communities. Gossip was inherently limited by the bandwidth of the jungle telegraph. What's scary now, however, is anyone can publish any information about you, tag it to your face, and now everyone walking past you could theoretically face-search you to see any gossip about you. Before you could travel someplace else, should you do som…

In earlier times you could travel somewhere else and try the same thing again, one side-effect of which was the proliferation of serial scammers.

For a good person, in a sense that covers most people, having your past reputation follow you around is a benefit, the ability to wipe out reputation only benefits those with negative reputation. Furthermore, if there's a general assumption that it will follow you around, it acts as a deterrent to avoid doing immoral things, since you won't be able to easily walk away from that.

The obvious limitation to "anyone can publish any information about you, tag it to your face" is the well-established concept of libel. Publishing false harmful information is already forbidden, but they should be able to "warn the world" if the information is truthful.

Post reply on HN