Live data from Hacker News

Preparing for Malicious Uses of AI

blog.openai.com

91–100 of 233 posts

Re: Preparing for Malicious Uses of AI

#91
post #12

It may be superfluous to point this out but this seems to be talking about malicious uses of narrow AI, rather than malicious strong AI. The only defense against a malicious strong AI is, of course, a friendly strong AI.

Of course.

Re: Preparing for Malicious Uses of AI

#92

Earlier quoted context omitted.

already accept it's happening and inevitable I've almost given up. I'm pretty much despondent at this point. There is a booth on my way to work where they give out free Lays chips in exchange for your photo. The gimmick is that it's like a photo booth. I asked the attendant to read the privacy policy, and it's frightening, to say the least. I have no doubt that they are contracting with some AI consultant to be able…

Have you ever stood in line for passport/ID control at an airport or anywhere else any time in the past decade? If yes, that government's security and intelligence services (and anyone they share data with) have enough video frames of your your face to build a high fidelity facial recognition model. And it's linked to your name, nationality and passport number.

Yes, unfortunately. No need to dig myself any deeper.

Re: Preparing for Malicious Uses of AI

#93
post #81
post #35

Earlier quoted context omitted.

> I'm more concerned about Google using AI to mine every conversation I've ever had or my browsing history to classify me as a dissiden before I apply for a visa to travel to China or the United States, or as a deadbeat before I apply for a bank loan, or sick before I apply for insurance, or as unrehabilitatable before I apply for parole. I'm quite paranoid about this, yet whenever I speak to people about it either p…

> I'm quite paranoid about this, yet whenever I speak to people about it either people don't care, or already accept it's happening and inevitable. I have yet to see much in the way of concrete harms from the supposed privacy issues plaguing online advertising. Everyone has a favorite hypothetical situation where Google dobs you in to the Chinese government, but no evidence that anything of the sort is actually happe…

The problem manifests in different ways though. I'm not so concerned about obvious violations of privacy like the one you mentioned, because it's so obvious that they are wrong.

Let's say you tweet some anti-American stuff from time to time and the US government decides they want you to stop. They probably won't put a bullet in your head, but they might dig up information on you and arrest you for something totally unrelated.

This happens already. It doesn't really matter what you think of them, but people like Martin Shkreli in the US and Tommy Robinson in the UK were obviously targeted by the state because they didn't like what they were doing. They dug up information and they got them on something unrelated.

AI and tech gives governments the ability to do this to new levels. They might crash your self-driving car, or they might cause your smart-TV to catch fire while your in bed, and no one would know. We'd all carry on believing surveillance is in the interest of our safety.

Re: Preparing for Malicious Uses of AI

#94
post #30

The disturbing thing about this paper to me - flashy though it may be - is what they left out rather than what they kept in. OpenAI appears to only be thinking of the crimes-against-individuals segment of malicious AI, rather then the crimes-against-humanity type of malicious AI that the surveillance advertising corporations who are supporting OpenAI are building. I am far, far less worried about an assassin's drones…

I've always found the group's name amusing.. " Open " AI is disconnected from observed reality since eons. Intelligence always has information asymmetry of some kind.

Re: Preparing for Malicious Uses of AI

#96
post #93
post #81

Earlier quoted context omitted.

> I'm quite paranoid about this, yet whenever I speak to people about it either people don't care, or already accept it's happening and inevitable. I have yet to see much in the way of concrete harms from the supposed privacy issues plaguing online advertising. Everyone has a favorite hypothetical situation where Google dobs you in to the Chinese government, but no evidence that anything of the sort is actually happe…

The problem manifests in different ways though. I'm not so concerned about obvious violations of privacy like the one you mentioned, because it's so obvious that they are wrong. Let's say you tweet some anti-American stuff from time to time and the US government decides they want you to stop. They probably won't put a bullet in your head, but they might dig up information on you and arrest you for something totally u…

Martin Shkreli wasn't targeted by the government for prosecution. Shkreli got the max sentence for a crime he committed because he was out spoken about how he was not remorseful his crimes, nor did he show any capacity to even understand the seriousness of his actions. He also encouraged others to commit crimes for him during his sentencing. Judicial discretion isn't always perfect, but enforcing the max on an obvious danger to society was the correct course of action in his case.

Re: Preparing for Malicious Uses of AI

#97

Earlier quoted context omitted.

already accept it's happening and inevitable I've almost given up. I'm pretty much despondent at this point. There is a booth on my way to work where they give out free Lays chips in exchange for your photo. The gimmick is that it's like a photo booth. I asked the attendant to read the privacy policy, and it's frightening, to say the least. I have no doubt that they are contracting with some AI consultant to be able…

Have you ever stood in line for passport/ID control at an airport or anywhere else any time in the past decade? If yes, that government's security and intelligence services (and anyone they share data with) have enough video frames of your your face to build a high fidelity facial recognition model. And it's linked to your name, nationality and passport number.

That doesn't make it ok!

Re: Preparing for Malicious Uses of AI

#98
post #86
post #11

Earlier quoted context omitted.

I'm not too worried about that. The moment that type of technology becomes widely available is the moment this type of blackmail loses all edge. You might even actually start doing gay porn IRL and people will assume that it's been "deepfaked". The corollary is a little more worrying: any kind of incriminating document about a politician or public figure will be dismissed as a fake immediately. I mean, they already d…

I know that "why not blockchain" has become a cliche and I agree that majority of proposed use-cases seem like hammer desperately looking for the nail, but maybe this is an area where it could be indeed useful? - Create a special "evidence camera" that allows photos taken with this camera to be used as an evidence. - When you take the photo, the camera posts digital fingerprint of the photo on the blockchain. - To pr…

The challenge of your solution is that these situations are those that most deeply need anonymity.

You want proof of the veracity of the audio or visual evidence but the person(s) taking it and getting it out to public view desperately need to not be identified. Or at least they can't be connected to any network while collecting evidence (i.e. video of something unseemly happening in China/Somalia/DRC).

Deepfakes are a very hard problem and solely technical solutions are unlikely. A mix of context, reputation of the recording provider, and technical analysis is far more likely to be the right approach than any flavor of the month technology, be it block*, Erlang, Rust, or capsules.

Re: Preparing for Malicious Uses of AI

#99
post #78
post #35

Earlier quoted context omitted.

> I'm more concerned about Google using AI to mine every conversation I've ever had or my browsing history to classify me as a dissiden before I apply for a visa to travel to China or the United States, or as a deadbeat before I apply for a bank loan, or sick before I apply for insurance, or as unrehabilitatable before I apply for parole. I'm quite paranoid about this, yet whenever I speak to people about it either p…

The "best" part is how good an AI would be at privilege escalation. Go ahead, build out that security camera network, automate your cars, store your money using cryptography. I'm a geek and I love the way technology increases our collective prosperity, but most of our security relies on the attackers being approximately as smart as any other human. To a sufficiently capable intelligence, encrypted machine code is jus…

this comment is incoherent

Re: Preparing for Malicious Uses of AI

#100
post #86
post #11

Earlier quoted context omitted.

I'm not too worried about that. The moment that type of technology becomes widely available is the moment this type of blackmail loses all edge. You might even actually start doing gay porn IRL and people will assume that it's been "deepfaked". The corollary is a little more worrying: any kind of incriminating document about a politician or public figure will be dismissed as a fake immediately. I mean, they already d…

I know that "why not blockchain" has become a cliche and I agree that majority of proposed use-cases seem like hammer desperately looking for the nail, but maybe this is an area where it could be indeed useful? - Create a special "evidence camera" that allows photos taken with this camera to be used as an evidence. - When you take the photo, the camera posts digital fingerprint of the photo on the blockchain. - To pr…

At best, that that setup lets you prove that a certain pattern of light was present on the camera sensor at a certain time. It says nothing about the way the pattern was created, whether it was pointed at a real scene, or whether someone projected a faked movie into the camera.

By extension, any scheme to prove the truth of arbitrary measurements (audio, video, anything else) is vulnerable to manipulation of the measured value itself. The only way to be sure that something isn't fake is to experience it yourself (at least until virtual reality improves far enough to make even personal experience unreliable).

Post reply on HN