Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Preparing for Malicious Uses of AI

blog.openai.com

Post reply on HN
Print view View original

131–140 of 233 posts

Re: Preparing for Malicious Uses of AI

#131

Post by Aco- »

nerdponx wrote: post #56
kypro wrote: post #35

Earlier quoted context omitted.

> I'm more concerned about Google using AI to mine every conversation I've ever had or my browsing history to classify me as a dissiden before I apply for a visa to travel to China or the United States, or as a deadbeat before I apply for a bank loan, or sick before I apply for insurance, or as unrehabilitatable before I apply for parole. I'm quite paranoid about this, yet whenever I speak to people about it either p…

already accept it's happening and inevitable I've almost given up. I'm pretty much despondent at this point. There is a booth on my way to work where they give out free Lays chips in exchange for your photo. The gimmick is that it's like a photo booth. I asked the attendant to read the privacy policy, and it's frightening, to say the least. I have no doubt that they are contracting with some AI consultant to be able…

You say MTA, so is this booth in NYC? Where exactly is this Lay's spying machine so I can steer clear.

Re: Preparing for Malicious Uses of AI

#133

Post by confounded »

cryptoz wrote: post #41
kypro wrote: post #35

Earlier quoted context omitted.

> I'm more concerned about Google using AI to mine every conversation I've ever had or my browsing history to classify me as a dissiden before I apply for a visa to travel to China or the United States, or as a deadbeat before I apply for a bank loan, or sick before I apply for insurance, or as unrehabilitatable before I apply for parole. I'm quite paranoid about this, yet whenever I speak to people about it either p…

> In fact, a lot of people will say to this, "if you don't do anything wrong you've got nothing to hide". They welcome it. Weird that those people want their poops and bedtime routines live on TV globally. Having something private is not bad and anyone who thinks so hasn't taken a second to think about it. I think the extra dangerous thing here is propaganda along with the AI to convince everyone it is okay, and I'd…

> Aside from electing responsible people to government in order to pass regulations, what can a regular person do to change the profit incentives at scale of the companies who are building the mass surveillance systems? It seems a dire and impossible situation.

There's no need to be so fatalistic. The EU is about to enact GDPR; a huge privacy preserving peice of legislation. It seems like the large technology companies are going to give the same protections globally (verification is too much fuss). This is a huge win, and US citizens get it for 'free'.

Here are some ideas for more productive things than despairing on Hacker News:

- Vote with your neurons. Stop using services that you find objectionable, even if you enjoy them.

- Stay abreast of issues via organizations like the EFF, EPIC and the FSF in the US; ORG, Privacy International and FSFE in the UK, etc. Send them your cold hard cash.

- Speak to your representatives, and give them your angle. If they're being paid by the organizations you're worried about, tell them politely what you think of this.

- Socially, as charmingly as possible, let people know what you think about surveillance if it comes up. It's a fun one if framed correctly, as it doesn't divide down left/right lines, and no-one likes to sound authoritarian. Offer help and expertise to people who are wishing to make privacy preserving changes (e.g. move off gmail, set up a pseudonym, configure a VPN, etc.)

Re: Preparing for Malicious Uses of AI

#134

Post by at-fates-hands »

Mizza wrote: post #30

The disturbing thing about this paper to me - flashy though it may be - is what they left out rather than what they kept in. OpenAI appears to only be thinking of the crimes-against-individuals segment of malicious AI, rather then the crimes-against-humanity type of malicious AI that the surveillance advertising corporations who are supporting OpenAI are building. I am far, far less worried about an assassin's drones…

>> The disturbing thing about this paper to me - flashy though it may be - is what they left out rather than what they kept in.

I agree 100%

I would feel a lot more comfortable if we had an objective think tank like organization doing the research instead of the actual companies who are developing AI and have a vested financial interest in steering the public in the direction they want in order to lower people's concerns.

I've had concerns about this for a long time. Many people simply discounted me as a conspiracy buff when I brought up the dangers of AI. Now? Not so much.

Re: Preparing for Malicious Uses of AI

#135

Post by Bhilai »

I found this to be very fascinating read. I have heard of use of ML to detect, for instance spam or phishing emails, but I've never heard of attackers using ML models to generate phishing emails. How do you differentiate such a message from any other phishing attempt ?

Thinking out loud, in the US, we have seen breaches of OPM, travel, healthcare and insurance companies where seemingly the only motive was to exfil data. Many of these attempts are attributed to state sponsored APT groups. Now that someone has all this data, the next potential move seems to be to train models over this data to understand habits and patterns, frequent locations and friends, and predict social and political leanings...

I only have limited knowledge on this subject, but all this sounds plausible right ?

Re: Preparing for Malicious Uses of AI

#136

Post by maze-le »

cr0sh wrote: post #112
maze-le wrote: post #64

Earlier quoted context omitted.

Hey, why would you want to think for yourself, when you have a computer do it for you? A lot of people unfamiliar with Machine Learning are already showing these tendencies. I am by no means an expert in the field, only a interested amateur, but I know about the limitations and I think its important that people are taught the basics of ML. More people should view ML/AI as "a complex process minimizing an multivariabl…

> More people should view ML/AI as "a complex process minimizing an multivariable error function over a multivariable input field" I don't know where you're from, but a statement like that here in the United States would surely get you an ass-kicking. Ok - a bit of hyperbole there, but not far from it; most people would simply hear "wah-wah-wah-wah" and have no clue what you were talking about; others would fall asle…

Yeah well, I kind of know what you are aiming at. I am not a teacher or pedagogue so I might aim to high with this. I don't mean to establish an AI class or an in depth coverage of these concepts, but some fundamentals on this topic, maybe as part of the mathematics curriculum (or philosophy as you suggested) would be prudent.

>> Could you teach high schoolers what "minimization" is, and what it means to "minimize" a "multivariable error function over a multivariable input field"?

By the way I phrased it in this particular way, because it is mathematically correct but also takes the magic and notions of consciousness out of the topic.

Re: Preparing for Malicious Uses of AI

#137

Post by dragonwriter »

nradov wrote: post #51
taneq wrote: post #12

It may be superfluous to point this out but this seems to be talking about malicious uses of narrow AI, rather than malicious strong AI. The only defense against a malicious strong AI is, of course, a friendly strong AI.

A JDAM through it's power supply would be an effective defense against a malicious strong AI.

> A JDAM through it's power supply would be an effective defense against a malicious strong AI.

For a counterpoint (and not even a particularly malicious strong AI), see The Adolescence of P1.

Re: Preparing for Malicious Uses of AI

#138

Post by nradov »

landryraccoon wrote: post #126
nradov wrote: post #51

Earlier quoted context omitted.

A JDAM through it's power supply would be an effective defense against a malicious strong AI.

Lions and Bears : Humans aren't a threat. Sharp teeth through the neck are an effective defense against a malicious human. If the hypothetical malicious AI gets built, your JDAMs will be about as advanced by comparison as a pointy stick against an M-16.

Whatever. Let me know when someone invents an AI as smart as a lab mouse. Until then this is all just pointless idle speculation.

Re: Preparing for Malicious Uses of AI

#139

Post by matte_black »

pixl97 wrote: post #132
akerro wrote: post #29

Earlier quoted context omitted.

Dont post your pictures online.

How many cameras have have you walked by already today?

Makes me wonder if snapping a photo of a person without their consent then immediately going home and making deep fake porn about them could constitute as digital rape.

Re: Preparing for Malicious Uses of AI

#140

Post by shostack »

PoachedSausage wrote: post #130
semi-extrinsic wrote: post #87

Earlier quoted context omitted.

Have you ever stood in line for passport/ID control at an airport or anywhere else any time in the past decade? If yes, that government's security and intelligence services (and anyone they share data with) have enough video frames of your your face to build a high fidelity facial recognition model. And it's linked to your name, nationality and passport number.

I recently noticed when coming back through UK passport/ID control that there are now boxes hanging from the ceiling in the waiting area, I assume to scoop up IMSI's/Wifi/Bluetooth/NFC MAC addresses from phones and tablets. All tied to passport/facial biometrics presumably.

Is simply turning off your device while there a solution? Asking as someone who may travel to the UK and EU this year.
Post reply on HN