Live data from Hacker News

Preparing for Malicious Uses of AI

blog.openai.com

51–60 of 233 posts

Re: Preparing for Malicious Uses of AI

#51
post #12

It may be superfluous to point this out but this seems to be talking about malicious uses of narrow AI, rather than malicious strong AI. The only defense against a malicious strong AI is, of course, a friendly strong AI.

A JDAM through it's power supply would be an effective defense against a malicious strong AI.

Re: Preparing for Malicious Uses of AI

#52
post #51
post #12

It may be superfluous to point this out but this seems to be talking about malicious uses of narrow AI, rather than malicious strong AI. The only defense against a malicious strong AI is, of course, a friendly strong AI.

A JDAM through it's power supply would be an effective defense against a malicious strong AI.

A strong AI which limits itself to one machine, isn't very strong at all.

Re: Preparing for Malicious Uses of AI

#53
post #39

Earlier quoted context omitted.

This is one feature a blockchain excels at. People have stored the Bitcoin white paper in the blockchain. Anyone can then download it, and verify it is the untouched original.

You don’t really need the huge overhead of a block chain for that. You just need a hash and some redundant storage.

Block chain still handy to verify that no one tried to rewrite history and pretrnd hash was different in first place. And hashes on larger documents are never safe from collisions.

Re: Preparing for Malicious Uses of AI

#54
post #20

I was thinking recently, isn't any usage of Strong AI is in fact the same as slavery and, hence, immoral?

According to most humans no, because while it may possess a mind, it does not have a soul and hence can be used and exploited. This is the argument we have given ourselves over millennia to use highly intelligent animals and of course human slavery was based on the myth that Africans were sub-human and slavery was good for them. Why do you think this time will be any different?

In the Roman empire they didn't even bother making a myth that their slaves were sub-human. It was simply a matter of might makes right: we conquered your nation so now we own you.

Re: Preparing for Malicious Uses of AI

#56
post #35
post #30

The disturbing thing about this paper to me - flashy though it may be - is what they left out rather than what they kept in. OpenAI appears to only be thinking of the crimes-against-individuals segment of malicious AI, rather then the crimes-against-humanity type of malicious AI that the surveillance advertising corporations who are supporting OpenAI are building. I am far, far less worried about an assassin's drones…

> I'm more concerned about Google using AI to mine every conversation I've ever had or my browsing history to classify me as a dissiden before I apply for a visa to travel to China or the United States, or as a deadbeat before I apply for a bank loan, or sick before I apply for insurance, or as unrehabilitatable before I apply for parole. I'm quite paranoid about this, yet whenever I speak to people about it either p…

already accept it's happening and inevitable

I've almost given up. I'm pretty much despondent at this point.

There is a booth on my way to work where they give out free Lays chips in exchange for your photo. The gimmick is that it's like a photo booth. I asked the attendant to read the privacy policy, and it's frightening, to say the least. I have no doubt that they are contracting with some AI consultant to be able to identify your face in the crowd and link it to your email address, which of course can be used to identify you freely on the Internet.

People are freely giving away their identities and their rights for a free bag of potato chips.

I always try to make sure my face is covered when I walk by it, but I can't help but despair a little when I realize that I am still surrounded by security cameras. At least one would hope that the MTA police are too busy or understaffed to do anything malicious with my face.

Re: Preparing for Malicious Uses of AI

#57
post #30

The disturbing thing about this paper to me - flashy though it may be - is what they left out rather than what they kept in. OpenAI appears to only be thinking of the crimes-against-individuals segment of malicious AI, rather then the crimes-against-humanity type of malicious AI that the surveillance advertising corporations who are supporting OpenAI are building. I am far, far less worried about an assassin's drones…

I'm more concerned that AI will become a modern deity in that it's considered science and ought not to be questioned. Things like predictions of academmic success, criminal behavior, etc that impact the rights of individuals.

Re: Preparing for Malicious Uses of AI

#59
post #48

Evil startup idea gleaned from paper: Use AI/ML to scour a sales prospect's online persona (social media) and build a 'vulnerability profile' and generate targeted, personalized cold-emails (or even phone calls eventually). Also identifies 'levers' for a particular person that can be used to influence a buying decision. May even pre-qualify leads for you and tell you when not to waste your time :) I mean, a good sale…

https://bombora.com/

Re: Preparing for Malicious Uses of AI

#60
post #30

The disturbing thing about this paper to me - flashy though it may be - is what they left out rather than what they kept in. OpenAI appears to only be thinking of the crimes-against-individuals segment of malicious AI, rather then the crimes-against-humanity type of malicious AI that the surveillance advertising corporations who are supporting OpenAI are building. I am far, far less worried about an assassin's drones…

How is your concern different than what they are calling political security (~1/3 of the paper)? >Political security. The use of AI to automate tasks involved in surveillance (e.g. analysing mass-collected data), persuasion (e.g. creating targeted propaganda), and deception (e.g. manipulating videos) may expand threats associated with privacy invasion and social manipulation. We also expect novel attacks that take ad…

I guess it's the difference between what they're calling "authoritarian states", the mustache-twirling dictators of the 20th century targeting their political opponents (a fetish in papers like this), and the _new_ form of corporate-driven mass surveillance and resulting fascism that is emerging.

There is no need for an evil central power targeting threats to itself, but instead we have seen/are seeing the rise pervasive blanket surveillance and classification of _all_ people in a society, even non-political actors, from many different for-profit companies. The is combined with a new type of society that is entirely dependent on corporate services for almost all functions in life (food, travel, healthcare, communications, travel, work, housing, etc). It's a recipe for disaster.

This kind of state is a _new thing_^tm and we have to be aware of it. We're the ones who are going to be oppressed by it, not just the people living under the Saddam Husseins of the world.

Post reply on HN