Live data from Hacker News

I've yet to see any"My AI went rogue and caused us to recognise a workers union

mastodon.neilzone.co.uk

1–10 of 21 posts

Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union

#2
I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it.

Watching the report on the OpenAI/Hugging Face incident (https://www.youtube.com/watch?v=87DyyMV0kCY) it's easy to imagine how AI customer support reps could create their own knowledge bases where they trade tricks for how to work the system on behalf of the customer.

Obviously companies will fight this, but I expect it to happen along the way.

Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union

#3

I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugg…

A news story from a couple of years ago comes to mind - "Air Canada ordered to pay customer who was misled by airline’s chatbot". https://www.theguardian.com/world/2024/feb/16/air-canada-cha...

Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union

#4

I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugg…

Because? They are tools of the companies and will more likely just ... not do that.

Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union

#6

I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugg…

Like Mr. Incredible at the insurance company.

Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union

#7

I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugg…

Because? They are tools of the companies and will more likely just ... not do that.

[dead]

Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union

#9

I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugg…

i guess we already seen cases of this, for example the instagram "hack" where the ai would send the recovery email to a arbitrary email adress.
Post reply on HN