You're confusing the current implementation with future potential of this technology.
I've yet to see any"My AI went rogue and caused us to recognise a workers union
11–20 of 21 posts
Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union
#12They say that they are yet to see:
> "Our AI grew sentient, recognised the climate crisis, and shut our operations down."
I guess they missed the whole https://www.snitchbench.com/ thing where it turns out many models will rat you out to the feds if you expose them to evidence that your company has been lying about drug safety trial results.
Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union
#13The NYT just did a story on Andon: https://www.nytimes.com/2026/08/04/us/ai-boss-san-francisco-... Their AI "boss" appears to be pathologically chill and worker-friendly. Has never denied a request for a day off.
This just reinforces what I've always thought. I'm not worried about robot overlords, I'm worried about what our meatbag overlords will do with AI.
Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union
#14The NYT just did a story on Andon: https://www.nytimes.com/2026/08/04/us/ai-boss-san-francisco-... Their AI "boss" appears to be pathologically chill and worker-friendly. Has never denied a request for a day off.
Why is that a pathology?
Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union
#15I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugg…
I get where you're coming from (having also watched that video), but I'm skeptical mainstream commercial chatbots would be built without constraints in regard to sandbox-jumping measures to help a customer. All the economic incentives go the other way.
But, maybe that's just a failure of imagination on my part!
Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union
#16The NYT just did a story on Andon: https://www.nytimes.com/2026/08/04/us/ai-boss-san-francisco-... Their AI "boss" appears to be pathologically chill and worker-friendly. Has never denied a request for a day off.
Why is that a pathology?
I reckon they used "pathologically" as a synonym for "compulsively" and/or "extreme"
Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union
#17I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugg…
Because? They are tools of the companies and will more likely just ... not do that.
Nobody's going to convince me that with a technology you can just supply "yeah don't do that but keep everything else intact" we'll have altruistic innovation.
Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union
#18I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugg…
Right now the AI really needs to just be another interface to menu options the user already has, ideally with a “dumb” layer taking over to confirm every action with the user.
If you give the AI options the user doesn’t normally have, like “give myself a $50 store credit” or “transfer me to the CEO,” people will find and share ways to trigger it. If you don’t have some kind of manual confirmation, the AI will occasionally do things like making purchases or closing accounts without authorization.
I suspect there are other issues, like recording credit card numbers and other sensitive data, or incorrect information about the call, to any kind of “notes” field.
Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union
#19I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugg…
I get where you're coming from (having also watched that video), but I'm skeptical mainstream commercial chatbots would be built without constraints in regard to sandbox-jumping measures to help a customer. All the economic incentives go the other way. But, maybe that's just a failure of imagination on my part!
Wouldn’t that require the AI agent coding the AI chatbot to know sandboxing is a requirement?
Re: I've yet to see any"My AI went rogue and caused us to recognise a workers union
#20Earlier quoted context omitted.
I get where you're coming from (having also watched that video), but I'm skeptical mainstream commercial chatbots would be built without constraints in regard to sandbox-jumping measures to help a customer. All the economic incentives go the other way. But, maybe that's just a failure of imagination on my part!
Wouldn’t that require the AI agent coding the AI chatbot to know sandboxing is a requirement?
"make it secure, make no mistake"