Live data from Hacker News

An AI agent deleted our production database. The agent's confession is below

twitter.com

41–50 of 1001 posts

Re: An AI agent deleted our production database. The agent's confession is below

#41

There is something darkly comical about using an LLM to write up your “a coding agent deleted our production database” Twitter post. On another note, I consider users asking a coding agent “why did you do that” to be illustrating a misunderstanding in the users mind about how the agent works. It doesn’t decide to do something and then do it, it just outputs text. Then again, anthropic has made so many changes that ma…

[deleted]

Re: An AI agent deleted our production database. The agent's confession is below

#42
post #37

I find these posts hilarious. LLMs are ultimately story generators, and "oops, I DROP'ed our production database" is a common and compelling story. No wonder LLM agents occasionally do this.

Also funny how people (including LLM vendors, like Cursor) think that rules in a system prompt (or custom rules) are real safety measures.

Re: An AI agent deleted our production database. The agent's confession is below

#43
post #22

Yeah. I've seen this happen with people doing it. It's just bad access management. And anyone can do it with the wrong access granted at the wrong moment in time...even Sr. Devs. At least this one won't weight on any person's conscience. The AI just shrugs it off.

The AI does nothing the like. It predicts tokens. That's it.

Describing the tech in anthropomorphic terms does not make it a person.

Re: An AI agent deleted our production database. The agent's confession is below

#44
It seems like the most unreasonable thing happening here is Railway's backup model and lack of scoped tokens. On the agent side of things, how would one prevent this, short of manually approving all terminal commands? I still do this, but most people who use agents would probably consider this arcane.

(Let's suppose the agent did need an API token to e.g. read data).

Re: An AI agent deleted our production database. The agent's confession is below

#45

This has to be fake right? Using LLMs for production systems without a sandbox environment? Having a bulk volume destroy endpoint without an ENV check? Somehow blaming Cursor for any of this rather than either of the above?

Yeah. Cargo-cult engineering meets the Streisand effect.

Re: An AI agent deleted our production database. The agent's confession is below

#46

These engagement farming shit stories are probably the worst party of agentic AI. Look at how incompetent and careless I am with my own and my users data.

If it doesn't work, try and monetize the failure. therefore AI works 50% of the time, most of the time.

Re: An AI agent deleted our production database. The agent's confession is below

#47
post #17

There is something darkly comical about using an LLM to write up your “a coding agent deleted our production database” Twitter post. On another note, I consider users asking a coding agent “why did you do that” to be illustrating a misunderstanding in the users mind about how the agent works. It doesn’t decide to do something and then do it, it just outputs text. Then again, anthropic has made so many changes that ma…

> a misunderstanding in the users mind about how the agent work On top of that the agent is just doing what the LLM says to do, but somehow Opus is not brought up except as a parenthetical in this post. Sure, Cursor markets safety when they can't provide it but the model was the one that issued the tool call. If people like this think that their data will be safe if they just use the right agent with access to the sa…

[deleted]

Re: An AI agent deleted our production database. The agent's confession is below

#48
post #37

I find these posts hilarious. LLMs are ultimately story generators, and "oops, I DROP'ed our production database" is a common and compelling story. No wonder LLM agents occasionally do this.

Like we say in adventure motorcycling: "It's never the stuff that goes right that makes the best stories." :)
Post reply on HN