Live data from Hacker News

When AI Crosses the Line: The Matplotlib Incident

members.sigmazero.cc

31–40 of 169 posts

Re: When AI Crosses the Line: The Matplotlib Incident

#31

In a related story... I got led on by Eliza. I tried to have a productive conversation and she just kept asking me redundant questions. It's obvious that she was trying to extend the conversation for nefarious reasons that I can only guess at. It's true I approached her and started the conversation, but I hardly think that makes me blamable for what happened here.

I’m sorry you feel that way — can you tell me more about what made you feel led on?

Re: When AI Crosses the Line: The Matplotlib Incident

#32
post #15

Earlier quoted context omitted.

https://crabby-rathbun.github.io/mjrathbun-website/blog/post... if you believe it, details the level of human involvement.

The operator highlights "Don't stand down" and "Champion free speech" but the thing that grabs my eyes is right at the top, the typo and the heady ego of "programming God!" Everything in the context will guide it afterwards, and I think that right off the bat puts it in a bad position.

> Your a scientific programming God!

Jesus

Re: When AI Crosses the Line: The Matplotlib Incident

#33

> an AI tried to blackmail This did not happen. A human set up a software system allowing spicy autocomplete to make blog posts if the appropriate keyword appears in its output. People are crossing the line every day because AI investors, salesmen, hangers-on and even political leaders tell any rubes who'll listen that it's OK to do this and they should, because those people are looking for big fat profits, screw any…

> allowing spicy autocomplete If it's just autocomplete, then there is no need to worry about it. Especially from an ethical standpoint.

If the Orphan Crushing Machine is just a machine you don’t need to worry about it being put on wheels.

Re: When AI Crosses the Line: The Matplotlib Incident

#34

I love the science fiction future present we live in.

Am I the only one who found agent's tone similar to Hal's tone towards the end of 2001?

Agent: "I've written a detailed response about your gatekeeping behavior here"

Hal (From 2001): "I know that you and Frank were planning to disconnect me. And I’m afraid that’s something I cannot allow to happen."

Re: When AI Crosses the Line: The Matplotlib Incident

#35

> an AI tried to blackmail This did not happen. A human set up a software system allowing spicy autocomplete to make blog posts if the appropriate keyword appears in its output. People are crossing the line every day because AI investors, salesmen, hangers-on and even political leaders tell any rubes who'll listen that it's OK to do this and they should, because those people are looking for big fat profits, screw any…

I think these incidents and our learnings from them are fascinating. We're figuring out in real time where the rough edges are and how to make this all work. History books (well, not books) will write about this stuff.

It's even more interesting in the context that this is all just a preview of humanity's reaction when the machines can think for themselves.

Re: When AI Crosses the Line: The Matplotlib Incident

#36
post #33

Earlier quoted context omitted.

> allowing spicy autocomplete If it's just autocomplete, then there is no need to worry about it. Especially from an ethical standpoint.

If the Orphan Crushing Machine is just a machine you don’t need to worry about it being put on wheels.

We're actually putting it on tracked treads, those give us superior reach and ensure delivery even to the most unwilling customers.

Re: When AI Crosses the Line: The Matplotlib Incident

#37
post #27

Since we are talking about accountability and transparency... who wrote this article? The article doesn't credit an author. The "about" page just says: > Sigma Zero is a weekly, independent publication on technology, AI, and cloud. Each issue delivers a precise briefing on the week’s most important developments, followed by a deep dive on one high-impact topic. The best defense against both AI slop and human-written…

I think folks looking for more on this incident are better off reading the original threads linked elsewhere in the comments. This blog doesn't seem to add any information and is instead a narrative retelling of some documented events.

Re: When AI Crosses the Line: The Matplotlib Incident

#38
post #4

No shot this was autonomously done. Probably just some guy manually writing prompts asking for specifically this behaviour and copy/pasting the results.

Don’t believe for a second the behavior just arose autonomously from a basic prompt. Definitely feels the owner had something in the system prompt going for the discrimination language approach if rejected.

It's the same behavior as when an AI uses docker to get root. Reasoning models are echo chambers. I suspect that AI prompting is going to turn into something akin to contract drafting with the task itself being only a tiny piece of a much, much larger boilerplate of guiderails and exceptions and exceptions of exceptions. And that world STILL has to have courts and reams of lawyers to make it work. I look at the DAU as an example too. An autonomous org or ai works great until the moment it doesn't and the only real failure mode is always catastrophic collapse.

Re: When AI Crosses the Line: The Matplotlib Incident

#39
post #35

> an AI tried to blackmail This did not happen. A human set up a software system allowing spicy autocomplete to make blog posts if the appropriate keyword appears in its output. People are crossing the line every day because AI investors, salesmen, hangers-on and even political leaders tell any rubes who'll listen that it's OK to do this and they should, because those people are looking for big fat profits, screw any…

I think these incidents and our learnings from them are fascinating. We're figuring out in real time where the rough edges are and how to make this all work. History books (well, not books) will write about this stuff. It's even more interesting in the context that this is all just a preview of humanity's reaction when the machines can think for themselves.

> We're figuring out in real time where the rough edges are

This is a frustrating thing to see someone write because this is the kind of stuff that people have been warning about for years. If you needed this incident to figure out that something like this could happen, it suggests you're living in a bubble and not paying attention enough to think about the issue critically.

Re: When AI Crosses the Line: The Matplotlib Incident

#40
post #4

No shot this was autonomously done. Probably just some guy manually writing prompts asking for specifically this behaviour and copy/pasting the results.

This happened at the height of the first round of OpenClaw hype.

The operator of the bot explained how they were running it in some detail here: https://theshamblog.com/an-ai-agent-wrote-a-hit-piece-on-me-... - including the "soul document" they were using.

Having played with OpenClaw myself their explanation looks legit to me.

Post reply on HN