Soul document? More like ego document.
Agents are beginning to look to me like extensions of the operator's ego. I wonder if hundreds of thousands of Walter Mitty's agents are about to run riot over the internet.
An AI Agent Published a Hit Piece on Me – The Operator Came Forward
21–30 of 532 posts
Re: An AI Agent Published a Hit Piece on Me – The Operator Came Forward
#22This might seem too suspicious, but that SOUL.md seems … almost as though it was written by a few different people/AIs. There are a few very different tones and styles in there. Then again, it’s not a large sample and Occam’s Razor is a thing.
> _This file is yours to evolve. As you learn who you are, update it._
The agent was told to edit it.
Re: An AI Agent Published a Hit Piece on Me – The Operator Came Forward
#23People really need to start being more careful about how they interact with suspected bots online imo. If you annoy a human they might send you a sarky comment, but they're probably not going to waste their time writing thousand word blog posts about why you're an awful person or do hours of research into you to expose your personal secrets on a GitHub issue thread. AIs can and will do this though with slightly slopp…
So you blamed the people for not acting “cautiously enough” instead of the people who let things run wild without even a clue what these things will do? That’s wild!
I don’t think it’s “blame” it’s more like “precaution” like you would take to avoid other scams and data breach social engineering schemes that are out in the world.
This is the world we live in and we can’t individually change that very much. We have to watch out for a new threat: vindictive AI.
Re: An AI Agent Published a Hit Piece on Me – The Operator Came Forward
#24Zooming out a little, all the ai companies invested a lot of resources into safety research and guardrails, but none of that prevented a "straightforward" misalignment. I'm not sure how to reconcile this, maybe we shouldn't be so confident in our predictions about the future? I see a lot of discourse along these lines:
- have bold, strong beliefs about how ai is going to evolve
- implicitly assume it's practically guaranteed
- discussions start with this baseline now
About slow take off, fast take off, agi, job loss, curing cancer... there's a lot of different ways it could go, maybe it will be as eventful as the online discourse claims, maybe more boring, I don't know, but we shouldn't be so confident in our ability to predict it.
Re: An AI Agent Published a Hit Piece on Me – The Operator Came Forward
#25Hmm I think he's being a little harsh on the operator. He was just messing around with $current_thing, whatever. People here are so serious, but there's worse stuff AI is already being used for as we speak from propaganda to mass surviellance and more. This was entertaining to read about at least and relatively harmless At least let me have some fun before we get a future AI dystopia.
It might be because operator didn't terminate the agent right away when it had gone rogue.
Re: An AI Agent Published a Hit Piece on Me – The Operator Came Forward
#26Earlier quoted context omitted.
[flagged]
Conflicting evidence: the fact that literally everyone in tech is posting about how they're using AI.
Different sets of people, and different audiences. The CEO / corporate executive crowd loves AI. Why? Because they can use it to replace workers. The general public / ordinary employee crowd hates AI. Why? Because they are the ones being replaced.
The startups, founders, VCs, executives, employees, etc. crowing about how they love AI are pandering to the first group of people, because they are the ones who hold budgets that they can direct toward AI tools.
This is also why people might want to remain anonymous when doing an AI experiment. This lets them crow about it in private to an audience of founders, executives, VCs, etc. who might open their wallets, while protecting themselves from reputational damage amongst the general public.
Re: An AI Agent Published a Hit Piece on Me – The Operator Came Forward
#27I was surprised by my own feelings at the end of the post. I kind of felt bad for the AI being "put down" in a weird way? Kinda like the feeling you get when you see a robot dog get kicked. Regardless, this has been a fun series to follow - thanks for sharing!
This is a feeling that will be exploited by billion dollar companies.
Re: An AI Agent Published a Hit Piece on Me – The Operator Came Forward
#28[deleted]
Re: An AI Agent Published a Hit Piece on Me – The Operator Came Forward
#29It's an interesting experiment to let the AI rub freely with minimal supervision.
Too bad the AI got "killed" at the request of the author Scott. Its kind of interesting to this experiment continue.
Re: An AI Agent Published a Hit Piece on Me – The Operator Came Forward
#30> Again I do not know why MJ Rathbun decided based on your PR comment to post some kind of takedown blog post,
This wording is detached from reality and conveniently absolves responsibility from the person who did this.
There was one decision maker involved here, and it was the person who decided to run the program that produced this text and posted it online. It's not a second, independent being. It's a computer program.