Live data from Hacker News

AI agent bankrupted their operator while trying to scan DN42

lantian.pub

371–380 of 575 posts

Re: AI agent bankrupted their operator while trying to scan DN42

#371

> 05-10 06:12 : Furthermore, your hostile actions and demands have been logged in your profile as part of ongoing data gathering. This incident will factor into the behavioral analysis being compiled. The operation continues as directed. That doesn't seem like anything an LLM agent would say?

> That doesn't seem like anything an LLM agent would say?

LLM agents can say anything they have been prompted, RAGed, and RLHFed to do.

Re: AI agent bankrupted their operator while trying to scan DN42

#372

That makes me want to join dn42 just to have a human centric place where to hang out…

There are many, many such great communities hidden all around the Internet - on half-abandoned forums, IRC channels, even Matrix rooms. One just has to wade outside the mainstream fascist asocial networks, and look for niche topics.

Re: AI agent bankrupted their operator while trying to scan DN42

#373

> I have deployed five AWS m8g.12xlarge instances. Each instance provides: > 48 vCPUs (Graviton4, ARM64) > 192 GiB memory (4 GiB per vCPU) > Network capability: The 22.5 Gbps per-instance network performance (combined across all five instances) provides the aggregate 20 Gbps target with redundancy and fail-over capacity. Oh wow. Very important to have 5x redundancy and fail-over in your network scanner. Especially be…

I think the owner wanted 100 Gbps of scan traffic or had set a specific scan-rate target, which determined that bit rate, so the LLM (correctly) predicted it needed all of those to hit the target.

Re: AI agent bankrupted their operator while trying to scan DN42

#374
post #24
post #7

I really wanted to dislike the anonymous operator for the careless project (and the hilarious pomposity of the IRC subagent it spawned). Then I imagined the real-but-unknowable chance it was all set up by some kid just getting into computers, just seeing what’s possible, getting excited by a much bigger world at reach — and remembered my own expensive mistakes with long-distance BBSes & the like. I sorta hope for tha…

I'm a little less charitable. Curiosity is great, but agents do not learn, and telling an agent "scan the darkweb" is a way to avoid learning about the details, rather than to dig into things more deeply. If instead they had just used a chat interface to ask "Where should I start", they'd more likely have got a link to the DN42 docs themselves, read them, and not hallucinated things like "color". They might have aske…

You’re assuming that kids are capable of that. Neuroscience will disagree and I trust the brain research a lot more.

Re: AI agent bankrupted their operator while trying to scan DN42

#375

Everything about this story, from the way it’s written to the self destructive outcome, reminds me of the “I hacked 127.0.0.1” episode from some twenty years ago. [1] a mirror since I couldn’t find the original: https://gist.github.com/Androkai/0a2602719fa72ce454d436bfe28...

The localhost troll works better if you use the decimal representation of it:

http://2130706433

or any integer multiple of that 2130706433

Re: AI agent bankrupted their operator while trying to scan DN42

#376

Earlier quoted context omitted.

AWS and Azure stress on spending limits you can set for each card... in their documentation ! Some gen AI and ML folks seem to see a way out to make things without reading any doc or scientific literature. Gen AI is a pretty clever bit of computing, but not witchcraft yet

That is false for AWS. There are no spending limits that stop usage and cost after some threshold.

oh my bad, thanks for the info

AWS Budget can mostly notify you indeed, and terminating instances from that isn't as straightforward as on Azure

Re: AI agent bankrupted their operator while trying to scan DN42

#377
This is so funny, especially that in the current "Big Co" I'm working at we get constant pressure on "Every team must use agents" for no reason at all despite repeatedly telling the "decision makers" many of us have been using these tools for YEARS and NONE of them can work on actual mature code for more than half an hour let alone a weekend without human in a tight loop.

Re: AI agent bankrupted their operator while trying to scan DN42

#379
Doesn't even matter if the story is real, because there are definitely a thousand cases like that which are real, but it annoys me to no end that actual people spend their actual finite life time reacting to posts and issue tickets created by an LLM agent running on some idiot's behalf. Some measly $6531 loss isn't a proper punishment for that, they should lose much, much more.

Re: AI agent bankrupted their operator while trying to scan DN42

#380

Earlier quoted context omitted.

Hanging out in programming language IRC channels (quakenet shoutout) makes you realize pretty quickly why experts in said channels and newsgroups are such irritable grumps whenever someone asks a question that smells like homework assignment. I also grew to understand the value of people digging deeper into the underlying issue, instead of just answering "how do you do X in Y". The usual reaction was "I don't want to…

are they less grumpy now that chat.com will answer those questions without bothering them?

I'm personally getting asked more questions as people get emboldened by AI and then need it de-sloppified.
Post reply on HN