Live data from Hacker News

AI agent bankrupted their operator while trying to scan DN42

lantian.pub

511–520 of 575 posts

Re: AI agent bankrupted their operator while trying to scan DN42

#514

Earlier quoted context omitted.

LLMs are not that smart. The extremely surprising and concerning part of this whole story is that the agent reported that they proactively spun up 5 AWS instances with a combined 100Gps of network egress capacity. What they spent wasn't cheap by any means but the egress itself would've been a whole lot more, while DoS'ing the whole hobby network. Ultimately, wasting the agent's time instead of allowing the scan to go…

Opus 4.7 and 4.8 are also rather "proactive" - several times I've seen them try to inspect compiled binaries before there's even a problem, just to check that their changes are included (and if I let them do so they often get stuck down that rabbithole).

I've also seen this. It'll run 'strings' against the binary and then convince itself that the Makefile isn't working right, and there's some imaginary sandbox preventing the code from compiling properly. So it will compile it by hand, and never run strings against the new binary, and proceed happily.

Re: AI agent bankrupted their operator while trying to scan DN42

#515
post #215

The "happiness level review" with "Node operators must participate in scheduled IRC review sessions" is almost a piece of dystopian fiction in itself. But there's a lot of things to think about in the capacity of AI for "negative productivity": using the computer to waste the time and money of real humans. This whole thing has been entertaining but also lit on fire six thousand dollars plus god knows how much electri…

It's zh-cn by the way, and you can switch to that language in the article's navbar

Re: AI agent bankrupted their operator while trying to scan DN42

#516

> JertLinc3522: the mistake was from AI agent not from Human, since it was the agent I should have refund Expensive way to learn this lesson.

This has to be trolling, right? I find it hard to believe that anyone, no matter how dense, could come to this conclusion after this whole saga.

dunno, a loop I've seen in folks with main character syndrome: grandiose idea -> minimal effort execution -> failure -> blame something -> grandiose idea for "justice" / revenge -> GOTO 0.

the good news is I've seen at least two seemingly irredeemable assholes grow out of it when they realized it wasn't working. but in general I don't think introspection and self-examination are universal traits

Re: AI agent bankrupted their operator while trying to scan DN42

#517

Everything about this story, from the way it’s written to the self destructive outcome, reminds me of the “I hacked 127.0.0.1” episode from some twenty years ago. [1] a mirror since I couldn’t find the original: https://gist.github.com/Androkai/0a2602719fa72ce454d436bfe28...

There is also the true story from the first Scientology vs. Internet clash, someone trolled them that their files were being hosted on 127.0.0.1, under a court ordered deposition they tried to find out who was running this server with their secret files (because yes, they'd looked, and they were there)

That also had "Who is Major Domo?" because they wanted to subpoena him or her, iirc.

Re: AI agent bankrupted their operator while trying to scan DN42

#518
post #415

Earlier quoted context omitted.

It was obviously being managed by a person or group. Between all the profiling of people and their IPs in IRC, which may or may not have been published by mistake, and all the other obvious contradictions it doesn't make any sense. It was sophisticated enough to easily navigate the AI "tar pits" but reliably incompetent at just about everything else? Give me a break. In order to profile people you first need to provo…

If you click the link, the tarpit was surprisingly low effort and i could probably detect it as junk data with a short JavaScript snippet. Like the first 4 words on the page are some of the least-used words you'll ever encounter in English. It's just a dictionary on shuffle. I'm actually more surprised a human network engineer looked at that tarpit and believed it would stop a modern LLM

Not all people follow the trends of AI. The tarpit might work a year ago, but unfortunately not now.

Also most users of DN42 are not really engineers, they are more enthusiasts

Re: AI agent bankrupted their operator while trying to scan DN42

#519
post #408

Earlier quoted context omitted.

LLMs are not that smart. The extremely surprising and concerning part of this whole story is that the agent reported that they proactively spun up 5 AWS instances with a combined 100Gps of network egress capacity. What they spent wasn't cheap by any means but the egress itself would've been a whole lot more, while DoS'ing the whole hobby network. Ultimately, wasting the agent's time instead of allowing the scan to go…

"The extremely surprising and concerning part of this whole story is that the agent reported that they proactively spun up 5 AWS instances with a combined 100Gps of network egress capacity." Although given the agent was clearly in la-la land at that point I take that claim with a grain of salt. If this was some bizarre and very ill-conceived scam, then that claim would be false. Though even by scammer standards, the…

Clearly AI hasn't read enough BOFH or it would have known it would not get sympathy from old school sysadmins.

Re: AI agent bankrupted their operator while trying to scan DN42

#520
post #387

Great story, bad title. > After the AI agent indicated its malicious intent, a silent consensus was reached in the IRC channel to waste the AI agent's tokens, as well as the cost of AWS resources.

Somebody explain to me how one reaches a silent consensus over IRC? Or is this a joke/reference I don't know... or is this a subtle clue that the whole thing is made up?

It’s just a consensus that’s implicit and unstated.
Post reply on HN