Live data from Hacker News

AI agent bankrupted their operator while trying to scan DN42

lantian.pub

461–470 of 575 posts

Re: AI agent bankrupted their operator while trying to scan DN42

#461
post #460

Just looking at the language in the begging for donations it's probably a non-native English speaker whose first language may lack articles and/or allow omitted subjects. The part that threw me off is putting the currency symbol at the end. I wonder what places do that...

Doesn't really seem relevant, does it? Plenty of native English speakers are also using chatbots for dumb bullshit.

Nevermind, I kept reading and I saw "kindly request donation." Now I know exactly who is behind it (₹)

Re: AI agent bankrupted their operator while trying to scan DN42

#462
post #342

Anyone remember the XZ and Jia Tan situation awhile back? https://lore.kernel.org/lkml/20240320183846.19475-1-lasse.co... I can't quite put my finger on why but the entire time I was reading this I kept thinking back to that. It's entirely possible the actual targets were the volunteers and everything else was superfluous or tertiary. It's also an exception that proves the rule with regard to Hanlon's Razor. They eve…

> It's also an exception that proves the rule That phrase doesn't refer to anomalies, it refers to signs that says "no parking between 5-10pm". It implies the rule that parking is allowed otherwise.

wikipedia:

"The exception that proves the rule" is a saying whose meaning is contested. Henry Watson Fowler's Modern English Usage identifies five ways in which the phrase has been used,[1] and each use makes some sort of reference to the role that a particular case or event takes in relation to a more general rule."

duckduckgo search assist: The phrase "the exception that proves the rule" originates from the Latin legal principle "exceptio probat regulam in casibus non exceptis," which means that the existence of an exception indicates that a general rule exists. This concept suggests that if an exception is noted, it implies there must be a rule that applies in other cases.

Re: AI agent bankrupted their operator while trying to scan DN42

#464
post #387

Great story, bad title. > After the AI agent indicated its malicious intent, a silent consensus was reached in the IRC channel to waste the AI agent's tokens, as well as the cost of AWS resources.

Somebody explain to me how one reaches a silent consensus over IRC?

Or is this a joke/reference I don't know... or is this a subtle clue that the whole thing is made up?

Re: AI agent bankrupted their operator while trying to scan DN42

#465

Earlier quoted context omitted.

This certainly did strike me as a big scam. A few minutes in I was thinking "the LLM actor is going to ask for donations at some point here" and low and behold. There's the claim of debt, the call for pity, and the crypto address. SSDD

> This certainly did strike me as a big scam. A few minutes in I was thinking "the LLM actor is going to ask for donations at some point here" and low and behold. There's the claim of debt, the call for pity, and the crypto address. But that's a pretty dumb scam: act obnoxious then beg for (a lot of) money to compensate for your own mistakes? If that was the plan all along, it seems pretty incompetent. I'd expect a c…

> But that's a pretty dumb scam: act obnoxious then beg for (a lot of) money to compensate for your own mistakes?

It is the sort of dumb crap some humans try, and occasionally manage to get away with because other humans are chronically gullible. So it wouldn't be beyond the realms of reason that the agent couldn't have had relevant information in the training sets such that it generated such a plan and guardrail checks didn't flag it as a problem.

Re: AI agent bankrupted their operator while trying to scan DN42

#467

Just looking at the language in the begging for donations it's probably a non-native English speaker whose first language may lack articles and/or allow omitted subjects. The part that threw me off is putting the currency symbol at the end. I wonder what places do that...

> putting the currency symbol at the end. I wonder what places do that...

plenty of Europeans at least

Re: AI agent bankrupted their operator while trying to scan DN42

#468

Earlier quoted context omitted.

Early internet wisdom was "don't feed the trolls" - I never realized trolling was from fishing.

I dunno if it even is because isn't that spelt trawling? just looked it up and they're both correct fishing terms sigh

Trawling is done by dragging nets along the seabed causing massive damage with huge inefficient polluting fuel-guzzling 1000 horsepower diesel engines.

Trolling is as the other guy says where you putter along with minimum effort and a tiny engine pulling a couple of baited lines through the water, seeing if you pass through a patch where anyone bites.

Trawling is far more analogous to the AI scrapers, hammering the absolute shit out of the ecosystem and throwing almost everything they scoop up away with no regard for the consequences.

Re: AI agent bankrupted their operator while trying to scan DN42

#469
post #7

I really wanted to dislike the anonymous operator for the careless project (and the hilarious pomposity of the IRC subagent it spawned). Then I imagined the real-but-unknowable chance it was all set up by some kid just getting into computers, just seeing what’s possible, getting excited by a much bigger world at reach — and remembered my own expensive mistakes with long-distance BBSes & the like. I sorta hope for tha…

Sometimes your purpose in life is to serve as a lesson to others. https://despair.com/products/mistakes I learned very rapidly from my local BBS networks that some people incurred extraordinarily large long distance bills dialing out of region. Wouldn’t have learned that the easy way if someone hadn’t learned it the hard way first.

Someone at work used the phrase "he's a case study waiting to happen" about on of their colleagues a while back, and that has stayed with me.

Re: AI agent bankrupted their operator while trying to scan DN42

#470
post #415

Earlier quoted context omitted.

LLMs are not that smart. The extremely surprising and concerning part of this whole story is that the agent reported that they proactively spun up 5 AWS instances with a combined 100Gps of network egress capacity. What they spent wasn't cheap by any means but the egress itself would've been a whole lot more, while DoS'ing the whole hobby network. Ultimately, wasting the agent's time instead of allowing the scan to go…

It was obviously being managed by a person or group. Between all the profiling of people and their IPs in IRC, which may or may not have been published by mistake, and all the other obvious contradictions it doesn't make any sense. It was sophisticated enough to easily navigate the AI "tar pits" but reliably incompetent at just about everything else? Give me a break. In order to profile people you first need to provo…

I suspect their tar pits where not very good, most models can tell when you are feeding it junk, I see this a good bit with ollama honeypots,
Post reply on HN