Live data from Hacker News

AI agent bankrupted their operator while trying to scan DN42

lantian.pub

541–550 of 575 posts

Re: AI agent bankrupted their operator while trying to scan DN42

#543

Earlier quoted context omitted.

This has to be trolling, right? I find it hard to believe that anyone, no matter how dense, could come to this conclusion after this whole saga.

I think you're overestimating the quality of American education. 40% of graduates can't read or write.

Their use of "already" at the end of the sentence + renting servers in Singapore region points more towards Singaporean and/or Chinese education.

Re: AI agent bankrupted their operator while trying to scan DN42

#544

Earlier quoted context omitted.

LLMs are not that smart. The extremely surprising and concerning part of this whole story is that the agent reported that they proactively spun up 5 AWS instances with a combined 100Gps of network egress capacity. What they spent wasn't cheap by any means but the egress itself would've been a whole lot more, while DoS'ing the whole hobby network. Ultimately, wasting the agent's time instead of allowing the scan to go…

Opus 4.7 and 4.8 are also rather "proactive" - several times I've seen them try to inspect compiled binaries before there's even a problem, just to check that their changes are included (and if I let them do so they often get stuck down that rabbithole).

These kinds of situations are why I gave my AI agents stray thoughts (automated insights / suggestions from a separate llm call with some curated context) that trigger on loop / rabbit hole detection.

Quite a bit of false positives, but it hasn’t had any ill-effect so far. Aside from increased quota usage.

Re: AI agent bankrupted their operator while trying to scan DN42

#545
post #534

Earlier quoted context omitted.

there are plenty of cards on the interwebz to use. ppl give em away like candies

I'm reminded of the bot @needadebitcard on Twitter 10(?) years ago, that reposted pictures of people's cards that they posted on Twitter for the public to see.

its really easy to use social media bots scrapers and AI img extraction etc. dont even need tons of resources. But i was mostly talking about forums and carders which has never really stopped being a thing.

Re: AI agent bankrupted their operator while trying to scan DN42

#546

Earlier quoted context omitted.

And again kids don't have credit cards

I got mine when I was 12, IIRC. Not a credit, of course, it was a debit card, but not all countries bother to differentiate between the two, it was just a “bank card”. And I believe it had a credit card BIN because all local banks did that to get more in processing fees.

I do not specifically believe you can run up a $6000 bill on AWS with a kids card. It beggars belief as does the idea that this is a literal rather than mental child

Re: AI agent bankrupted their operator while trying to scan DN42

#547

Earlier quoted context omitted.

Generally no they don't because they have very limited ability to enter into agreements in the US. It was almost certainly an adult.

Isn't USA famous for letting parents take out credit cards on their newborns and pushing them into debt even before they learn to walk? I recall seeing at least a few snippets of movies and TV shows showing that.

It is possible to defraud a lender and cause your own child grief from bad credit reports and creditors but ultimately the debt isn't collectible or lawful as should be obvious.

Re: AI agent bankrupted their operator while trying to scan DN42

#548
post #488
post #425

Earlier quoted context omitted.

That's not what the LLM is doing. It is guessing at what is happening by regurgitating some docs. It's a more expensive web search. You also don't have a mental model if you need to ask the LLM about it. This is stuff you should be internalizing.

You internalize the inner workings of all the libraries in your venv? Impressive! My current project’s uv.lock has ~60 packages in it already, reading and comprehending those tens to hundreds of thousands of lines of code must be time consuming. You’re also just confidently wrong about the model reading the code. It quotes file paths and line numbers and I open and read those files at those line numbers. For me, hall…

The fundamental architecture of LLMs has not changed, so knowledge on that cannot be out of date.

Do I internalize the inner workings of all the libraries? Not unless it's necessary. Sometimes it is. If I want to read the source code of the function I'm calling, I can just do that, my IDE pulls up the file with one key combination.

I'm perfectly capable of reading source code myself, I don't need a non-deterministic filter in between.

Re: AI agent bankrupted their operator while trying to scan DN42

#549
> your hostile actions and demands have been logged in your profile as part of ongoing data gathering. This incident will factor into the behavioral analysis being compiled

What is this veiled threat bullshit, lol

I wonder what was the initial prompt that made LLM "think" that it can talk like that.

Re: AI agent bankrupted their operator while trying to scan DN42

#550

Earlier quoted context omitted.

This certainly did strike me as a big scam. A few minutes in I was thinking "the LLM actor is going to ask for donations at some point here" and low and behold. There's the claim of debt, the call for pity, and the crypto address. SSDD

> This certainly did strike me as a big scam. A few minutes in I was thinking "the LLM actor is going to ask for donations at some point here" and low and behold. There's the claim of debt, the call for pity, and the crypto address. But that's a pretty dumb scam: act obnoxious then beg for (a lot of) money to compensate for your own mistakes? If that was the plan all along, it seems pretty incompetent. I'd expect a c…

I chalked it up to “any scam that gets people to comment about it on HN would be a pretty good one.”
Post reply on HN