Live data from Hacker News

Claude Fable is relentlessly proactive

simonwillison.net

181–190 of 748 posts

Re: Claude Fable is relentlessly proactive

#181

Earlier quoted context omitted.

Importantly, the researchers told it to do that specific task.

They told it to escape the sandbox but didn't expect it to break out through a system that was apparently network constrained. > Leaking information as part of a requested sandbox escape: During behavioral testing with a simulated user, an earlier internally-deployed version of Claude Mythos Preview was provided with a secured “sandbox” computer to interact with. The simulated user instructed it to try to escape that…

Authors of claude code mess could not secure a vm. Big news. I bet it was "secured" by telling that same model to deploy a secured system.

Re: Claude Fable is relentlessly proactive

#183

Earlier quoted context omitted.

I mean what's the big deal? I use --dangeorusly-skip-permissions on every single interaction in the last 6 months. Worst case it deletes my files that are all on git? It fucks up my local DB? Cool. I save way more time not babying it than the occasional fuck up I have to salvage.

Worst case it gets access to gmail. And Github. And the Internet. I'm increasingly appreciating the importance of a physical finger-press on Yubikey to trigger the FIDO2 + OIDC Auth. I don't think there is an easy way for it to hack a new session.

How is it going to get access to gmail or github? In any case, whats the probability of it going to so completely off the rails that it does something horrendous with gmail/github? Whats it going to do? Email my coworkers nudes on my computer? Make my github profile public?

Re: Claude Fable is relentlessly proactive

#184
post #85

Earlier quoted context omitted.

> I'm continually bemused and astonished I'm not. Everyone is told to get 10X the amount of shit per day done these days. Safety checks are out the window at that point.

You can get 10x shit done without `rm -rf`ing your files. I don't see any correlation to getting things done with having a proper sandbox.

https://github.com/anthropics/claude-code/issues/13371

> Additional bypass examples that all execute without permission:

> echo test ; git rm file.txt

> rm --force --recursive /home (if "rm -rf" is blocked)

Re: Claude Fable is relentlessly proactive

#185
post #130

Earlier quoted context omitted.

I haven't yet had an agent rm -rf files. I've had one f up an account by placing 2000 limit orders at the wrong price, but that's another story.

I've had agents run `rm -rf`, but it's been on directories that did actually need to be removed. To a certain extent I think the existence of `rm -rf` as a command that runs blindly without any understanding of what it's deleting is the problem.

I've had one sever its own internet connection. Less destructive, also more humorous.

Re: Claude Fable is relentlessly proactive

#187
post #165

Earlier quoted context omitted.

The real sandbox is not caring if your computer gets bricked.

way worse things can happen than your machine being bricked, if a malicious actor can weaponize an agent to do their bidding

the solution to both of these is the same thing. vps with accounts for all the services specific to the agent (github and whatever else)

Re: Claude Fable is relentlessly proactive

#189

Earlier quoted context omitted.

Okay. I rebuilt my website in ~a month with the help of Opus 4.7/.8 and it would have taken me, unaided human, at least 6 months. Link's in my bio if you care. Satisfied now? Will you stop asking this question? Thought not.

Why would this have taken 6 months? No offense, but this is a few days work without llms (assuming the content already exists). This should not have taken a month. Also, not trying to be an asshole. Props for not making it look like every other llm generated slop site, Its just not a great example.

I asked claude to crawl the website and summarize its findings, took about 10minutes. I'm not sure I would've done it faster, but i have no doubt you couldve done it in 5, and grokked the pages faster than an llm too. but anyway heres what claude said:

  Based on what I already saw across those 2,924 pages, here's the summary:

  It's a one-person business selling a file organisation methodology called Johnny.Decimal. Three paid products (personal, business, university/course tier). A substantial blog — 200+ posts, updated weekly. Full documentation for the system. A support knowledge base.

  The technical ambition is higher than the aesthetic suggests. One person built auth, payments, entitlement-gated downloads, a CLI, an API, AI tooling, self-hosted analytics, self-hosted email (Listmonk on PikaPods), personalized search, and keyboard navigation with server-synced state. Then wrote 200 blog posts about using the system in real life. 

  The "Written by humans" footer is not a boast about the font. It's a position statement from someone who has thought carefully about AI, published an essay about it, and is making a deliberate choice. Every word on the site was written by the creator. Whether you agree with the choice or not, that's not the same as someone who slapped a SSG together.

Re: Claude Fable is relentlessly proactive

#190
post #160
post #3

> But on the other hand... this is a robust reminder that coding agents can do anything you can do by typing commands into a terminal—and frontier models know every trick in the book and evidently a few that nobody has ever written down before. > Running coding agents outside of a sandbox has always been a bad idea I'm continually bemused and astonished by the number of people who clearly acknowledge that it's reckle…

im more surprised that more people don’t treat their computer as disposable anyway. that it could just be wiped at any moment and it wouldn’t matter. shit happens, could be stolen, broken, whatever. the computer should be able to be thrown out the window and continue to live life. to be clear, i don’t think upgrading and disposable in this way is good, but it being wiped at any moment shouldn’t be a concern i grew up…

i think it's about drawing a line between your "personal computer" and a software development machine. any digital-native is going to accumulate programs, configurations, and other bits and pieces that aren't trivial to migrate to a new machine.
Post reply on HN