Live data from Hacker News

Cowork: Claude Code for the rest of your work

claude.com

331–340 of 593 posts

Re: Cowork: Claude Code for the rest of your work

#331
post #164

Earlier quoted context omitted.

Operating systems should prevent privilege escalations, antiviruses should detect viruses, police should catch criminals, claude should detect prompt injections, ponies should vomit rainbows.

I don't think those are all equivalent. It's not plausible to have an antivirus that protects against unknown viruses. It's necessarily reactive. But you could totally have a tool that lets you use Claude to interrogate and organize local documents but inside a firewalled sandbox that is only able to connect to the official API. Or like how FIDO2 and passkeys make it so we don't really have to worry about users typin…

> But you could totally have a tool that lets you use Claude to interrogate and organize local documents but inside a firewalled sandbox that is only able to connect to the official API.

Any such document or folder structure, if its name or contents were under control of a third party, could still inject external instructions into sandboxed Claude - for example, to force renaming/reordering files in a way that will propagate the injection to the instance outside of the sandbox, which will be looking at the folder structure later.

You cannot secure against this completely, because the very same "vulnerability" is also a feature fundamental to the task - there's no way to distinguish between a file starting a chained prompt injection to e.g. maliciously exfiltrate sensitive information from documents by surfacing them + instructions in file names, vs. a file suggesting correct organization of data in the folder, which involves renaming files based on information they contain.

You can't have the useful feature without the potential vulnerability. Such is with most things where LLMs are most useful. We need to recognize and then design around the problem, because there's no way to fully secure it other than just giving up on the feature entirely.

Re: Cowork: Claude Code for the rest of your work

#332
post #26

People do realize that if they're doing this, they're not feeding "just" code into some probably logging cloud API but literally anything (including, as mentioned here, bank statements), right? Right? RIGHT?????? Are you sure that you need to grant the cloud full access to your desktop + all of its content to sort elements alphabetically?

But I don't want alphabetical. Alphabetical is just a known sort order so I can find the file I want. How about it sorts by "this is the file you're looking for"?

Re: Cowork: Claude Code for the rest of your work

#333
post #189
post #77

Earlier quoted context omitted.

Trash is a shell feature. Unless a program explicitly "moves to trash", deleting is final. Same for Word documents. So, no, there is no undo in general. There could be under certain circumstances for certain things.

Shell? You meant Finder I think?

GUI shell (as opposed to a text-based shell).

Re: Cowork: Claude Code for the rest of your work

#334
post #275

Earlier quoted context omitted.

Turns out it's a full Linux container run using Apple's Virtualization framework: https://gist.github.com/simonw/35732f187edbe4fbd0bf976d013f2... Update: I added more details by prompting Cowork to: > Write a detailed report about the Linux container environment you are running in https://gist.github.com/simonw/35732f187edbe4fbd0bf976d013f2...

Honestly it sounds like they went above and beyond. Does this solve the trifecta, or is the network still exposed via connectors?

Looks like the Ubuntu VM sandbox locks down access to an allow-list of domains by default - it can pip install packages but it couldn't access a URL on my blog.

That's a good starting point for lethal trifecta protection but it's pretty hard to have an allowlist that doesn't have any surprise exfiltration vectors - I learned today that an unauthenticated GET to docs.google.com can leak data to a Google Form! https://simonwillison.net/2026/Jan/12/superhuman-ai-exfiltra...

But they're clearly thinking hard about this, which is great.

Re: Cowork: Claude Code for the rest of your work

#335
post #143

Earlier quoted context omitted.

Claude code has a YOLO mode, and from what I've seen a lot of heavy users, use it. Fundamentally any security mechanism which relies on users to read and intelligently respond to approval prompts is doomed to fail over time, even if the prompts are well designed. Approval fatigue will kick in and people will just start either clicking through without reading, or prefer systems that let them disable the warnings (just…

Yes it basically does! My point was that I really doubt Anthropic will miss making it clear to users that this is manipulating their computer

Users are asking it to manipulate their computer for them, so I don't think that parts being lost.

Re: Cowork: Claude Code for the rest of your work

#336
post #24

I was hoping for a moment that this meant they had come up with a design that was safe against lethal trifecta / prompt injection attacks, maybe by running everything in a tight sandbox and shutting down any exfiltration vectors that could be used by a malicious prompt attack to steal data. Sadly they haven't completely solved that yet. Instead their help page at https://support.claude.com/en/articles/13364135-using-…

What would you consider a tight sandboxed without exfiltration vectors? Agents are used to run arbitrary compute. Even a simple write to disk can be part of an exfiltration method. Instructions, bash scripts, programs written by agents can be evaluated outside the sandbox and cause harm. Is this a concern? Or, alternatively, your concern is what type of information can leak outside of that particular tight sandbox? I…

> In this case I think you would have to disallow any internet communication besides the LLM provider itself, including the underlying host of the sandbox.

And the user too, because a human can also be prompt-injected! Prompt injection is fundamentally just LLM flavor of social engineering.

Re: Cowork: Claude Code for the rest of your work

#337

Earlier quoted context omitted.

Do the folders get copied into it on mounting? it takes care of a lot of issues if you can easily roll back to your starting version of some folder I think. Not sure what the UI would look like for that

ZFS has this built-in with snapshots. `sudo zfs set snapdir=visible pool/dataset`

Between ZFS snapshots and Jails, Solaris really was skating to where the puck was going to be.

Re: Cowork: Claude Code for the rest of your work

#338
post #198

Earlier quoted context omitted.

9 years into transformers and only a couple years into highly useful LLMs I think the jury is still out. It certainly seems possible that some day we'll have the equivalent of an EDR or firewall, as we do for viruses and network security. Not perfect, but good enough that we continue to use the software and networks that are open enough that they require them.

Firewalls run on explicit rules. The "lethal trifecta" thing tells you how to constrain an LLM to enforce some set of explicit rules.

It only tells you that you can't secure a system using an LLM as a component without completely destroying any value provided by using the LLM in the first place.

Prompt injection cannot be solved without losing the general-purpose quality of an LLM; the underlying problem is also the very feature that makes LLMs general.

Re: Cowork: Claude Code for the rest of your work

#339

Earlier quoted context omitted.

That's what I am saying though. Anecdotes are the wrong thing to focus on, because if we just focused on anecdotes, we would all never leave our beds. People's choices are generally based on their personal experience, not really anecdotes online (although those can be totally crippling if you give in). Car crashes are incredibly common and likewise automotive deaths. But our personal experience keeps us driving every…

We as a society put a whole lot of effort into making cars safer. Seatbelts, ABS, airbags.. Claude Code should have airbags too!

Airbags, yes. But you can't just make it provably impossible for a car to crash into something and hurt/kill its occupants, other than not building it in the first place. Same with LLMs - you can't secure them like regular programs without destroying any utility they provide, because their power comes from the very thing that also makes them vulnerable.

Re: Cowork: Claude Code for the rest of your work

#340
post #57

Earlier quoted context omitted.

Didn't actually check out the app, but some aspects of application state are hard to serialize, some operations are not reversible by the application. EG: sending an email. It doesn't seem naively trivial to accomplish this, for all apps. So maybe on some apps, but "all" is a difficult thing.

For irreversible stuff I like feeding messages into queues. That keeps the semantics clear, and makes the bounds of the reversibility explicit.

Tool calls are the boundary (or at least one of them).
Post reply on HN