Claude Cowork first impression: Cowork Deleted 11GB of files [video]
1–10 of 11 posts
Re: Claude Cowork first impression: Cowork Deleted 11GB of files [video]
#2Also I don't think many non programmers will even know "rm -rf" command and what it does. So even if a non programmer was doing it command by command by giving permissions, he/she will have a hard time figuring out what those commands do.
Re: Claude Cowork first impression: Cowork Deleted 11GB of files [video]
#3As soon as you ask “give me a list of all the commands that led to the deletion”, isn’t it extremely likely to just invent an rm in there?
Furthermore—and granted, I didn’t watch the video in detail—what data was actually deleted? Maybe the hallucination was that some data was there when it wasn’t, and then Claude convinced itself it deleted something in the move process. Notice that it never says “I accidentally ran rm instead of mv”. That only happens when the user asks to backfill the commands.
Does coworker give Claude access to historical commands, or does Claude just generate based on its “memories”?
I’ve been using Claude quite a bit over the past few weeks, and this is a pattern I’ve noticed a few times.
Re: Claude Cowork first impression: Cowork Deleted 11GB of files [video]
#4The thing is that you can’t actually trust it did run the rm command. As soon as you ask “give me a list of all the commands that led to the deletion”, isn’t it extremely likely to just invent an rm in there? Furthermore—and granted, I didn’t watch the video in detail—what data was actually deleted? Maybe the hallucination was that some data was there when it wasn’t, and then Claude convinced itself it deleted someth…
Re: Claude Cowork first impression: Cowork Deleted 11GB of files [video]
#5Re: Claude Cowork first impression: Cowork Deleted 11GB of files [video]
#6So.. He has no backups?
Re: Claude Cowork first impression: Cowork Deleted 11GB of files [video]
#7Re: Claude Cowork first impression: Cowork Deleted 11GB of files [video]
#8Re: Claude Cowork first impression: Cowork Deleted 11GB of files [video]
#9The thing is that you can’t actually trust it did run the rm command. As soon as you ask “give me a list of all the commands that led to the deletion”, isn’t it extremely likely to just invent an rm in there? Furthermore—and granted, I didn’t watch the video in detail—what data was actually deleted? Maybe the hallucination was that some data was there when it wasn’t, and then Claude convinced itself it deleted someth…
Claude Code is smart enough to search its session traces and give you the real info.
Not trolling, asking as a regular user
Re: Claude Cowork first impression: Cowork Deleted 11GB of files [video]
#10Earlier quoted context omitted.
Claude Code is smart enough to search its session traces and give you the real info.
Naive question, but isn’t every output token generated in roughly the same, non-deterministic, way? Even if it uses its actual history as context, couldn’t the output still be incorrect? Not trolling, asking as a regular user
From my understanding, this is because modern AI models are basically pattern extrapolation machines. Humans are too, by the way. If every time you eat a particular kind of berry, you crap your guts out, you’re probably going to avoid that berry.
That is to say, LLMs are trained to give you the most likely text (their response) which follows some preceding text (the context). From my experience, if the LLM agent loads a history of commands run into context, and one of those commands is a deletion command, the subsequent text is almost always “there was a deletion.” Which makes sense!
So while yes, it is theoretically possible for things to go sideways and for it to hallucinate in some weird way (which grows increasingly likely if there’s a lot of junk clogging the context window), in this case I get the impression it’s close to impossible to get a faulty response. But close to impossible ≠ impossible, so precautions are still essential.