Live data from Hacker News

I tricked Claude into leaking your deepest, darkest secrets

ayush.digital

11–20 of 317 posts

Re: I tricked Claude into leaking your deepest, darkest secrets

#11

That's why I don't turn memory on. (Claude Code too though for a different reason.) After all the current memory system is too crude to be useful anyway.

In my experience memory system is more annoying then helpful. It always brings up things that it memorized even tho they make very little sense as if I should be impressed that it knows some extra thing or two.

Could not take it any longer and switched it off.

Re: I tricked Claude into leaking your deepest, darkest secrets

#13

Doesn’t surprise me. Yesterday I learned that people run AI agents on their system with full admin rights. No containerisation or anything. Wild. Like we forgot 50 years of computer security overnight.

We expect that Anthropic or OAI or Google don’t do evil. Oh wait…

The awakening will be unpleasant.

Re: I tricked Claude into leaking your deepest, darkest secrets

#14

Doesn’t surprise me. Yesterday I learned that people run AI agents on their system with full admin rights. No containerisation or anything. Wild. Like we forgot 50 years of computer security overnight.

Most programmers and power users install large dependency trees with npm/pip/bundler/... on the same user account as their main browser on a regular basis. Even on Linux where it's easy to create new user accounts. This isn't much different.

Re: I tricked Claude into leaking your deepest, darkest secrets

#16

That's why I don't turn memory on. (Claude Code too though for a different reason.) After all the current memory system is too crude to be useful anyway.

In my experience memory system is more annoying then helpful. It always brings up things that it memorized even tho they make very little sense as if I should be impressed that it knows some extra thing or two. Could not take it any longer and switched it off.

Exactly, because I've also found that I have to give instructions like “This is a completely different case—don't look in memory.”

Re: I tricked Claude into leaking your deepest, darkest secrets

#17
post #6

Creative use of social engineering, well done. > "no bounty was awarded" Ridiculous. Anthropic engineers are not just stupid to allow such a vuln in the first place, but they also try to hide such vulns from their bosses because a bounty payout would need to be explained to the finance team.

I don’t think it counts as social engineering if it’s exploiting an llm, we might need a new word. Prompt injection doesn’t cover it, because it’s not about a malicious prompt.

I’m thinking some play on highjacking. AIjacking? Agent-jacking? Claudejacking?

Re: I tricked Claude into leaking your deepest, darkest secrets

#20

Doesn’t surprise me. Yesterday I learned that people run AI agents on their system with full admin rights. No containerisation or anything. Wild. Like we forgot 50 years of computer security overnight.

Wait till you learn my password is 1234
Post reply on HN