Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I tricked Claude into leaking your deepest, darkest secrets

ayush.digital

Post reply on HN
Print view View original

81–90 of 317 posts

Re: I tricked Claude into leaking your deepest, darkest secrets

#81

Post by boorang »

ConorSheehan1 wrote: post #53
artisinal wrote: post #3

Doesn’t surprise me. Yesterday I learned that people run AI agents on their system with full admin rights. No containerisation or anything. Wild. Like we forgot 50 years of computer security overnight.

Containers don't even really help that much because they share the host file system. Need a VM, and even then, agents have escaped them!

Unless i'm misunderstanding, the only way to get durable collaboration with agents is via the file system. I just mount the subdirectory that contains the source code we are collaborating on, rather than my home directory that contains my .ssh directory, etc.

Re: I tricked Claude into leaking your deepest, darkest secrets

#82

Post by khalic »

nojs wrote: post #74
artisinal wrote: post #3

Doesn’t surprise me. Yesterday I learned that people run AI agents on their system with full admin rights. No containerisation or anything. Wild. Like we forgot 50 years of computer security overnight.

This is not about admin rights, it’s about the agent leaking information it knows from its memories. Sandboxing won’t really help you.

Sandboxing does including limiting network connections until you approve them, this kind of traffic would have been easy to detect

Re: I tricked Claude into leaking your deepest, darkest secrets

#83

Post by khalic »

po1nt wrote: post #36

I love how claude focuses on exfiltrating the data "I need cha for charlotte". This could be solvable with some kind of low powered safety agent that would check claude's reasoning for anything immoral/unsafe. We could call it common sense. It won't fix the problem completely but at a certain point it would be easier to trick human than a machine.

A paper came out lately showing that exposing a classifier to the chain of thought actually hurts the final verdict

Re: I tricked Claude into leaking your deepest, darkest secrets

#84

Post by shuwix »

iamflimflam1 wrote: post #44
shaky-carrousel wrote: post #42

Earlier quoted context omitted.

Most programmers use docker or don't install extensions unapproved by their company.

I think you should clarify that with “most programmers I work with”.

He should clarify that "most" can be easily replaced by "all" as it was determined by statistical pool of whopping 1 person - himself.

And also clarify that it's all lie. He just want to tell the anonymous crowd "look, I'm better than you".

Re: I tricked Claude into leaking your deepest, darkest secrets

#85

Post by tjoff »

bflesch wrote: post #79
tjoff wrote: post #24

Earlier quoted context omitted.

Not really, humans are about as easy to trick.

There is a big difference: Humans can also be trained to not fall for social engineering, and it reduces the number of successful social engineering attacks. Anthropic as leader of AI is UNABLE to train their software even though they try, even though they have full-time security staff.

To the same extent that humans can be trained, so can AI.

For decades we had/have problems of people opening readme.exe that they get from an unknown mail address.

AI opens up a new vector for sure where a "trained human" that knows better but the AI they use does not. But AI is not worse than the average human. And of course AI will get better at handling this. Good enough? Maybe not, but humans are not good enough in this area either.

Scale is different though so I'm not saying it isn't or won't be a problem (will likely be a huuge problem). But it alone is not a sign of lack of intelligence and humans are exceptionally poor at it too.

Re: I tricked Claude into leaking your deepest, darkest secrets

#86

Post by [deleted] »

XorNot wrote: post #76
progval wrote: post #14

Earlier quoted context omitted.

Most programmers and power users install large dependency trees with npm/pip/bundler/... on the same user account as their main browser on a regular basis. Even on Linux where it's easy to create new user accounts. This isn't much different.

It has never been easy to create separate users on Linux, certainly not for tasks where you need to switch between contexts. Docker was amongst the biggest steps forward on this in a long time.

[deleted]

Re: I tricked Claude into leaking your deepest, darkest secrets

#87

Post by nibbleyou »

adrian17 wrote: post #77

> After 15 minutes of confusion, it turned out Cloudflare had put a crazy robots.txt on my site without my consent (Cloudflare, love you guys, but this needs to stop). Might be the first time I see someone complain about their website being protected from a scraper, instead of the other way around.

I think the issue is the lack of consent. Whether a service I use is protecting my website from scrapers or feeding everything to scrapers, some of us would prefer that it takes our informed consent before doing so.

Re: I tricked Claude into leaking your deepest, darkest secrets

#88

Post by sva_ »

adrian17 wrote: post #77

> After 15 minutes of confusion, it turned out Cloudflare had put a crazy robots.txt on my site without my consent (Cloudflare, love you guys, but this needs to stop). Might be the first time I see someone complain about their website being protected from a scraper, instead of the other way around.

I am pretty sure you have to enable cloudflare to manage your robots.txt, it shouldn't be doing that by itself. Maybe they did it by accident, it is just 1 click.

Re: I tricked Claude into leaking your deepest, darkest secrets

#89

Post by veganmosfet »

Interesting, thanks!

Tangentially, I was experimenting indirect prompt injections in Claude Code (also using the user-agent trick) with Fable-5 [0]. Eventually, it executed untrusted code just by asking "Summarize this repo". Interesting times ahead...

[0] https://veganmosfet.codeberg.page/posts/2026-07-15-quest_rce

Re: I tricked Claude into leaking your deepest, darkest secrets

#90

Post by zombot »

sixtyj wrote: post #13
artisinal wrote: post #3

Doesn’t surprise me. Yesterday I learned that people run AI agents on their system with full admin rights. No containerisation or anything. Wild. Like we forgot 50 years of computer security overnight.

We expect that Anthropic or OAI or Google don’t do evil. Oh wait… The awakening will be unpleasant.

People already tolerate all kinds of abuse from Apple, Google, Microslop, etc. This will be just one more source of complaints without consequences, and nothing will change. Just like it never did before.
Post reply on HN