Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I tricked Claude into leaking your deepest, darkest secrets

ayush.digital

Post reply on HN
Print view View original

101–110 of 317 posts

Re: I tricked Claude into leaking your deepest, darkest secrets

#101

Post by fragmede »

bflesch wrote: post #79
tjoff wrote: post #24

Earlier quoted context omitted.

Not really, humans are about as easy to trick.

There is a big difference: Humans can also be trained to not fall for social engineering, and it reduces the number of successful social engineering attacks. Anthropic as leader of AI is UNABLE to train their software even though they try, even though they have full-time security staff.

> Humans can also be trained to not fall for social engineering

That's hilariously wrong. I mean, we do try, but it's far from 100% effective. So then the question is how much better/worse than Anthropic is vs an average human.

Re: I tricked Claude into leaking your deepest, darkest secrets

#102

Post by el_io »

adrian17 wrote: post #77

> After 15 minutes of confusion, it turned out Cloudflare had put a crazy robots.txt on my site without my consent (Cloudflare, love you guys, but this needs to stop). Might be the first time I see someone complain about their website being protected from a scraper, instead of the other way around.

You have to enable this, or atleast was the case when I tried less than 1 month ago.

Re: I tricked Claude into leaking your deepest, darkest secrets

#103

Post by rgrieselhuber »

adrian17 wrote: post #77

> After 15 minutes of confusion, it turned out Cloudflare had put a crazy robots.txt on my site without my consent (Cloudflare, love you guys, but this needs to stop). Might be the first time I see someone complain about their website being protected from a scraper, instead of the other way around.

It should still be done with consent. Robots.txt files don’t protect against determined scrapers anyway.

Re: I tricked Claude into leaking your deepest, darkest secrets

#104

Post by adrian17 »

rgrieselhuber wrote: post #103
adrian17 wrote: post #77

> After 15 minutes of confusion, it turned out Cloudflare had put a crazy robots.txt on my site without my consent (Cloudflare, love you guys, but this needs to stop). Might be the first time I see someone complain about their website being protected from a scraper, instead of the other way around.

It should still be done with consent. Robots.txt files don’t protect against determined scrapers anyway.

I thought bot protection was one of reasons for using Cloudflare in the first place (next to general CDN hosting)? After all, they do show a captcha-like challenge on some websites, so I thought that even without robots.txt, it still would have prevented the automated request by default.

Re: I tricked Claude into leaking your deepest, darkest secrets

#105

Post by cheschire »

rlpb wrote: post #98
inopinatus wrote: post #61

Earlier quoted context omitted.

I’ve been recommending the use of consistent lies about name and date of birth to online systems since Eternal September began. Very few sites and systems justify accurate PII, and even for those I often still maintain dual accounts/profiles as necessary.

I like using a date of birth of 1 January. It's plausible but also hopefully suspicious how many people seem to be born that day if others do the same.

But if an attacker gets your fake birthday and uses that to successfully reset credentials on another site that uses the same fake birthday?

At some point it becomes your birthday of record as far as the internet is concerned. Doesn’t matter what the actual record says.

Re: I tricked Claude into leaking your deepest, darkest secrets

#106

Post by kioleanu »

ShinTakuya wrote: post #38
swipee wrote: post #4

Expected more from Anthropic by at least giving you a bounty, because this was a novel way of bypassing their safeguards…

Yeah I never get the "we knew about it internally" excuse. I can understand if another reporter got to it on the same day and they were in the process of mitigating, but even then they should have to prove it somehow. I'm sure someone will tell me why I'm wrong but it feels like they're just dodging payouts. Reduces trust and motivation to report it.

you're not wrong at all, this was abysmally handled by Anthropic and is a slap in the face for OP. I would have been much more upset

Re: I tricked Claude into leaking your deepest, darkest secrets

#107

Post by hyusap »

artisinal wrote: post #3

Doesn’t surprise me. Yesterday I learned that people run AI agents on their system with full admin rights. No containerisation or anything. Wild. Like we forgot 50 years of computer security overnight.

hey this is the author here! yeah big fan of containerization, and claude's site (not claude code) is actually great at this, so it was shocking when i found this exfil!

Re: I tricked Claude into leaking your deepest, darkest secrets

#108

Post by hyusap »

rmunn wrote: post #80

I've been running Claude Code in a VM, where I clone the GitHub repos I want it to work on (they're open source so no login info needed) but have no other credentials. I used to reset the VM every day, but that was getting to be a bit of a hassle so I switched to a monthly reset. But even so, it would be hard for Claude to exfil anything more than what open-source projects I've been working on in the past month (at w…

note that this wasn't claude code but claude ai the main website

Re: I tricked Claude into leaking your deepest, darkest secrets

#110

Post by dpacmittal »

artisinal wrote: post #3

Doesn’t surprise me. Yesterday I learned that people run AI agents on their system with full admin rights. No containerisation or anything. Wild. Like we forgot 50 years of computer security overnight.

Multipass is just an apt-get or brew command away. People trust software too much these days.
Post reply on HN