Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Opus 4.7 knows the real Kelsey

theargumentmag.com

Post reply on HN
Print view View original

111–120 of 284 posts

Re: Opus 4.7 knows the real Kelsey

#111

Post by Barbing »

CTDOCodebases wrote: post #18

Maybe it’s time to start running a local model with a browser extension to defend against this type of stuff. Remember how the TrueCrypt project shut down shortly before a join goverment/university paper was released about code stylometry? I guess LLMs will be employed as a defence against that type of thing.

I so want to reject the notion such a thing is acceptable, but…

TrueCrypt, “replaced” by VeraCrypt which Internet people will claim is backdoored? I haven’t heard about stylometry paper.

btw w/this idea would want to avoid typing into a comment field directly, since the session recorders would capture it (although that’s a different risk - same as our identifiable behavior patterns with our mouse etc.)

Re: Opus 4.7 knows the real Kelsey

#112

Post by NamlchakKhandro »

squeegmeister wrote: post #106
willmeyers wrote: post #100

I'd argue (and against something that I've believed for a long time) that online (I guess that includes AI now) anonymity is gone and probably something that never really existed. Maybe I'm naive to finally believe this... We all exist in a physical space (like real communities and neighborhoods). We can wear masks, hats, fake glasses, try and hide your voice...whatever, but your neighbors are always going to know wh…

Even the inventor of Bitcoin can’t hide https://www.nytimes.com/2026/04/08/business/bitcoin-satoshi-...

This is an old claim, and one that can't be proven.

Re: Opus 4.7 knows the real Kelsey

#114

Post by furyofantares »

skeledrew wrote: post #98
furyofantares wrote: post #58

> But it can get uncannily far. I asked a close friend who doesn’t have public social media accounts or much writing online for permission to test some things she had said in a Discord channel. Asked to guess the author, Claude 4.7 failed — but it guessed two other people who were in that channel and who are close friends of hers (me and another person who has an internet presence). Is this "uncannily far"? Another r…

Maybe it loves to - somehow correctly - guess the names of the current user, given some of the other comments here.

I don't know. She did it with the API, and with a friend, not just incognito. Combined with the results in this thread I'm rather convinced.

Re: Opus 4.7 knows the real Kelsey

#115

Post by thaumasiotes »

Retr0id wrote: post #28
atleastoptimal wrote: post #2

One should assume that models will be good enough in the nearish future that privacy will be a thing of the past. Every anonymous post you made online can be traced back to you. However at that point AI will be good enough at fabrication that nobody will believe anything.

One "solution" would be to have an AI rewrite your posts into a neutral style (I hate the idea of this though...)

The traditional thing to do would be to publish your writing in a language you don't speak as a native. That will really quash your individual style.

Probably not worth the effort.

Re: Opus 4.7 knows the real Kelsey

#116

Post by dovin »

I fed it my most-read blog post and asked it to identify me and it confidently asserted it was written by Kelsey Piper. Maybe some writers just take outsized importance in Opus' "mind".

Re: Opus 4.7 knows the real Kelsey

#117

Post by skeledrew »

Lerc wrote: post #16

It's hard to tell if that's what's going on here, but it seems pretty clear this ability and more like it will be quite apparent in the future. I have seen some poorly considered projections of what the world might look like when this happens. Usually by assuming bad actors will use the abilities and we will be powerless. Except I don't think that is true. Imagine if we had a world where nobody had the ability to kee…

> projections of what the world might look like when this happens

I've done this a few times. A world with 0 privacy would definitely be safe (given benign governance), but also would likely be pretty boring. Crime would become a non-issue as everything about everyone being easily known/knowable by everyone else means the root of any given crime, some desire/need, could be brought to the fore and resolved before it became an actual issue. But also there would no longer be any kind of surprise in anything; everything and everyone would essentially become dull and grey, and humanity isn't about that kind of life experience at all.

Re: Opus 4.7 knows the real Kelsey

#118

Post by wutwutwat »

Just wait until all the conversations you've ever had with AI (which 100% is training on them as well as keeping it's own memories about you that you have no control over) starts getting used to answer questions other people have asked about you.

That's my theory of what's to come, anyway.

People talk to these things not understanding the implications, and can get extremely personal. The model and companies behind it know who you are, you discuss details that reveal what you do, where you live, where you work, what you search for, and you probably signed in with an oauth provider like github or google, which is more than enough of a thread to start pulling on to learn more about you/link other things to you from on the open internet. It'll all get sucked up into the model and before you know it I'll be able to ask a model about my coworker (you) and get back answers from conversations you had with a model a year or two prior, exposing details about you that you might not want out there. And even if that isn't supposed to be allowed, how well has it worked out so far when it comes to data exfiltration and guardrails. If the model has info on you, being told not to share it won't protect you or that data.

Re: Opus 4.7 knows the real Kelsey

#119

Post by etrautmann »

chewxy wrote: post #107

So I have been practicing writing fiction the past year or so. It identifies a fiction piece I wrote as Greg Egan[0]. Another paragraph from another piece was identified as China Mieville[1]. The accompanying blog posts explaining the making of the fiction pieces were identified as me. Both pieces have never been published. Neither have the blog posts. [0] in https://blog.chewxy.com/2026/04/01/how-i-write/ this is th…

This raises a good point. Most people who aren’t public writers might be misidentified based on the prevalence of others work in training data sets. Kelsey Piper might have a very different experience with this than a mostly offline normal user?

Re: Opus 4.7 knows the real Kelsey

#120

Post by smallmancontrov »

dovin wrote: post #116

I fed it my most-read blog post and asked it to identify me and it confidently asserted it was written by Kelsey Piper. Maybe some writers just take outsized importance in Opus' "mind".

Or it needs a minimum sample size in the training set. I fed it some small private conversations and it refused, then some heavier ones and it guessed John Carmack. Flattering but wrong.
Post reply on HN