Live data from Hacker News

US Government plans to develop AI that can unmask anonymous writers

reclaimthenet.org

21–30 of 219 posts

Re: US Government plans to develop AI that can unmask anonymous writers

#21

So we'll have AI that can mask writer's identity in about three months.

If precision isn't super important you can already run your text through machine translation into another language and then back again. Spammy content sites already seem to do that to avoid copyright detection.

Re: US Government plans to develop AI that can unmask anonymous writers

#22
post #13

Earlier quoted context omitted.

"How dare they do it before us" USA next decade: "Posting bad things on twitter reduces your credit score"

Credit scores are not determined by the government. If a credit ratings agency took that step, it would harm them because Twitter posts are unlikely to represent a meaningful variable when predicting someone's creditworthiness. Don't confuse that with "social credit" systems, whereby China prevents you from riding trains if you say something naughty.

(citation needed - that’s not actually implemented in china at scale, though it’s a convenient talking point in the west)

Re: US Government plans to develop AI that can unmask anonymous writers

#24
post #8

Plans? I assumed lots of people were already working on this. There's already a lot of training data out there, and I suspect most users can be identified by use of a handful of uncommon trigrams and sentence stats. I know you can recognize things I've written at work because they have real em dashes—people rarely type with those.

Someone unintentionally did something similar with HN comments to find users who sound most similar to you/eachother and people were finding their throwaway and alt accounts.

Re: US Government plans to develop AI that can unmask anonymous writers

#25
post #17

The best protection against this type of de-anonymization is to take measures now, while you still have time, to prevent it. It is possible to change the style of one's writing by using a language model which alters the original text in order to create a new piece with a different style. For example, to translate your text into the grandiose and flowing diction of a bygone era, you might consider the project below. […

There is a case to be made, not just for natural language but code.

AFAIK there is quite a bit of examples from security labs where malware authors aren't necessarily identified but at least fingerprinted based on naming conventions, patterns they use across multiple projects etc...

That sort of fingerprinting could expand to correlating someone's anonymous software projects to other examples of code elsewhere (ex: if they contribute to source available stuff).

re: the example project you mention specifically, it does feel like using tools like that almost as a linter for natural language would be a fingerprint in itself.

EDIT: As far as OPSEC goes, a fun tidbit. A friend of mine identified a PR I submitted anonymously to them, simply because of the style of PR comments I made.

Re: US Government plans to develop AI that can unmask anonymous writers

#26
post #2

Don't talk bad about your government, folks. We're going to be entering a new age of technological tyranny.

@ezekg, GovAI has detected that your post violates community guidelines. Your COVID pass is RED for 72 hours to protect yourself and others.

Re: US Government plans to develop AI that can unmask anonymous writers

#27
This is why I write my shit under my own legal name, even going to notarize this account at some point. Yeah throwaway yeah. Anonymous speech. Oh yeah darknet, Tor, cryptography, like yes sometimes, but it's a game of cat and mouse, it's purely a question of cost.

Furthermore I consider games like poker or Magic the Gathering unplayable, that is the extent to which there is literally absolutely no privacy.

But don't mind me, just got lobotomized is all.

Re: US Government plans to develop AI that can unmask anonymous writers

#30
post #19

What we need is a speaking style anonymizer. Like a language translator except it translates your text into some kind of stylistic uniformness. We're flexible on that format. Anything legible and relatively easy to translate into. Call it ANONSPEAK. It will probably be, aesthetically, horrible.

Seems very doable given the state of google translate.

Trouble is if you are a revolutionary leader of some kind you are probably going to be saying new things that no-one else talks about - which renders both anonspeak and the ai detection kind of redundant.

I guess the application for this then is in the interim to stop people or online groups becoming revolutionary by tracking and deradicalising them with targeted manipulation.

Post reply on HN