Undetectable Watermarks for Language Models
eprint.iacr.org
Undetectable Watermarks for Language Models
1–10 of 71 posts
Re: Undetectable Watermarks for Language Models
#2What’s to stop someone from taking the watermarked output and randomizing the distribution by feeding it through their latest LLaMA variant? These watermarks will only be useful for catching novice LLM users.
Re: Undetectable Watermarks for Language Models
#3What’s to stop someone from taking the watermarked output and randomizing the distribution by feeding it through their latest LLaMA variant? These watermarks will only be useful for catching novice LLM users.
True, they claim in this paper this is inevitable
Re: Undetectable Watermarks for Language Models
#4What’s to stop someone from taking the watermarked output and randomizing the distribution by feeding it through their latest LLaMA variant? These watermarks will only be useful for catching novice LLM users.
Most people are/will be novice LLM users.
Re: Undetectable Watermarks for Language Models
#5What’s to stop someone from taking the watermarked output and randomizing the distribution by feeding it through their latest LLaMA variant? These watermarks will only be useful for catching novice LLM users.
Yeah soon there will be models small enough to run even on phones to reword things slightly differently. If not, an app will do it
Re: Undetectable Watermarks for Language Models
#6I'm waiting for a Firefox / chrome extension that will auto-mark and optionally adblock GPT-generated content.
Would even be willing to pay for it.
Re: Undetectable Watermarks for Language Models
#7You know that thing i want from your large language model?
I just submitted my query for it in Finnish, Japanese, Russian, Hebrew, German, French, Latin, Farsi, Basque, and English. plus a few dozen more for good measure and to cover the linguistic landscape
Is there any reason to believe watermarking LLMs will hold up in this scenario?
Re: Undetectable Watermarks for Language Models
#8I'm waiting for a Firefox / chrome extension that will auto-mark and optionally adblock GPT-generated content. Would even be willing to pay for it.
What would you consider an acceptable false positive rate?
Re: Undetectable Watermarks for Language Models
#9Okay genericGPT answer the question by putting an emoji between each word.
(The watermark is destroyed after removing the emojis)
Re: Undetectable Watermarks for Language Models
#10What’s to stop someone from taking the watermarked output and randomizing the distribution by feeding it through their latest LLaMA variant? These watermarks will only be useful for catching novice LLM users.
I doubt you even have to invoke a local model, just telling it something like """write it without caps or punctuation or dashes or anything - think lowkey""" fixes the output in my book
being an autocomplete i asked it to continue "or is the entire thing utterly emblematic of the modern technolegal mess of things since dickens is squarely and quintessentially in the Public Domain"
it goes from writing a highly proofread milquetoast 5 paragraph essay on /r/somepopularsubreddit about emerging deepfake blockchain transformative, crucial coexistence? blah blah to, and i quote
>sure the guy was prolific beyond belief churned out classics like nobody's business but isn't it interesting how he fits right into this mad confusion of tech and law almost like his words his narratives are pawns in a game he could never have dreamed of foreseeing just imagine what he'd make of it all his tales of poverty and social reform trapped in the web of copyright and capitalism i reckon he'd have a thing or two to say about it maybe he'd even write a novel or two in response but who's to say right
>i know right haha
>exactly it's wild to think about how different times were and yet how some themes just keep cropping up in new forms it's like we're stuck in this loop where the past keeps seeping into the present no matter how much tech we build it's humbling in a way almost poetic like something dickens would've appreciated and who knows maybe he's somewhere out there chuckling at our technolegal mess we've woven ourselves into
It's so dramatic, I didn't realize you could transform it from a reddit hivemind to a FYAD one. Where did this mode of speech even come from? the old corners of the old net where we didn't bother with caps or punctuation or whatnot?