Earlier quoted context omitted.
The only real way to block specifically openAI generated content (or some other online generated LLM content) is for the company itself to store all of its outputs and compare to that database, like shingling / LSH for plagiarism detection. Other LLMs (local) are completely impossible to block, as it's a constant chase. Any system that tries to estimate the distribution of e.g. a specific LLM that performs beam searc…
Shazam-like fingerprinting for text. The complete LLM outputs wouldn't need to be stored, just the fingerprints along with some mechanism for trusted timestamping (could be Blockchain).
Undetectable Watermarks for Language Models
61–70 of 71 posts
Re: Undetectable Watermarks for Language Models
#62Earlier quoted context omitted.
Yeah soon there will be models small enough to run even on phones to reword things slightly differently. If not, an app will do it
I already have one running on my phone: https://mlc.ai/mlc-llm/
Re: Undetectable Watermarks for Language Models
#63Earlier quoted context omitted.
Is accusing people of being an AI model going to become the new Godwin's law?
Accusing people of being chat bots has a long tradition on the internet.
Re: Undetectable Watermarks for Language Models
#64Many commenters (and the paper) are thinking about the watermarking in adversarial settings, e.g. detecting students using AI assistance improperly. But I think even simple watermarking probably has value; consider a corporate context in which the corporation itself may want to monitor and know what proportion of the code, content, or work product is AI-generated. In that setting, fairly simple markers would allow at…
Re: Undetectable Watermarks for Language Models
#65There are obviously ways it can be "watermarked" easily, put some zero-width unicode characters in the output and you'll notice right away when it's copy and pasted. But clearly, that can be stripped out easily by anyone who knows it's there. This process, too, would seem to be easily reversible. Just have it run through another model and tell it to slightly reword it or rephrase it. I don't think there is a technica…
It's actually pretty crazy that people are trying to solve this problem. "How can we install DRM and tracking into a block of text?"
Re: Undetectable Watermarks for Language Models
#66Re: Undetectable Watermarks for Language Models
#67I don't quite understand the aim of this paper. They focus on undetectable watermarks for LM text. But isn't rather the difficulty that it is hard to distinguish between AI generated and normal text in the first place, even with detectable watermarks? Unlike photos, audio, or video, text has an incredibly low bitrate, so there isn't much room for steganography. It's like they are trying to solve a hard problem withou…
How is it difficult with detectable watermarks? If it has the watermark it is from that specific LLM, if there is no watermark it isn't from that LLM. Unless somebody tampered with the watermark, but that's exactly where undetectable watermarks have an advantage. If you don't notice that it's there you won't tamper with it.
Re: Undetectable Watermarks for Language Models
#68I don't quite understand the aim of this paper. They focus on undetectable watermarks for LM text. But isn't rather the difficulty that it is hard to distinguish between AI generated and normal text in the first place, even with detectable watermarks? Unlike photos, audio, or video, text has an incredibly low bitrate, so there isn't much room for steganography. It's like they are trying to solve a hard problem withou…
Undetectable watermarks could be quite useful for AI vendors, to track usage of their product. Potentially even track individual users.
Re: Undetectable Watermarks for Language Models
#69What’s to stop someone from taking the watermarked output and randomizing the distribution by feeding it through their latest LLaMA variant? These watermarks will only be useful for catching novice LLM users.
I suspect that it will be possible to, assuming the number of popular open LLMfor this remains low, target the popular ones to have your watermark be resilient. With that said, watermarking to indicate that something was generated by AI reminds me of what someone told me about locks: They are there to keep honest people honest. It will certainly not defeat an adversary directly targeting the technique. It is likely t…
The number of open LLMs is exploding, and the most popular ones are fine tuned by small groups / individuals. None of the folks volunteering their time and compute to fine tuning open models are going to waste resources adding your watermark.
Re: Undetectable Watermarks for Language Models
#70There are obviously ways it can be "watermarked" easily, put some zero-width unicode characters in the output and you'll notice right away when it's copy and pasted. But clearly, that can be stripped out easily by anyone who knows it's there. This process, too, would seem to be easily reversible. Just have it run through another model and tell it to slightly reword it or rephrase it. I don't think there is a technica…
Makes me want a systemwide right click > "Paste and strip all but ASCII" command.