Live data from Hacker News

Undetectable Watermarks for Language Models

eprint.iacr.org

31–40 of 71 posts

Re: Undetectable Watermarks for Language Models

#31
post #5

Earlier quoted context omitted.

Yeah soon there will be models small enough to run even on phones to reword things slightly differently. If not, an app will do it

I already have one running on my phone: https://mlc.ai/mlc-llm/

you are very kind thank you

Re: Undetectable Watermarks for Language Models

#32

Why would you want to watermark your content - generally watermarks are used to provide legal proof of provenance which can be important when suing someone for stealing your content but since machine learning outputs cannot be copyrighted this use is not important.

One pretty useful reason would be to then eliminate that content from subsequent training data, so you're not training the next model on the previous model's output.

Re: Undetectable Watermarks for Language Models

#33

Why would you want to watermark your content - generally watermarks are used to provide legal proof of provenance which can be important when suing someone for stealing your content but since machine learning outputs cannot be copyrighted this use is not important.

> machine learning outputs cannot be copyrighted

I don't believe this in practice, a person will just say that they did it rather than the AI

Re: Undetectable Watermarks for Language Models

#34

Why would you want to watermark your content - generally watermarks are used to provide legal proof of provenance which can be important when suing someone for stealing your content but since machine learning outputs cannot be copyrighted this use is not important.

The purpose is to detect if text was written by ChatGPT, so a university could check whether an essay is LLM generated, social media company could detect LLM spam, etc.

Re: Undetectable Watermarks for Language Models

#35

Why would you want to watermark your content - generally watermarks are used to provide legal proof of provenance which can be important when suing someone for stealing your content but since machine learning outputs cannot be copyrighted this use is not important.

>since machine learning outputs cannot be copyrighted

This is very much unexplored and unsettled territory in most jurisdictions, both judicially and legislatively. I would refrain from making such authoritative statements for now.

Re: Undetectable Watermarks for Language Models

#36
post #20
post #4

Earlier quoted context omitted.

Most people are/will be novice LLM users.

If your goal is to track novice users there are much easier methods. You could insert invisible unicode characters for example.

Most platforms strip those automatically.

Re: Undetectable Watermarks for Language Models

#37

Why would you want to watermark your content - generally watermarks are used to provide legal proof of provenance which can be important when suing someone for stealing your content but since machine learning outputs cannot be copyrighted this use is not important.

Lots of reasons watermarks would be useful if they could be detected. Cheating on essays, bots spamming AI generated content all over the web, StackOverflow submissions can be instantly rejected, propaganda identified, etc.

Re: Undetectable Watermarks for Language Models

#39

You know that thing i want from your large language model? I just submitted my query for it in Finnish, Japanese, Russian, Hebrew, German, French, Latin, Farsi, Basque, and English. plus a few dozen more for good measure and to cover the linguistic landscape Is there any reason to believe watermarking LLMs will hold up in this scenario?

It's all numbers underneath. GPT doesn't see different languages, the same data transformations can be applied universally.

Re: Undetectable Watermarks for Language Models

#40
Many commenters (and the paper) are thinking about the watermarking in adversarial settings, e.g. detecting students using AI assistance improperly.

But I think even simple watermarking probably has value; consider a corporate context in which the corporation itself may want to monitor and know what proportion of the code, content, or work product is AI-generated. In that setting, fairly simple markers would allow at least a rough estimate or indication, although they'd have the converse problem of not necessarily indicating places where humans did some hand-editing of the output.

Post reply on HN