Live data from Hacker News

How Claude marks AI-generated content

support.claude.com

11–20 of 446 posts

Re: How Claude marks AI-generated content

#11
post #5

They should just replace the spaces by one of Unicode special space characters. Can it be circumvented? Of course. Will most people go through the trouble to circumvent it? No.

https://unicode-explorer.com/articles/space-characters

U+2800 or U+3164 would be nice.

But as I remove unwanted characters with grep before layout in InDesign, someone will make a skill for removing such space characters.

Re: How Claude marks AI-generated content

#12

Earlier quoted context omitted.

I would love to see what this looks like in practice. Especially in generated code. I assume this is more than insertion of non visible special unicode whitespace characters, but more in the pattern of the text content itself?

non visible text is extremely easy to filter with a git hook, a post tool call hook, or just a script. I doubt they are doing that

Or grep, in a skill. /clean-cc-watermark just entered the chat…

Re: How Claude marks AI-generated content

#13
post #5

They should just replace the spaces by one of Unicode special space characters. Can it be circumvented? Of course. Will most people go through the trouble to circumvent it? No.

If it's that simple and obvious, you'll have 10 "Remove Claude Watermark" web-apps by the end of Day 1. Most of them coded by Claude.

Hell, it'll probably happen no matter how sophisticated their watermark is. There's no watermark in text that can't be detected and removed, and no text that can't be converted to generic keyboard ASCII.

Re: How Claude marks AI-generated content

#14

So this won't be happening in the US, but in the EU: " When a supported Claude model generates text, it weaves an imperceptible watermark directly into the text itself. You won’t see it, and it doesn’t change the meaning, quality, or readability of Claude’s response. Because the watermark is part of the text, it will travel with the text when it’s copied and pasted elsewhere, and may persist through some editing. Wat…

I would love to see what this looks like in practice. Especially in generated code. I assume this is more than insertion of non visible special unicode whitespace characters, but more in the pattern of the text content itself?

IIRC, watermarking text could be as simple as training the model to use specific words/phrases more frequently than what you would expect to find in human-written text, to the point where it's highly statistically improbable that it wasn't AI generated. I assume similar logic could apply to code in the form of functions/code styling.

That's probably an over simplification. Also a solid defence that can be used against complaints about the way AI writes text.

Re: How Claude marks AI-generated content

#15
> When a supported Claude model generates text, it weaves an imperceptible watermark directly into the text itself. You won’t see it, and it doesn’t change the meaning, quality, or readability of Claude’s response.

I'd like to know a lot more about how that works.

A lot of my interactions with Claude return pretty precise text. If I ask it to edit a project and refactor a specific function in several places I know exactly what I want to happen, it will NOT be OK if those refactors have some kind of weird pattern baked into their text to act as a watermark.

I guess this may be covered by this:

> Content generated by Claude may not carry a detectable mark if, for example: [...] The passage is very short, leaving too little text for a reliable signal;

Re: How Claude marks AI-generated content

#16

> Generated text will carry embedded watermarks, and generated files will include digitally signed provenance metadata where supported. This should make it easier to catch cheaters who use Claude, right? Unless everyone runs their artifacts through some watermark and metadata sanitizer?

As long as they’re in the EU.

From the linked article

> Regions. Marking will apply to output from supported models wherever Claude is offered, worldwide.

Re: How Claude marks AI-generated content

#17
post #6

I have had a hunch for a while now that (in addition to these tools), Anthropic has actually leaned in to Claude's distinctive manner of writing since it makes the text more obviously AI generated and thus less susceptible to misuse. That's not necessarily the same thing as a markov-style fingerprint but it could be a correlated factor.

I had a similar thought but I assumed they leaned in because it improved performance on coding or something like that

Re: How Claude marks AI-generated content

#18

So this won't be happening in the US, but in the EU: " When a supported Claude model generates text, it weaves an imperceptible watermark directly into the text itself. You won’t see it, and it doesn’t change the meaning, quality, or readability of Claude’s response. Because the watermark is part of the text, it will travel with the text when it’s copied and pasted elsewhere, and may persist through some editing. Wat…

I would love to see what this looks like in practice. Especially in generated code. I assume this is more than insertion of non visible special unicode whitespace characters, but more in the pattern of the text content itself?

I'm guessing - probably some textual variation on Benford's law? [1]. Trivial for compute, painful for a human.

- "Ensure distribution of vowels is in >99th percentile of human work"

- "Ensure the distribution of the letter "s" is within 99th percentile of human work"

- "Ensure the distribution of the letter "L" is periodic with periodicity within 5% of 1/N characters.

- "Ensure there is a cross-linguistic 'typo' (colour vs color) at 1/N words, where N: 1000 = Model1, 2000 = Model2, 3000 = Model3.

- "Ensure the distribution of tense error is within 99th percentile of human work"

If more than 3 dimensions have a score >99% percentile of human, let's call it watermarked...

- 1) https://en.wikipedia.org/wiki/Benford%27s_law

Re: How Claude marks AI-generated content

#19
> We’re also working to enable users and other third parties to detect Claude’s embedded watermarks and provenance metadata.

This seems to be similar in execution to Google's SynthID. I hope they release actual code the technically proficient can use, unlike SynthID which can only (afaik) be queried with Gemini's UI.

Re: How Claude marks AI-generated content

#20
post #11
post #5

They should just replace the spaces by one of Unicode special space characters. Can it be circumvented? Of course. Will most people go through the trouble to circumvent it? No.

https://unicode-explorer.com/articles/space-characters U+2800 or U+3164 would be nice. But as I remove unwanted characters with grep before layout in InDesign, someone will make a skill for removing such space characters.

We already have one, our Claude setup already requires output to be 7-bit ASCII clean and scans it for such.
Post reply on HN