This is great, but there is no way for me to verify if groups or nation states can pay for a special contract where they do not have to have their outputs watermarked.
SynthID: A tool to watermark and identify content generated through AI
41–50 of 81 posts
Re: SynthID: A tool to watermark and identify content generated through AI
#42Re: SynthID: A tool to watermark and identify content generated through AI
#43Reposting a comment I made on an earlier thread on this.
We need to be super careful with how legislation around this is passed and implemented. As it currently stands, I can totally see this as a backdoor to surveillance and government overreach.
If social media platforms are required by law to categorize content as AI generated, this means they need to check with the public "AI generation" providers. And since there is no agreed upon (public) standard for imperceptible watermarks hashing that means the content (image, video, audio) in its entirety needs to be uploaded to the various providers to check if it's AI generated.
Yes, it sounds crazy, but that's the plan; imagine every image you post on Facebook/X/Reddit/Whatsapp/whatever gets uploaded to Google / Microsoft / OpenAI / UnnamedGovernmentEntity / etc. to "check if it's AI". That's what the current law in Korea and the upcoming laws in California and EU (for August 2026) require :(
Re: SynthID: A tool to watermark and identify content generated through AI
#44[dead]
The act doesn't explicitly require watermarking, does it?
Re: SynthID: A tool to watermark and identify content generated through AI
#45Note that watermarking (yes, including text) is a requirement[1] of the EU AI Act, and goes into effect in August 2026, so I suspect we'll see a lot more work in this space in the near future. [1] Specifically, "...synthetic audio, image, video or text content, shall ensure that the outputs of the AI system are marked in a machine-readable format and detectable as artificially generated or manipulated", see https://a…
EU really like unenforceable regulations, doesn't it?
Yeah, they also outlawed murder. And stealing. And bribing officials. All universally unenforceable. Weird...
Re: SynthID: A tool to watermark and identify content generated through AI
#46[dead]
haha "you" say this, when your comment was written by an LLM! it's watermarked!
Re: SynthID: A tool to watermark and identify content generated through AI
#47Re: SynthID: A tool to watermark and identify content generated through AI
#48Earlier quoted context omitted.
What do you mean? There is nothing unenforceable about this.
How would you prove that something was generated by AI yet did not include a watermark?
You can trivially enforce that at the AI provider level, which covers 99% of the problem the law is designed to address.
Of course it doesn't cover the issue of foreign state psyop operations but the fact that enforcing laws against organized crime and adversary state actors is hard isn't specific to AI.
Re: SynthID: A tool to watermark and identify content generated through AI
#49Earlier quoted context omitted.
EU really like unenforceable regulations, doesn't it?
Yeah, they also outlawed murder. And stealing. And bribing officials. All universally unenforceable. Weird...
Well, consider the case with murder: they're not demanding that people proactively implement a system to prevent it from happening, are they? You're just not allowed to do it, in the sense that the system will attempt to find you, prove your guilt, and punish you after the fact.