SynthID: A tool to watermark and identify content generated through AI
1–10 of 81 posts
Re: SynthID: A tool to watermark and identify content generated through AI
#2This technology could be used to copyrights as well.
>The watermark doesn’t change the image or video quality. It’s added the moment content is created, and designed to stand up to modifications like cropping, adding filters, changing frame rates, or lossy compression.
But does it survive if you use another generative image model to replicate the image?
Re: SynthID: A tool to watermark and identify content generated through AI
#3This technology could be used to copyrights as well. >The watermark doesn’t change the image or video quality. It’s added the moment content is created, and designed to stand up to modifications like cropping, adding filters, changing frame rates, or lossy compression. But does it survive if you use another generative image model to replicate the image?
> This technology could be used to copyrights as well.
That's been a thing for a while: https://en.wikipedia.org/wiki/Digital_watermarking
Re: SynthID: A tool to watermark and identify content generated through AI
#4I wonder how it stands up to feature analysis.
"Generate a pure white image." "Generate a pure black image." Channel diff, extract steganographic signature for analysis.
Re: SynthID: A tool to watermark and identify content generated through AI
#5These sorts of tools will only be able to positively identify a subset of genAI content. But I suspect that people will use it to 'prove' something is not genAI.
In a sense, the identifier company can be an arbiter of the truth. Powerful.
Training people on a half-solution like this might do more harm than good.
Re: SynthID: A tool to watermark and identify content generated through AI
#6I genuinely feel that in this AI world we need the inverse. That every analogue or digital photo taken by traditional means of photography will need to be signed by a certificate, so anyone can verify its authenticity.
Re: SynthID: A tool to watermark and identify content generated through AI
#7This technology could be used to copyrights as well. >The watermark doesn’t change the image or video quality. It’s added the moment content is created, and designed to stand up to modifications like cropping, adding filters, changing frame rates, or lossy compression. But does it survive if you use another generative image model to replicate the image?
Extremely doubtful, due to the way that embedding and diffusion works. I would be utterly floored if they had achieved that.
Re: SynthID: A tool to watermark and identify content generated through AI
#8These sorts of tools will only be able to positively identify a subset of genAI content. But I suspect that people will use it to 'prove' something is not genAI. In a sense, the identifier company can be an arbiter of the truth. Powerful. Training people on a half-solution like this might do more harm than good.
It will just be an arms race if we try to prove "not genAI." Detectors will improve, genAI will improve without marking (opensource and state actors will have unmarked genAI even if we mandate it).
Marking real from lense through digital life is more practical. But then what do we do with all the existing hardware that doesn't mark real and media that preexisited this problem.
Re: SynthID: A tool to watermark and identify content generated through AI
#9I genuinely feel that in this AI world we need the inverse. That every analogue or digital photo taken by traditional means of photography will need to be signed by a certificate, so anyone can verify its authenticity.
Some cameras support this, but usually only for raw.
Note that your cell phone camera is using gen AI techniques to counteract sensor noise.
Was that famous person in the background really there, or a hallucination filling in static?
Who knows at this point? So, the signatures you proposed need to have some nuance around what they’re asserting.
Re: SynthID: A tool to watermark and identify content generated through AI
#10I genuinely feel that in this AI world we need the inverse. That every analogue or digital photo taken by traditional means of photography will need to be signed by a certificate, so anyone can verify its authenticity.
[dead]