...But it can be hard to tell the difference between content that’s been
AI-generated, and content created without AI.
SynthID: A tool to watermark and identify content generated through AI
21–30 of 81 posts
Re: SynthID: A tool to watermark and identify content generated through AI
#22I genuinely feel that in this AI world we need the inverse. That every analogue or digital photo taken by traditional means of photography will need to be signed by a certificate, so anyone can verify its authenticity.
And how do you fix the analog hole? Because if you can point your "verified" camera at a sufficiently high-resolution screen, we're worse off than when we started.
Or just extract the certificate from the hardware you own.
Re: SynthID: A tool to watermark and identify content generated through AI
#23...But it can be hard to tell the difference between content that’s been AI-generated, and content created without AI. Pro-Tip: Something like that Sherbet colored dog is always AI generated
You'd be surprised what dog owners do sometimes.
Re: SynthID: A tool to watermark and identify content generated through AI
#24Earlier quoted context omitted.
And how do you fix the analog hole? Because if you can point your "verified" camera at a sufficiently high-resolution screen, we're worse off than when we started.
Or just extract the certificate from the hardware you own.
That is presumably a very expensive endeavor. We already have hardware that attempts to mitigate this and while I think it's possible for the government it's certainly not trivial.
Re: SynthID: A tool to watermark and identify content generated through AI
#25Earlier quoted context omitted.
And how do you fix the analog hole? Because if you can point your "verified" camera at a sufficiently high-resolution screen, we're worse off than when we started.
Or just extract the certificate from the hardware you own.
This is a "solved" problem. Vendors whose keys are extractable get their licenses revoked. The verifier checks the certificate against a CRL.
Re: SynthID: A tool to watermark and identify content generated through AI
#26I genuinely feel that in this AI world we need the inverse. That every analogue or digital photo taken by traditional means of photography will need to be signed by a certificate, so anyone can verify its authenticity.
And how do you fix the analog hole? Because if you can point your "verified" camera at a sufficiently high-resolution screen, we're worse off than when we started.
Yes, I’m more worried about the false confidence such technology could create. Implement an authenticity mechanism and it will be treated as truth. Powerful people will have the means to spoof photographic evidence.
Re: SynthID: A tool to watermark and identify content generated through AI
#27I genuinely feel that in this AI world we need the inverse. That every analogue or digital photo taken by traditional means of photography will need to be signed by a certificate, so anyone can verify its authenticity.
I'm sure Apple would love that too. More seriously, would that also mean all editing tools would need to re-sign a photo that was previously signed by the original sensor. How do we distinguish an edit that's misleading vs just changing levels? It's an interesting area for sure, but this inverse approach seems much trickier.
You'd have to provide both images, and let the end user determine whether they think it's misleading.
Re: SynthID: A tool to watermark and identify content generated through AI
#28I genuinely feel that in this AI world we need the inverse. That every analogue or digital photo taken by traditional means of photography will need to be signed by a certificate, so anyone can verify its authenticity.
And how do you fix the analog hole? Because if you can point your "verified" camera at a sufficiently high-resolution screen, we're worse off than when we started.
Depth sensor information.
Re: SynthID: A tool to watermark and identify content generated through AI
#29Seems like this really just validates whether a piece of AI content was generated by Google, not AI generated in general
What incentive do open models have to adopt this?
Re: SynthID: A tool to watermark and identify content generated through AI
#30Note that watermarking (yes, including text) is a requirement[1] of the EU AI Act, and goes into effect in August 2026, so I suspect we'll see a lot more work in this space in the near future.
[1] Specifically, "...synthetic audio, image, video or text content, shall ensure that the outputs of the AI system are marked in a machine-readable format and detectable as artificially generated or manipulated", see https://artificialintelligenceact.eu/article/50/