It's not feasible or desirable for our hardware devices to verify the information they record autonomously. A real solution to the problem of attribution in the age of AI must be based on reputation. People should be able to vouch for information in verifiable ways with consequences for being untrustworthy.
Roc Camera
31–40 of 491 posts
Re: Roc Camera
#32What concerns me most in the era of gen AI irt photography is journalism. We need truth, most especially when limited-means citizen journalism is the only reliable source of that truth. But I feel like the only way to accomplish fool-proof photos we can trust in a trustless way (i.e. without relying on e.g. the Press Association to vet) is to utterly PACK the hardware with sensors and tamper-proof attestation so the…
Re: Roc Camera
#33Re: Roc Camera
#34Like, how is this any different than having each camera equipped with a vendor controlled key and then having it sign every photo?
If you can spoof the sensor enough to reuse the key, couldn't you spoof the sensor enough to fool a verifier into believing your false proof?
Re: Roc Camera
#35Earlier quoted context omitted.
What proof is there that the photo scanner is scanning a genuine photo and not something AI generated that looks like a Polaroid?
What proof is there that this camera is photographing a genuine scene? https://en.wikipedia.org/wiki/Cottingley_Fairies
It was a real moment with objects that Bishop Berkeley could have kicked.
Re: Roc Camera
#36Re: Roc Camera
#37Earlier quoted context omitted.
It wouldn't work at all as open source since you could just modify the source to sign your AI generated pictures.
This is patently incorrect. Just remember the whole TiVo affair and reasons why GPLv3 was born. Source code availability does not guarantee ability to run it on the particular device.
https://sfconservancy.org/blog/2021/mar/25/install-gplv2/ https://sfconservancy.org/blog/2021/jul/23/tivoization-and-t... https://events19.linuxfoundation.org/wp-content/uploads/2017...
Re: Roc Camera
#38Seems to me that a camera like this is necessarily, at least in part, a closed system that blocks you from controlling the software or hardware on the device you supposedly own. It's hard for me to think this is a good direction. And as others have pointed out, it can't prevent attacks through the analog hole, e.g. photographing a display. It's not feasible or desirable for our hardware devices to verify the informat…
The problem is quality takes time, and therefore loses relevance.
We need a way to break people out of their own human nature and reward delayed gratification by teaching critical thinking skills and promoting thoughtfulness.
I sadly don't see an exciting technological solution here. If anything it's tweaks to the funding models that control the interests of businesses like Instagram, Reddit, etc.
Re: Roc Camera
#39You can absolutely sign the image with the on-camera certificate, for example, but that would too boring of a solution to hype.