Live data from Hacker News

What Happens When AI-Generated Lies Are More Compelling Than the Truth?

behavioralscientist.org

31–40 of 111 posts

Re: What Happens When AI-Generated Lies Are More Compelling Than the Truth?

#31
post #27

There was a brief window where photography and videos became widespread so events could be documented and evidenced. Generative AI is drawing that period to an end, and we're returning to "who said / posted this" and having to trust the source rather than the image/message itself. It's a big regression.

I await cryptographically signed photos coming out of cameras. Actually I’ve said that should be the case for the last 20 years. You should be able to follow a chain of evidence towards an unprocessed raw image potentially.

There have been several initiatives in this direction. Here is one of the latest: https://contentauthenticity.org

Re: What Happens When AI-Generated Lies Are More Compelling Than the Truth?

#32
post #5

Earlier quoted context omitted.

Would be very interesting to require generative AI companies to log their created images for that purpose, it isn't gonna eliminate self hosted alternative, but it can destroy any fake evidence faster

Logging them would be rather cost prohibitive, but images can be hashed + (invisibly) watermarked and video can be hashed frame by frame, in such a way that each frame authenticates the one before it. Surely there's a way to durably mark generated content.

I think such watermarks are one of DeepMind's goals: https://deepmind.google/science/synthid/

Re: What Happens When AI-Generated Lies Are More Compelling Than the Truth?

#33
"lies" are always more compelling than the truth. truth=what is

vs, a whole wide range of "wouldn't it be nice .....if", "cant we just....", and the massive background of myth, legend, fantasy, dreaming, etc so into this we have created a mega capable machine rendered virtual sur-reality.....much like the ancient myth/legends where odesius sits to table where at a fantastic feast..nothing is as it seems

Re: What Happens When AI-Generated Lies Are More Compelling Than the Truth?

#34

There was a brief window where photography and videos became widespread so events could be documented and evidenced. Generative AI is drawing that period to an end, and we're returning to "who said / posted this" and having to trust the source rather than the image/message itself. It's a big regression.

Remember the fairy photo hoax that fooled Lewis Carrol?

There was never a time when authenticated photo and video could be trusted without knowing the source and circumstances.

Re: What Happens When AI-Generated Lies Are More Compelling Than the Truth?

#35
post #27

There was a brief window where photography and videos became widespread so events could be documented and evidenced. Generative AI is drawing that period to an end, and we're returning to "who said / posted this" and having to trust the source rather than the image/message itself. It's a big regression.

I await cryptographically signed photos coming out of cameras. Actually I’ve said that should be the case for the last 20 years. You should be able to follow a chain of evidence towards an unprocessed raw image potentially.

There have also been calls for a mechanism like this to prevent doctored photos of controversial newsworthy events being spread by news agencies. But afaik the only thing that came off it was "we only pay for camera jpg, only allowed changes are brightness, contrast, color".

Edit: sister comments have links.

Re: What Happens When AI-Generated Lies Are More Compelling Than the Truth?

#37
post #27

There was a brief window where photography and videos became widespread so events could be documented and evidenced. Generative AI is drawing that period to an end, and we're returning to "who said / posted this" and having to trust the source rather than the image/message itself. It's a big regression.

I await cryptographically signed photos coming out of cameras. Actually I’ve said that should be the case for the last 20 years. You should be able to follow a chain of evidence towards an unprocessed raw image potentially.

I think Nikon and Canon's past cameras had signed photos by default, and you could get the software for verification if you're a police dept or similar.

Both manufacturer's keys got extracted from their cameras, rendering the feature moot. Now, a more robust iteration is probably coming, possibly based on secure enclaves.

I'd love to have the feature and use it to verify that my images are not corrupted on disk.

Re: What Happens When AI-Generated Lies Are More Compelling Than the Truth?

#38

Earlier quoted context omitted.

Videos and photos have been faked for a long time. Nothing has changed in that regard but decreasing the effort required somewhat.

Only the price changed and that is everything.

The open question is who’s worse: one major tyrant three thousand miles away or three thousand minor tyrants a mile away. If we consent to live under capitalism, then we’re destined to live in a world of lies. We always have; it’s all we’ve ever known.

What we don’t know is whether we’ll be worse or better off when the technology of forgery is available to random broke assholes as easily as it is to governments and companies. More slop seems bad, but if our immunity against bullshit improves, people might redevelop critical thinking skills and capitalism could end.

Re: What Happens When AI-Generated Lies Are More Compelling Than the Truth?

#39
From TFA:

    Mythmaking, more than truth seeking, is what seems likely to define the future of media and of the public square. The reason extraordinarily strange conspiracy theories have spread so widely in recent years may have less to do with the nature of credulity than with the nature of faith. 
The reason why strange and even outright deranged notions have spread so widely is that they have been monetised. It is a Gibberish Economy.

Re: What Happens When AI-Generated Lies Are More Compelling Than the Truth?

#40

From TFA: Mythmaking, more than truth seeking, is what seems likely to define the future of media and of the public square. The reason extraordinarily strange conspiracy theories have spread so widely in recent years may have less to do with the nature of credulity than with the nature of faith. The reason why strange and even outright deranged notions have spread so widely is that they have been monetised . It is a…

Capitalism found the least amount of energy to produce a viable product.
Post reply on HN