Earlier quoted context omitted.
And that we're just a tightrope stretched over the abyss from the monkey until ai.
From where or from whom will 'ai' be getting its moral outlook on the actions it takes?
A new way to detect ‘deepfake’ picture editing
51–60 of 92 posts
Re: A new way to detect ‘deepfake’ picture editing
#52Couldn't reputable photo/video authors just publish content as an NFT? If the NFT is not traced back to a reputable source, then the content is deemed unreliable.
Re: A new way to detect ‘deepfake’ picture editing
#53> An image owner can modify their image in subtle ways which are not themselves very visible, but will sabotage any attempt to inpaint it by adding visible information determined in advance by the markpainter. Hmm... so if I ask it to add an apple to the scene it just looks for an apple and says "yep, found an apple". That is not an algorithm to detect fakes, it is an algorithm to detect predetermined edits. Steganog…
no i think that sentence means you can still use photoshop manually to laboriously edit stuff… but the super convenient AI editing will fail, meaning 99,9% of the population won‘t be able to create deepfakes
Re: A new way to detect ‘deepfake’ picture editing
#54Re: A new way to detect ‘deepfake’ picture editing
#55The whole point of GANs is to train a model until it can defeat detection by another model. Virtually any technique for detection that can be reproduced could just be incorporated into the training loop and rendered almost useless.
Re: A new way to detect ‘deepfake’ picture editing
#56Earlier quoted context omitted.
Cryptographic keys embedded in hardware worked really well for the DRM industry. Eventually someone will work out how to extract the key, then create malware to spread around android devices to send back millions of valid keys. What do you do then? Blacklist millions of real peoples cameras and prevent them from using the internet?
You only need a method of key invalidation and renewal, that's all. Ssl certificates have been facing this problem for years. The threat model is equal to someone infecting millions of devices and then sending back banking data, so it's not like people aren't working on mitigating that stuff.
That's an entirely different, and much easier problem. In the case of SSL you are not worried about an attacker obtaining a certificate for any host, just the ones you care about. E.g. an attacker getting a certificate for facebook.com would be catastrophic, but an attacker getting a certificate for a website that no one uses would be a non-issue.
For the case of avoiding deepfakes, you need to avoid the attacker extracting a key from any of the millions of cameras that are sold every year.
Re: A new way to detect ‘deepfake’ picture editing
#57Earlier quoted context omitted.
You only need a method of key invalidation and renewal, that's all. Ssl certificates have been facing this problem for years. The threat model is equal to someone infecting millions of devices and then sending back banking data, so it's not like people aren't working on mitigating that stuff.
>Ssl certificates have been facing this problem for years. That's an entirely different, and much easier problem. In the case of SSL you are not worried about an attacker obtaining a certificate for any host, just the ones you care about. E.g. an attacker getting a certificate for facebook.com would be catastrophic, but an attacker getting a certificate for a website that no one uses would be a non-issue. For the cas…
Re: A new way to detect ‘deepfake’ picture editing
#58It's hard to see this as much anything but snake oil. While the technique allegedly allows you to target multiple models, it still requires you to know what adversarial model you're targeting before the fact. If the adversary sees there's visible artifacts they'll just change a few parameters or use a different model and be good to go none the less. In short, while this might be academically interesting, I can't help…
A few weeks ago, there was a post here about that guy who deepfaked female profile pictures. He showed that the visible artifacts go away by merely scaling up the number of parameters in the model. Give it a few years and these fake images will be impossible to detect unless we agree on some way of cryptographically signing images from real cameras.
Re: A new way to detect ‘deepfake’ picture editing
#59But maybe we'll just have to limit cameras outputting NFT videos, or signed frames as the only source of trusted media
Re: A new way to detect ‘deepfake’ picture editing
#60Earlier quoted context omitted.
A few weeks ago, there was a post here about that guy who deepfaked female profile pictures. He showed that the visible artifacts go away by merely scaling up the number of parameters in the model. Give it a few years and these fake images will be impossible to detect unless we agree on some way of cryptographically signing images from real cameras.
At best that would allow you to tell if a picture was raw footage. Which is pointless because people edit things all the time.
It doesn't really seem likely at all to work in practice.