Live data from Hacker News

A new way to detect ‘deepfake’ picture editing

lightbluetouchpaper.org

21–30 of 92 posts

Re: A new way to detect ‘deepfake’ picture editing

#21

Isn't literally every deepfake detection technique just an oracle that you can use to train a better deepfake creator?

Yes, but if the "fake detection" technique is computationally much faster than the generation technique, having access to a better oracle is not so helpful to the deepfake creators, who are bottlenecked by the other phase.

Re: A new way to detect ‘deepfake’ picture editing

#24
post #22

I'm having trouble following. Can someone explain this in easier terms? What scenario does this address and how does this work exactly?

The OP's title is incorrect. This doesn't detect deepfakes, it serves for people to watermark their images in a way that are hard to remove by conventional ML approaches.

Re: A new way to detect ‘deepfake’ picture editing

#25
The post is pretty hard to understand. Here's the paper and an excerpt from the abstract:

https://arxiv.org/abs/2106.00660

> First, we show how an image owner with access to an inpainting model can augment their image in such a way that any attempt to edit it using that model will add arbitrary visible information. We find that we can target multiple different models simultaneously with our technique. This can be designed to reconstitute a watermark if the editor had been trying to remove it. Second, we show that our markpainting technique is transferable to models that have different architectures or were trained on different datasets, so watermarks created using it are difficult for adversaries to remove. Markpainting is novel and can be used as a manipulation alarm that becomes visible in the event of inpainting.

Re: A new way to detect ‘deepfake’ picture editing

#26
It's hard to see this as much anything but snake oil. While the technique allegedly allows you to target multiple models, it still requires you to know what adversarial model you're targeting before the fact. If the adversary sees there's visible artifacts they'll just change a few parameters or use a different model and be good to go none the less. In short, while this might be academically interesting, I can't help but feel that this is a futile field to work in. A good way to see why is to look at it this way: a skilled human can manually manipulate an image so that it isn't possible to tell that the image has been manipulated. It is then a matter of teaching the model to do the same, which might take time or be computationally prohibitive for now, but eventually it will be done.

Re: A new way to detect ‘deepfake’ picture editing

#28
post #22

I'm having trouble following. Can someone explain this in easier terms? What scenario does this address and how does this work exactly?

scenario: you want to resell 50000 istock phots, but they are watermarked, making the free high resolution versions valueless.

solution: you use a denoising filter to reconstruct the watermark pixels to plausible original values. Profit!

this: instead of just simple obvious watermarks, you can instead encode visually indistinct fake-noise that deliberately confuses denoising neural networks.

They claim “We find that we can target multiple different models simultaneously with our technique.”, ie. it is reasonably generic.

how? Eh, that’s complicated, look up “adversarial neural networks”, there’s a fairly high level overview here: https://towardsdatascience.com/how-to-systematically-fool-an...

Post reply on HN