A few weeks ago my girlfriend made me discover Instagram filters. Obviously they're not in "deep fake" territory but I was still massively impressed by the quality of the face recognition and tracking coupled with some rather advanced 3D reconstructions on top. 15 years ago that would've been science fiction, today it's a free gimmicky feature in an app running on commodity hardware. There are also apps that will smo…
Creating a deepfake took two weeks and cost $552
61–70 of 119 posts
Re: Creating a deepfake took two weeks and cost $552
#62The central technique used in DeepFakes is fascinating. Initially I assumed they were using Generative Adversarial Networks (GANs). But — and someone can correct if I’m wrong — Deep Fakes use two Autoencoders. So essentially you’re training a network how to compress an image down to a very tiny representation, and then uncompress it as accurately to the original as possible. You train two of these: one for the origin…
How do you guarantee that the two trained autoencoders speak the "same language", i.e. the code learned by the autoencoder of the original face gives a reasonable output when uncompressed by the target autoencoder?
Re: Creating a deepfake took two weeks and cost $552
#63I mean. No. I understand the point of the article is “look how much I did with so little.” And it’s really good in terms of how much was done. But the final deliverable isn’t at all convincing. Clickbait title.
Man, you're reading way too much into my headline. The headline describes the article accurately: I created a deepfake. It took me two weeks and I spent $552. The headline doesn't say anything about whether it was convincing or not.
I guess I always assumed the 'deep' in deepfake meant it was convincing, but upon further consideration it's probably just a nod to DNNs. Well played sir.
Re: Creating a deepfake took two weeks and cost $552
#64The central technique used in DeepFakes is fascinating. Initially I assumed they were using Generative Adversarial Networks (GANs). But — and someone can correct if I’m wrong — Deep Fakes use two Autoencoders. So essentially you’re training a network how to compress an image down to a very tiny representation, and then uncompress it as accurately to the original as possible. You train two of these: one for the origin…
How do you guarantee that the two trained autoencoders speak the "same language", i.e. the code learned by the autoencoder of the original face gives a reasonable output when uncompressed by the target autoencoder?
For example, the canonical way to train deep machine translation systems is to make use of large parallel corpora - large set of translation pairs. In the case where this data may not exist, for structurally similar languages, one approach is to learn unsupervised word embeddings independently (i.e. using word2vec) which only require monolingual data and to find a transformation that aligns the two spaces. In many cases, neural networks still struggle with this task. However, some work in the last few years has demonstrated that a few seed word-translations is all you need to apply simple algorithms that can learn a linear or simple nonlinear transformation that work pretty well!
[1] Here is a method that proposes locally linear transformation maps for alignment: http://nakashole.com/papers/2018-emnlp-norm.pdf
Re: Creating a deepfake took two weeks and cost $552
#65That's a terrible Deepfake to be honest. This is a much better example. https://www.youtube.com/watch?v=bPhUhypV27w
Re: Creating a deepfake took two weeks and cost $552
#66Earlier quoted context omitted.
I feel like that ship sailed a while ago with Photoshop being around. I think the problem now is you can do the same with videos and the technology is more commoditized so you don’t have to be very knowledgeable to do these things.
People predicted that Photoshop was the end of truth, that journalism could no longer be trusted, that photographic evidence at criminal trials would be inadmissible. None of that actually happened because people learned to be skeptical, and to care about who took the photo, the chain of custody, and the controls to prevent digital alteration. Maybe we need something similar but more rigorous for video. The camera it…
Re: Creating a deepfake took two weeks and cost $552
#67A few weeks ago my girlfriend made me discover Instagram filters. Obviously they're not in "deep fake" territory but I was still massively impressed by the quality of the face recognition and tracking coupled with some rather advanced 3D reconstructions on top. 15 years ago that would've been science fiction, today it's a free gimmicky feature in an app running on commodity hardware. There are also apps that will smo…
It's my understanding (and experience) that Snapchat filters are even more impressive and that Snap CEO Evan Spiegel has pretty much bet the company on AR [1]. [1]: https://www.theverge.com/2019/10/22/20927521/snap-growth-ear...
Re: Creating a deepfake took two weeks and cost $552
#68Earlier quoted context omitted.
Made by a dude who has next to no experience in the field. Now imagine what a guy who knows what he's doing can do with a bit more money. That's what the allusion here is; the fact that a Reporter with 500$ even comes close should be an alarm signal to you.
I'm under the impression that these things are easier to come infinitesimally close to, but very hard to get right: i.e. the old uncanny valley problem. A reporter with $500 can get very close, but a team of PhD with thousands of dollars and a lot of time may never be able to produce something that'll convince the public. I'm NOT claiming that this is the case, I'm just saying we don't have a reason to believe why th…
There really are two separate questions though:
- Can experts with a big budget create videos that even equally expert analysis can't tell from the real thing? (Maybe yes, maybe no. But it's hard.
- With modest skill and budget, are people increasingly able to create fake videos that stand up a cursory glance and can fool people as a result? (Absolutely--or at least we're getting close.)
Re: Creating a deepfake took two weeks and cost $552
#69Earlier quoted context omitted.
Made by a dude who has next to no experience in the field. Now imagine what a guy who knows what he's doing can do with a bit more money. That's what the allusion here is; the fact that a Reporter with 500$ even comes close should be an alarm signal to you.
This is also an impressive DeepFake: https://www.youtube.com/watch?v=Wm3squcz7Aw Voice actor reads a poem in voices of famous people; his face gets swapped with the actor's face; the combination of voice and face makes it very believable.
Re: Creating a deepfake took two weeks and cost $552
#70Well Zuckerberg and Data do look like they were separated at birth, which I guess would make Zuckerberg Lore - which might also explain a few things.
So FB is the crystalline entity or the rogue Borg?