Live data from Hacker News

Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

github.com

71–80 of 129 posts

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#71
post #16

I'm curious what would happen if somebody tried to impersonate the US president using this. He would say it's fake, but who would believe him? How exactly can computer scientists explain deepfakes to laymen?

I thinka layman would be perfectly capable of understanding "computers can now create fake videos so real you can't spot them". Not that that claim is quite true yet.

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#72

I'm probably being captain obvious here, but if this is what's being released for free, I wonder how much better a polished commercial version does, and when we reach the point where we can't trust anything we see anymore. It doesn't even have to be super perfect, even reaching the point where it takes experts about two weeks to determine if something's real or not might already be long enough to do great damage. Fro…

Honestly, you just need to convince one person to execute a successful social engineering attack.

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#73
post #66

Earlier quoted context omitted.

DRM will be pushed hard, starting from video/audio acquisition, perhaps assisted by blockchain to keep footage verified at all processing steps.

Don't you think that a blockchain that works for anything other than a rather useless currency should be created before suggesting one for such a use? I see comments all the time about how we should use blockchain for this and that, and yet far simpler uses for blockchain haven't yet worked out.

The sentiment and idea is there, just need the implementation.

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#74
post #58

I'm probably being captain obvious here, but if this is what's being released for free, I wonder how much better a polished commercial version does, and when we reach the point where we can't trust anything we see anymore. It doesn't even have to be super perfect, even reaching the point where it takes experts about two weeks to determine if something's real or not might already be long enough to do great damage. Fro…

Isn’t this something a lookalike and some good make up could already do for ages?

That would require an entire team's worth of skill, preparation and work. This could be done with a few already existing medias, and a single person behind a computer.

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#75

I'm probably being captain obvious here, but if this is what's being released for free, I wonder how much better a polished commercial version does, and when we reach the point where we can't trust anything we see anymore. It doesn't even have to be super perfect, even reaching the point where it takes experts about two weeks to determine if something's real or not might already be long enough to do great damage. Fro…

AI can also be used to identify these fake videos, and they are probably better than human identification. There will be a rise of AI forensics.

The type of neural network they use (GAN) works by having two networks battling each other, one tries to generate fake, and another (discriminator) tries to identify fake, it's a constant arms race. As the generator gets better, the discriminator also gets better. Which means, if the fake video is this good, there must be a discriminator network that identifies fakes just as good.

We did a similar project using GAN, generating images from a text description. You can see the progression of generator and discriminator battling each other, and both get better with time.

https://github.com/yonkshi/text2imageNet

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#76
Seeing the example of one facial pose video transcribed to three different looking women, I'm imagining a future where Netflix does a/b testing on its shows, using similar tech to swap out different "actors" to find which one resonates with audiences best.

They could even generate a new "cast" for each market, after only shooting the show once.

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#77
post #11

From the paper: "we have to use all the GPUs in DGX1 (8 V100 GPUs, each with 16GB memory) for training. We distribute the generator computation task to 4 GPUs and the discriminator computation task to the other 4 GPUs. Training takes ∼10 days for 2K resolution." As I don't have a DGX1 here, training the 2K resolution net for 10 days on a p3.16xlarge instance (also has 8 V100 GPUs) would cost USD 5875 on AWS. (USD24.4…

Their GitHub README says 24GB, and 12/16 GB requires cropping and performance not guaranteed. I’ve only seen P100 with 16 each, and its the big Quadros that have 24

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#78
post #2

Am i reading that right? Its making the videos that look real, from the simplistic input? If so, that is amazing. And if so, how do I turn a video I have into a simple/line version, to be able to then put a different 'skin' on it?

The level of realism can be gauged from the examples they provide right there on the page. Of course your results may vary basing on the initial bulk of data of realistic source images you use. You have the code right there on Github, just install it on some PC with powerful GPUs (or rent one), tune some parameters, train the network and you can do the same things.

The hardware they used costs tons of money, and so does doing on a cloud provider. It’s not something to do in a weekend with your gaming card.

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#79
post #11

From the paper: "we have to use all the GPUs in DGX1 (8 V100 GPUs, each with 16GB memory) for training. We distribute the generator computation task to 4 GPUs and the discriminator computation task to the other 4 GPUs. Training takes ∼10 days for 2K resolution." As I don't have a DGX1 here, training the 2K resolution net for 10 days on a p3.16xlarge instance (also has 8 V100 GPUs) would cost USD 5875 on AWS. (USD24.4…

The DXG-1 costs $129,000 so AWS is cheaper unless you need to do it 22 times. And you can have multiple instances running at once and get all of your results in ten days, instead of waiting ten days again for each run.

Re: Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

#80
post #79
post #11

From the paper: "we have to use all the GPUs in DGX1 (8 V100 GPUs, each with 16GB memory) for training. We distribute the generator computation task to 4 GPUs and the discriminator computation task to the other 4 GPUs. Training takes ∼10 days for 2K resolution." As I don't have a DGX1 here, training the 2K resolution net for 10 days on a p3.16xlarge instance (also has 8 V100 GPUs) would cost USD 5875 on AWS. (USD24.4…

The DXG-1 costs $129,000 so AWS is cheaper unless you need to do it 22 times. And you can have multiple instances running at once and get all of your results in ten days, instead of waiting ten days again for each run.

Well plus electricity. A DGX-1 takes 4 kilowatts or so that 10 day training run will take just about a megawatt hour or about $100 at retail. So the cross over point is more like 23 runs :)
Post reply on HN