Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

github.com

Post reply on HN
Print view View original

101–110 of 336 posts

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#101

Post by A4ET8a8uTh0 »

Planktonne wrote: post #7

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

Hmm. It is a tough one.

I am closer to your line of thinking than not, but, at the same time, from where I sit, it seems that data monitoring went too far already and regular user has to have a way to circumvent it.

For that reason alone, this tool, even if it will result in some abuse, it just evens out the playing field.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#102

Post by mike_hock »

Tepix wrote: post #73
kalal wrote: post #69

Serious question. What is the chance this video has been deepfaked? https://www.youtube.com/watch?v=ENlL-Uru-cM&ab_channel=CNBCT...

It was published by the official channels. What are you implying?

That his staff couldn't get him to do the sensible thing so had to deepfake his press conference.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#104

Post by forgingahead »

Planktonne wrote: post #7

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

We're actually super fortunate that the development of deepfake technologies have been done relatively out in the open, with source codes, concepts, and pre-trained models often being readily shared. This allows for a broader based understanding of what is possible, and then hopefully develop ways for folks to inoculate themselves, or at least have some societal-level resistance to being hoodwinked by them. If this tech was only developed in secret, and was being used in a targeted manner, who knows what kind of large-scale manipulations would be being undertaken.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#105

Post by Planktonne »

davidguetta wrote: post #78
Planktonne wrote: post #7

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

Having morals when the other side doesn't is a weakness. Make the tools available to everyone. As Elon musk says, sun is the best disinfectant.

Having morals when the other side doesn't is the best possible reason to be on different sides.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#107

Post by mensetmanusman »

bjt2n3904 wrote: post #98
IfOnlyYouKnew wrote: post #84

Earlier quoted context omitted.

I can’t see a way this technology could be used defensively. Wide access just leads to more abuse. There’s no principle by which it serves some sort of justice to make some crime more accessible. It’s surprising how often this argument is made compared to, say, equal-opportunity access to fancy cars or good housing.

They literally have a demonstration of the tool being used to evade an intrusive "send us a video of your face, turn your head both ways, blink". That isn't a defensive use!?

Definitely useful for scammers.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#108

Post by galangalalgol »

jonathanstrange wrote: post #89
throw9871928 wrote: post #76

I work at Axis, which makes surveillance cameras.[0] This comment is my own, and is not on behalf of the company. I'm using a throwaway account because I'd rather not be identified (and because surveillance is quite controversial here). Axis has developed a way to cryptographically sign video, using TPMs (Trusted Platform Module) built into the cameras and embedding the signature into the h.264 stream.[1] The video c…

It shouldn't be too hard to film a deepfake movie from a screen or projection that don't make it obvious it was filmed. That way, the cryptographic signature will even lend extra authenticity to the deepfake!

A screen with double the resolution and twice the framrate should be indistinguishable. Moreover if you pop the case on the camera and replace the sensor with something fed by display port (probably need an fpga to convert display port to lvds, spi,ic2 or whatever those sensors use, at speed) that should work too.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#110

Post by imiric »

jacquesm wrote: post #61
yosito wrote: post #60

Earlier quoted context omitted.

It doesn't matter what anyone thinks about it.

I actually disagree with that. I think software and ethics are closely intertwined and too often we see them as disjoint. It's interesting to try to find a software project that does not have an ethically dubious angle to it, that isn't all that simple.

While it's an interesting discussion, would you ask the same question to a knife or sword maker? Your tone in this and the AMA thread is combative, and wouldn't lead to a productive discussion.

It would be much more interesting to discuss the technical merits of this project than any particular moral concerns you might have, especially on this forum.

Post reply on HN