Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

github.com

Post reply on HN
Print view View original

71–80 of 336 posts

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#71

Post by 2OEH8eoCRo0 »

xiphias2 wrote: post #62
2OEH8eoCRo0 wrote: post #59

Earlier quoted context omitted.

I always imagined the USPS fulfilling this need.

I don't know how serious is USPS, but in my country the post office doesn't check if the signature looks the same for example. Banks face and handle fraud on a much higher level, and have a much better training in identificacion.

My signatures never look the same. Signatures aren't a good judge of authenticity.

My point is that a bad actor would have to show up in person and lie to a federal entity. It's not that they won't get away with it- it's that they cannot hide on the other side of the globe.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#72

Post by jacquesm »

mod wrote: post #66
mjbeswick wrote: post #50

Earlier quoted context omitted.

The difference is that guns are literally deigned for killing people. There are nonlethal alternatives, so when people buy guns (the exception being hunting) the purpose it to be able to kill someone.

There are non-lethal alternatives to devices "literally deigned [sic] for killing people?" This logically does not compute. I guess you mean in situations where guns are currently used, other strategies could be employed? Since the goal of a firearm is to hurl a chunk of metal through the air at high speed, I can't really think of alternatives. Besides air rifles, we just have traditional powder guns filling that nic…

I'm a bit confused here: the majority of the uses for guns seem to not be to 'hurl a chunk of metal through the air at high speed' but the intended outcome: to wound or kill someone. Sure, there is hunting but since the advent of the farm hunters have seen less and less employ, to the point that some societies have no hunters at all.

Guns are universally classed as 'weapons' not as 'metal object throwers'.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#74

Post by alexjurkiewicz »

ls15 wrote: post #55
Planktonne wrote: post #7

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

Unless we cut off the chain of responsibility somewhere, the creators of the programming language, the computer and its components, as well as the people who have designed the computer and those who mined the required minerals are responsible as well.

Good thing nobody is suggesting we *checks notes* jail silica miners for building the Deepfake Offensive Toolkit.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#75

Post by Tepix »

giorgiop wrote: post #4

Hi there, one of the maintainers here. Thanks for sharing & AMA!

I'm interested mainly in the moral aspects.

1. How would you feel if this toolkit were used to create a embarassing and convincing deepfake videos of you and/or your family members (perhaps your parents)?

2. Why do you think you have to enable people to fake videos very easily?

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#76

Post by throw9871928 »

I work at Axis, which makes surveillance cameras.[0] This comment is my own, and is not on behalf of the company. I'm using a throwaway account because I'd rather not be identified (and because surveillance is quite controversial here).

Axis has developed a way to cryptographically sign video, using TPMs (Trusted Platform Module) built into the cameras and embedding the signature into the h.264 stream.[1] The video can be verified on playback using an open-source video player.[2]

I hope this sort of video signing will be mainstream in all cameras in the future (i.e. cellphones etc), as it will pretty much solve the trust issues deep fakes are causing.

[0] https://www.axis.com/ [1] https://www.axis.com/newsroom/article/trust-signed-video [2] https://www.axis.com/en-gb/newsroom/press-release/axis-commu...

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#77

Post by throwaway71271 »

wiz21c wrote: post #52
Planktonne wrote: post #7

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

Reminds me of Oppenheimer: "I am become Death, the shatterer of worlds."

you can hear Oppenheimer himself: https://www.youtube.com/watch?v=lb13ynu3Iac

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#78

Post by davidguetta »

Planktonne wrote: post #7

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

Having morals when the other side doesn't is a weakness.

Make the tools available to everyone. As Elon musk says, sun is the best disinfectant.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#79

Post by thrwawy283 »

barnabee wrote: post #43
Planktonne wrote: post #7

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

I’d argue there is a moral imperative to create and release tools like this as free and open source software so that anyone has access to them and can choose whether to use them, rather than only sophisticated and well resourced adversaries. IMO the creators should feel good about their actions, even if they feel bad or apprehensive about the direction of the world because this technology exists at all.

I'm not saying it's a good idea to give everyone a gun, but I do like the argument that the disadvantaged have the same opportunity to pull a trigger. I hope humanity learns wisdom as quickly as we innovate. We've made it this far..

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#80

Post by Tepix »

throw9871928 wrote: post #76

I work at Axis, which makes surveillance cameras.[0] This comment is my own, and is not on behalf of the company. I'm using a throwaway account because I'd rather not be identified (and because surveillance is quite controversial here). Axis has developed a way to cryptographically sign video, using TPMs (Trusted Platform Module) built into the cameras and embedding the signature into the h.264 stream.[1] The video c…

> it will pretty much solve the trust issues

I'm not so sure. How will you verify a signature if you see a video on TV or on social media? Do you believe these devices are 100% secure and the keys will never be extracted?

Post reply on HN