Live data from Hacker News

Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

github.com

21–30 of 336 posts

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#21
post #16
post #9

Earlier quoted context omitted.

It is an attempt at a legal disclaimer. It may not hold up in court.

It's the same as the age old "guns don't kill people" that seems to work fine for the weapons industry in the US.

The world is larger than the US, and even there that argument does not hold water:

https://www.nytimes.com/2022/02/15/nyregion/sandy-hook-famil...

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#23

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

All I learned from this response was to just release tools like this on Darknet Marketplaces and maybe Telegram and just forget the disclaimer

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#24

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

This has a clear benign use. Of course it sucks that you can also use it in a hostile manner - but the fact that this tool is publicly available rather than hidden in the pocket of some unscrupulous blackhat means that every space that uses verification with these methods can now incorporate this type of testing. That's a net benefit for society.

I do think disclaimers like this are a little juvenile (it reeks of a US-ian litigation mentality), but you can easily imagine why they put it there. Perhaps instead of the author being less naive, you need to be more empathetic.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#25

> Authors and contributing developers assume no liability and are not responsible for any misuse or damage caused by the use of this program. Anything that can be created, will be created. However, that doesn't free you from all moral culpability. If you create something, make it freely accessible and easy to use, then I think you are partly responsible for its misuse. I'm not saying that they shouldn't have created…

What do you do? IMHO, only person naive here is you.

People should be happy, that there are still white-hats who're reporting exploits, even for no profit. I personally switched to gray-market, can't take the shit we get from companies, anymore.

This tool released publicly is only to bring an awareness to the topic. Everybody else who needed to exploit this, have these tools developed in private.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#26

Earlier quoted context omitted.

I too would like to imagine whether or not I would release something like this in similar circumstances. Yet this question seems unfairly loaded. At the least - premature. Though we can easily imagine it, afaik there is no evidence of any actual abuse to date.

Tools like these will end up in the hands of those that are trying to harden an installation and in the hands of those that will end up using them to try to break into such installations. I've often wondered whether the net effect of the whole security research community is a net positive or a net negative and I honestly do not know the answer. So yes, it is a loaded question. But asking yourself if what you can do i…

Thank you for a considered response. I share those feelings.

I just hope the person offering AMA will not be daunted by a good but blunt question from a voice that carries weight around here.

Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)

#29

Earlier quoted context omitted.

Tools like these will end up in the hands of those that are trying to harden an installation and in the hands of those that will end up using them to try to break into such installations. I've often wondered whether the net effect of the whole security research community is a net positive or a net negative and I honestly do not know the answer. So yes, it is a loaded question. But asking yourself if what you can do i…

Thank you for a considered response. I share those feelings. I just hope the person offering AMA will not be daunted by a good but blunt question from a voice that carries weight around here.

I've been in that position, which is one of the reasons why I'm asking. When I came up with 'live streaming video on the www' I never for one second sat down to think about the abuse potential. Color me hopelessly naive. And when confronted with the various abuses over the years I've always had a problem with that, this was the direct consequence of me just 'scratching my itch' and it caused a huge amount of misery. Oh, say the defenders, but if you had not done it then somebody else would have. This is true, but then that moral weight would be on their shoulders and not on mine.

Hence my question. Because I do feel that weight and it has caused me to carefully consider the abuse potential of the stuff that I've released since then and I've only released those things that I feel have none that I can (easily) discern.

Post reply on HN