Has anyone followed the install instructions successfully on an m1 mac?
We haven't really tested it on M1. You are welcome to give a try and open an Issue if any problem
Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
291–300 of 336 posts
Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
#292A few months ago, the IRS made me verify my identity using some janky video conferencing software where I had to hold up a copy of my passport. The software was so hard to use, that I can't believe average people manage to do it. Now, real-time deep fakes are literally easier to create than using the video verification software itself. This will have interesting societal implications.
I mistyped my SSN this year and I wound up doing something similar: I had to take off my glasses and hold my face exactly in the center of the camera, while repeatedly squinting (hopelessly) to try and read the error messages as they alternated between "TOO CLOSE" and "TOO FAR AWAY". I gave up and, luckily, a few hours later found the mistake.
Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
#293Hi there, one of the maintainers here. Thanks for sharing & AMA!
Mind releasing some footage of your face and your personal information? It would be a nice gesture to say "I am as much at risk of the consequences of my actions as the people I have chosen to put at risk"
You can easily google me.
Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
#294Earlier quoted context omitted.
This is explored further in Nick Bostrom's Vulnerable World Hypothesis. He believes that not even a total global surveillance system would be able to stop a single teenager with the recipe for a homemade pathogen. Nothing changes about the laws of the universe in that case, only the fact that the information was not in our minds before and then it is, and we collectively cannot forget or uninvent it. We as a species…
> When Jobs held up the first smartphone and we all started cheering and fantasizing, did any of us think it would lead to this? Jobs didn’t hold up the first smartphone and smartphone proliferation has little to do with the AI research that led to deepfakes.
I was more trying to point out that what we might hope comes out of new technology in the future may not necessarily come true, or the benefits might come with as-yet-unknown downsides that only become visible by the technology being proliferated extensively (and irreversibly).
Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
#295Earlier quoted context omitted.
Indeed it is, but I'm interested in this particular author's stance on this, prompted by their disclaimer which clearly indicates that they realize that there is the risk of abuse, and an AMA seems to be an excellent opportunity to gain some insight.
I agree. I'm not OP but I would answer like this: abuses of this technology are inevitable and can only be mitigated by counter-software (which leads to an arms race). The release of this source code could kickstart the development of deepfake detection software. Or maybe in general people need to put less weight on video evidence.
Please read this https://www.biometricupdate.com/202205/sensity-alleges-biome...
We have warned many vendors about the vulnerability of their commercial biometrics software. The threat is currently downplayed by the whole industry. We hope this release to be a wake up call and that our team will be joined by other experts in raising the alarm.
Deepfakes are already used for spoofing KYC around the world. This is already happening, and not by using `dot`.
Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
#296Earlier quoted context omitted.
Even if you claim that you are legally not responsible for any abuses of this software do you feel any moral responsibility?
I too would like to imagine whether or not I would release something like this in similar circumstances. Yet this question seems unfairly loaded. At the least - premature. Though we can easily imagine it, afaik there is no evidence of any actual abuse to date.
As commented above:
Please read this https://www.biometricupdate.com/202205/sensity-alleges-biome...
We have warned many vendors about the vulnerability of their commercial biometrics software. The threat is currently downplayed by the whole industry. We hope this release to be a wake up call and that our team will be joined by other experts in raising the alarm.
Deepfakes are already used for spoofing KYC around the world. This is already happening, and not by using `dot`.
Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
#297Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
#298Hi there, one of the maintainers here. Thanks for sharing & AMA!
I just wonder. How well will this work with less realistic textures? Like imagine applying some textures on video game 3D model? And yeah please don't be discouraged to continue publishing your work and models because some people think it's can be abused. Bad guys always have access to the tech they want anyway.
Thanks for questions. The main faceswap algo that we use is SimSwap. You can take a look at their repo for understanding limitation and chance to be applied to 3d game model. To some extend it will work, but I suspect it may not blend very photorealistically.
Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
#299Earlier quoted context omitted.
As someone with a stalker, I can't emphasize this enough. A stalker will go to all sorts of lengths to do bizarre shit. People don't believe it. I would guess governments will do some equivalent there-of. Democratizing access to things -- including bad things -- has a preventative effect: 1) I can guard against things I know about 2) People take me seriously if something has been democratized The worst-case scenario…
> Democratizing access to things not to be too pedantic, but this is not "democratizing access", as that would involve print-outs/usb sticks/discs of the code distributed to people that can't access the internet, accessibility issues, bias considerations etc etc. as such, this is just "access".
Athens, late medieval/early modern Poland, and the early US all had democratic systems of sorts where about 10% of the population, give-or-take, were in the electorate.
Likewise, slavery Access, inclusion, and democracy aren't binary concepts, and progress is gradual.
Re: Deepfake Offensive Toolkit (real-time deepfakes for virtual cameras)
#300Governments and bank branches should offer physical identification as a (potentially payed) service globally, and provide a digital signature that a person is owning a physical device (which should be valid until the device is reset or invalidated by the person).
One the author here. Please read this https://www.biometricupdate.com/202205/sensity-alleges-biome...