Live data from Hacker News

Stop developing this technology

github.com

21–30 of 410 posts

Re: Stop developing this technology

#21

Tangent, but I think things like that will spell the end of remote working and remote interviewing.

Most people will follow the social norm of not doing this. Until that norm is broken. Perhaps the first successful presidential candidate that is revealed to be virtual will be the event that changes things.

Re: Stop developing this technology

#23
post #16
post #15

Earlier quoted context omitted.

Can we agree that it's fundamentally not a bad thing to develop a technology? If you were a legislator, how would you like to criminalize the development of technology? You know, the most difficult part of this tech is probably the facial tracking, which is probably also used for the animation of 3d avatars. The jump is probably not huge.

Many things can be unethical/immoral without being illegal, and of course there are some technologies that are fundamentally bad.

Tech is such a malleable thing. Let's say that this repo doesn't exist, but repos exist for doing facial tracking on webcam feeds and pictures (for facial recognition), and others for modifying a 3d model according to a facial model output by facial trackers (for 3d avatars).

Let's say that the tech around this DeepFaceLive repo develops to the point that the repo can become just a 10-line file of glue that makes a 3d model that's just a grid plane with a picture on it that moves according to a webcam feed. Such a repo is redundant and anyone that wants this tech can just apply the repos mentioned in the previous paragraph to do the equivalent.

Are those repos now bad? If not, it seems the ethical question can be resolved by some restructuring of code so bad uses are not made so obvious, while being almost as easy.

Re: Stop developing this technology

#24
post #7
post #6

I think it's a good thing. Not that it's being used for evil things, but because it should help make it obvious that you can't trust anything you see on a screen. Using fake media to trick people into believing anything used to be a privileged reserved for nation states and the ultra rich. Now that _ANYONE_ and their cat can do it, it should follow that nobody can believe anything that's on a screen anymore (this com…

Right. When that chaos happen, just remember that you will not be safe from it

I am already not safe from it, but it is less obvious because people like to think the technology doesn't exist merely because it is kind of expensive.

Re: Stop developing this technology

#25
Can anybody demonstrate a legitimate use of deepfake software? Has it ever been used to facilitate a socially positive or desirable outcome? While I recognize my experiences are far from definitive, I hazard most would be hard pressed to name anything positive that came out of deepfake technology.

edit: I’ll take your knee-jerk DV, and any others, as an admission of an inability to speak to positive utility of this technology.

Re: Stop developing this technology

#26
post #8

an age old discussion. ultimately i prefer for this technology to be developed in the open on github and be aware of it (and able to combat nefarious use of it). the alternative is that its being developed hidden and used by the most vile and evil without many being aware of it (which it most definitely will) As with nuclear, the cats out of the bag or the babys bathwater(?) already spilled, no way to turn back the c…

now that it is in the open , any high school boy can create some porn deepfakes of their classmates and suicide rate will probably rise. Let's see if you still hold this view when one of your family members is a victim

People have been able to draw naked pictures of people forever, and almost anyone with very little skill has been able to create extremely believable realistic fake naked photographs of people for over a decade now. I honestly don't understand the fear here: video is only more believable than a photograph because video is harder to forge... well, now it isn't, so video isn't believable either. But video could already be forged before, it just required more effort and more skill so a bunch of people have chosen to accept a miserable heuristic that it can't be forged and so it is worth always believing it... why is this good? How is this even sort of OK? We should strive to live in a world where video is as farcical as photography.

Re: Stop developing this technology

#27

an age old discussion. ultimately i prefer for this technology to be developed in the open on github and be aware of it (and able to combat nefarious use of it). the alternative is that its being developed hidden and used by the most vile and evil without many being aware of it (which it most definitely will) As with nuclear, the cats out of the bag or the babys bathwater(?) already spilled, no way to turn back the c…

I disagree. Most scammers are unable to build this. Providing attackers with ready to use tech will increase attacks.

Re: Stop developing this technology

#28
Quite often in science fiction media, despite the advancement of technology, I see text and graphics(but not pictures) only as User Interfaces. I wonder if this is the path we will be going down. Zero trust towards images and video

Re: Stop developing this technology

#29
There are a lot of completely benign usecases.

1. I want to deepfake myself to have an avatar for online interaction.

2. I want to generate videos instead of filming by pasting people into existing videos.

3. Prevent a Face/Off of scenario.

Re: Stop developing this technology

#30
post #17
post #8

Earlier quoted context omitted.

now that it is in the open , any high school boy can create some porn deepfakes of their classmates and suicide rate will probably rise. Let's see if you still hold this view when one of your family members is a victim

We are lifing just fine with car related deaths. The rate is much higher than suicide rates. Bullying is alive and well even without this tech. I guess scissoring out a photo from the yearbook and glue it in a porn magazine would work as good. It is not about believability but about the psychological damage when it comes to bullying

But with cars there is an upside, we tolerate it because it is so usefull and the government does its best to make it as safe as possible, setting requirements that need to be met for you to legally use it.

In this case there isn't that much upside, it's basically only being used for non-consensual porn generation and impersonating people

Post reply on HN