Live data from Hacker News

Stop developing this technology

github.com

211–220 of 410 posts

Re: Stop developing this technology

#211
I don’t think any specific technology is good or bad, but I do think you could attempt to quantify its impact better by measuring how often it’s used for “good” versus “bad”.

It’s not going to end the argument though, not least because you’ll then have to assign a relative value to abstract things like “personal freedom” or “artistic expression”.

Even if you could quantify the losses to crypto scams, you can’t put an objective value on some of its more ideological benefits.

Re: Stop developing this technology

#212

Earlier quoted context omitted.

> > it WILL be developed no matter how much people wish it wouldn't. > Sure, but there's a value in delaying that development. Delaying harm is a valid tactic. It is a horrible tactic when your adversary has ultra-deep pockets & mountains of bodies to throw at the problem. Whatever's being developed here has 1/10th the capability of the tech being developed in black site facilities at the behest of national militarie…

Which are blocked from pulling from Github?

You really think the government sponsored projects are subject to bans on downloading stuff from GitHub?

Re: Stop developing this technology

#213

The deepfake thechnology is awesome and should be available to everybody. Because this is the only way everybody can be finally taught to think critically about everything thay hear/see. Can you believe a politician saying something on TV? Hell no! You should exercise logic about the whole political play he is a part of. Should you think bad about a person you find on a porn site? Absolutely no, what good could resul…

This rabbit hole goes waaay deep. Why should people believe anything you say on this topic? How can they know you're not a bot or a psy-ops troll working for Xi or Putin with the mission to undermine the very fabric of Democratic societies? What truths/facts should people NOT doubt when they're using "common sense" and thinking "critically". Are we not all affected by propaganda that directly targets what we consider…

> We may need to find a way back to a world where there is one main shared narrative that we can all more or less trust. Where the custodians of the institutions that provide the narrative understand the need to maintain the trust and the risks involved in undermining the trust for personal gain, and where there are checks and balances that removes bad actors from such positions.

When was such time in history? I'm trying to think of one and I can't. Misinformation has spread in the past too, albeit slowly. The checks and balances did nothing to stop the custodians of the institutions from dismissing heliocentrism, the germ theory, or the continental drift. And for a modern example, the checks and balances failed when the authorities shared a narrative about weapons of mass destruction in Iraq.

All of that was possible without today's technology.

Re: Stop developing this technology

#214

Earlier quoted context omitted.

I understand the sentiment but I disagree. It's just another disruptive piece of technology that people will have to adjust to. If you can't trust a digital face, then nobody will and using this tech for scamming purposes will simply fizzle out after an initial "adjustment period". I know that sounds rough but society might react differently than you think, i.e.: with digital faces being useless for identifying peopl…

I don't see a difference between any technology. So if we can frown upon some nation for developing nukes, we can frown upon a group people for developing this. On the other hand somebody can say "if we don't, then others will". So regulate and ban the technology, then.

> So regulate and ban the technology, then.

When has that ever worked? What banned technology is conceived of but not developed because some government entity said not to?

I think the "if we don't, then others will" is part of the natural progression of technology. Whatever the next logical step of development is, that's where development efforts will flow. Some might not want to go there, but some will. Someone banning it will likely only fan the flames and drive more interest into the space - ala the "Streisand Effect".

When the US government (et al) labeled certain numbers "illegal" because they could be used to break DRM or certain encryption types, academia and hackers alike openly mocked the notion. T-shirts, stickers, and websites sprung up further spreading this "illegal" knowledge. People who had no idea about how a number could be so "dangerous" suddenly wanted to know. By telling people they can't know or do something will absolutely drive people toward that knowledge.

The hacker mentality often answers the question "why?" with "because I can". Saying you cannot only encourages more to jump in.

Re: Stop developing this technology

#215

I wonder if some form of regulation is coming to tech. We do not allow people to spread heroin freely or slavery or some other sort of horrible stuff.

How are you going to effectively regulate a white paper? Or Stable diffusion? These things can be trained on readily available, easily purchased by the average citizen commodity GPU hardware. Heck, there’s rumors NVIDIA has an RTX titan in the pipe for under $3000 with 48GB of VRAM!

Even if the government regulates that I can’t physically have one, I could rent a rig of A100X8 servers in Russia, VPN tunnel into it, and download whatever artifacts the server generates.

How in the world could any government short of North Korea effectively regulate such a thing, even if they went full authoritarian, the blowback from such draconian measures would be intense?

Re: Stop developing this technology

#216

Earlier quoted context omitted.

> there also many good counter-arguments. Someone will develop it, and someone will use it for nefarious purposes - as one terrorist organization spokesperson once said, "We only need to get lucky once. You need to get lucky every time". If it is developed like this, in the open, at least we have a better chance to understand its capabilities and limitations, and to be better equipped to build countermeasures.

Yes but in the end it’s all about choice . It’s not some creation of chaotic coincidences and circumstances. It’s not some accidental discovery. It’s an active choice by whoever decides to make it for whoever purpose. The argument isn’t matter of should it be made, but that the only reason it’s being made is because of people actual choices to do so. It’s not randomly spawning Into existence of its own free will.

An extreme version of this might be:

> I saw Bob about to stab Alice, so I beat Bob to it and shot her in the head. I did nothing wrong since the outcome would have been the same regardless of my actions.

Re: Stop developing this technology

#217
post #215

I wonder if some form of regulation is coming to tech. We do not allow people to spread heroin freely or slavery or some other sort of horrible stuff.

How are you going to effectively regulate a white paper? Or Stable diffusion? These things can be trained on readily available, easily purchased by the average citizen commodity GPU hardware. Heck, there’s rumors NVIDIA has an RTX titan in the pipe for under $3000 with 48GB of VRAM! Even if the government regulates that I can’t physically have one, I could rent a rig of A100X8 servers in Russia, VPN tunnel into it, a…

I don't really know it does sound super hard. But maybe if we consider that we go down the path where you do not own your tech (we are close to that now) and the companies have some monitoring tools to see what you are doing. And then you have this kind of network of trusted machines that you communicate with.

Edit: i really don't like the idea that i have to be paranoid about every interaction with tech.

Re: Stop developing this technology

#218
post #5

Earlier quoted context omitted.

"must" is probably the wrong word, but if they don't develop it, someone else will. At most, it would be delayed, and I'm not sure there's much difference in that.

Can we agree that “someone would have done this anyway” is a poor justification for one’s actions? That’s what you say when you 1) recognize that you did a bad thing, but 2) don’t want to be blamed for it.

If I can become rich instead of someone else, and the damage will be done either way, it seems perfectly rational if I can avoid any actual legal punishment (I don’t care about people on Twitter being angry with me, Twitter isn’t real life) to push the big red button and reap the rewards.

Once I’m rich and powerful I can afford to be ethical, isn’t that the way of billionaires anyway?

Re: Stop developing this technology

#219
post #43

Earlier quoted context omitted.

Edit: this comment is referring to deepfakes more broadly, and is not a commentary on the validity of the source linked here. I can't speak to the reputability of the community developing this, or how it has been used so far. -- I'm a fairly visual and imaginative person, and it's pretty easy for me to come up with some very useful applications. No hostility intended, genuinely sharing my thoughts: 1. CGI for video e…

First let me thank you for a thoughtful riposte! I do appreciate that. My question was an honest one and I imagine, not the easiest to conceive an answer to. I genuinely appreciate your taking the time to share your thoughts. With that said almost every use-case cited was financial or monetary gain whereas I enquired about social utility and value. That dishonesty ie creation of a fake avatar is cited as being of soc…

> With that said almost every use-case cited was financial or monetary gain whereas I enquired about social utility and value.

It could allow people to petition their government [0] without having someone bust down their door at 3am and disappear forever.

[0] Which is apparently important enough to have been included in the bill of rights

Re: Stop developing this technology

#220
post #18

Earlier quoted context omitted.

From the main page: “Communication groups [...] • mrdeepfakes - the biggest NSFW English deepfake community”, which strains my assumption of good faith debate regarding their ethics.

> strains my assumption of good faith debate regarding their ethics. Let's flip the argument upside down. Let's imagine you want to produce porn content, but don't want to be recognized. This technology allows that.

I've already seen porn where someone's face is blurred.

And whose face are you going to put in that porn with this?

Post reply on HN