Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

They stole my voice with AI

jeffgeerling.com

Post reply on HN
Print view View original

211–220 of 461 posts

Re: They stole my voice with AI

#211

Post by gwervc »

ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

This is nothing to do with AI but with intolerance of a certain religion. That religion is killing a lot in my country and many others too, but both the governments (national and supranational) and corporations censor any criticism of it. Even here on HN I got posts and accounts removed by the moderation for the slightest hint of criticism against it, and fully expected a downvoting mob by writing this comment. Sadly, it'll will continue for a long time giving how taboo the subject is.

Re: They stole my voice with AI

#212

Post by yreg »

godelski wrote: post #140
ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

> what if AI was used to imitate a person saying something blasphemeous? I've been contemplating writing an open letter to Dang to nuke my account. Because at this time you can likely deanonymize any user with a fair amount of comments. As long as you can correlate. You can certainly steal their language, even if not 100% accurate. It may be caution, but it isn't certain that we won't enter a dark forest and there's…

I treat my accounts an non-anonymous unless I use a single-use throwaway.

I suppose even a throwaway could be linked to my identity if a comment was long enough, but probably only with some limited certainty.

Re: They stole my voice with AI

#213

Post by shevekofurras »

godelski wrote: post #140
ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

> what if AI was used to imitate a person saying something blasphemeous? I've been contemplating writing an open letter to Dang to nuke my account. Because at this time you can likely deanonymize any user with a fair amount of comments. As long as you can correlate. You can certainly steal their language, even if not 100% accurate. It may be caution, but it isn't certain that we won't enter a dark forest and there's…

You can't nuke your account. You can close it but your comments remain on the site. They'll delete your account and assign your comments and posts to a random username.

Yes this violates any EU citizen's right to be forgotten under GDPR. Welcome to silicon valley.

Re: They stole my voice with AI

#214

Post by latexr »

yapyap wrote: post #206
ryzvonusef wrote: post #205

Earlier quoted context omitted.

But, but, it sounds so realistic ! Listen kiddo, I dunno what 'cryptographic signatures' are, all I know is it sounds exactly like movedx saying they likes pineapple on pizza, and I know what I heard, sounds just like them, heard them dozen of times on TV, must have been an undercover journalist who exposed them, I say a person who likes pineapple on pizza is not welcome in my house whatever you say, now be gone!

used the wrong example there, pineapple on pizza is a nice, delicious, refreshing topping

Fine, then use dead rats on pizza. Don't focus on the letter of the example when you clearly understand the spirit. Conversation on HN aims to be better than that. Don’t reply with shallow dismissals, steel man the other person’s argument.

Your account is a week old and half your comments are dead. I recommend referring to the guidelines.

https://news.ycombinator.com/newsguidelines.html

https://en.wikipedia.org/wiki/Straw_man#Steelmanning

Re: They stole my voice with AI

#215

Post by ryzvonusef »

gwervc wrote: post #211
ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

This is nothing to do with AI but with intolerance of a certain religion. That religion is killing a lot in my country and many others too, but both the governments (national and supranational) and corporations censor any criticism of it. Even here on HN I got posts and accounts removed by the moderation for the slightest hint of criticism against it, and fully expected a downvoting mob by writing this comment. Sadly…

You are focusing too much on 'that' religion and not realising that parallel analogies exist for other countries, religions and culture too.

Sure, not lynch mobs, but AI-generate fake media can certain ruin people's lives, and unlike photshop etc, the barriers of skill and time required are very low, and the quality is very high.

I share my country's experience because I wanted to share my personal perspective and fears, but please don't under estimate how AI can affect you. Just because you won't be death doesn't mean they can't turn you into a social pariah with a few clicks.

Re: They stole my voice with AI

#216

Post by Popeyes »

movedx wrote: post #202
ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

One way that we technical folk can help prevent this is by purchasing a domain that we can call our own and then host a website that's very clear: "If my image or voice is used in a piece of digital media that is not linked here from this domain, it was not produced by me." That, and cryptographic materials being used to sign stuff too. I think that's possibly the best we can hope for from a technical perspective as…

But that doesn't account for the situation, of course you aren't going to post the illegal stuff you say. And then that gives you a blank to cheque to say what you like in private and say "Well, it isn't on my site, so it must be fake, right?"

Re: They stole my voice with AI

#217

Post by karlgkk »

yapyap wrote: post #206
ryzvonusef wrote: post #205

Earlier quoted context omitted.

But, but, it sounds so realistic ! Listen kiddo, I dunno what 'cryptographic signatures' are, all I know is it sounds exactly like movedx saying they likes pineapple on pizza, and I know what I heard, sounds just like them, heard them dozen of times on TV, must have been an undercover journalist who exposed them, I say a person who likes pineapple on pizza is not welcome in my house whatever you say, now be gone!

used the wrong example there, pineapple on pizza is a nice, delicious, refreshing topping

did the point of the analogie fly over your head so completely

Re: They stole my voice with AI

#218

Post by RockRobotRock »

donatj wrote: post #19

Maybe I am crazy but I don't really think it sounds that much like him. It's a little similar but different. It's slightly higher pitch, more nasal, and the intonation is a little different.

It's definitely his voice. Either way, why can't they hire a fucking voice actor instead of using this text to speech crap?

Re: They stole my voice with AI

#219

Post by [deleted] »

paganel wrote: post #157

For what it's worth this seems to be a thing, for example here's a video promoting some batteries-thingie with the help of AI-voice based on a (famous, in some circles) podcast girl. [1] https://old.reddit.com/r/redscarepod/comments/1fmiiwt/which_...

[deleted]

Re: They stole my voice with AI

#220

Post by johnnyanmac »

movedx wrote: post #202
ryzvonusef wrote: post #135

Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous? My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob. And thi…

One way that we technical folk can help prevent this is by purchasing a domain that we can call our own and then host a website that's very clear: "If my image or voice is used in a piece of digital media that is not linked here from this domain, it was not produced by me." That, and cryptographic materials being used to sign stuff too. I think that's possibly the best we can hope for from a technical perspective as…

Honestly, we're in a post truth era at the moment. There's so much misinformation out there that a 5 second google query can disprove, but it doesn't solve any arguments. That kind of cryprographic verification will only help you in court. There will probably be irrevocable pr damage even if you win that court case though.
Post reply on HN