Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenVoice: Versatile Instant Voice Cloning

arxiv.org

Post reply on HN
Print view View original

181–190 of 207 posts

Re: OpenVoice: Versatile Instant Voice Cloning

#181

Post by jokethrowaway »

ben_w wrote: post #97
jokethrowaway wrote: post #90

Earlier quoted context omitted.

How? Your bank stores personal data covered by gdpr but enabling crappy secure systems is not the domain of gdpr. Most likely this is caused by SCA another European directive that ruined our lives with extra security hoops (for payment providers) for little extra security - or even worse in case of voice password or security questions

A person's voice is, I believe, personal data. > Processing personal data is generally prohibited, unless it is expressly allowed by law, or the data subject has consented to the processing - https://gdpr-info.eu/issues/consent/

I see, good point!

Given the same voice get processed and recorded during a normal phone call to the bank so you would need to give consent just to talk on the phone (and they do have a disclaimer when you are calling in Europe).

Most likely this is buried deep in some massive EULA you accept when you open an account.

Re: OpenVoice: Versatile Instant Voice Cloning

#182

Post by jokethrowaway »

RagnarD wrote: post #106

My first and ongoing thought is that immoral/criminal uses of voice cloning vastly exceed any legitimate ones.

I disagree, we should just not accept voice as authentication.

I think the most common use case will be making art & content programmatically without voice actors (and most likely without actors at all once we nail video or a 3d model pipeline + frame by frame transformation to make it look realistic)

Re: OpenVoice: Versatile Instant Voice Cloning

#183

Post by ben_w »

jokethrowaway wrote: post #181
ben_w wrote: post #97

Earlier quoted context omitted.

A person's voice is, I believe, personal data. > Processing personal data is generally prohibited, unless it is expressly allowed by law, or the data subject has consented to the processing - https://gdpr-info.eu/issues/consent/

I see, good point! Given the same voice get processed and recorded during a normal phone call to the bank so you would need to give consent just to talk on the phone (and they do have a disclaimer when you are calling in Europe). Most likely this is buried deep in some massive EULA you accept when you open an account.

All processing is supposed to require explicit and meaningfully informed consent for each separate use; one of the GDPR training lessons we get over here is basically "Bob has a bunch of customer's emails he got from the sign up process, is he allowed to use them to send adverts for a new product?" and the answer is "No, that's only allowed when the customers explicitly consented to that, you can't just use any data they happen you have given you for whatever new purpose you want".

EULAs are a bit more of a mess, as all the advice I've been given says "don't hide stuff like that" while all the websites I visit are "we're going to do this anyway because we think we can get away with it".

Re: OpenVoice: Versatile Instant Voice Cloning

#184

Post by ben_w »

jokethrowaway wrote: post #180
toss1 wrote: post #157

Earlier quoted context omitted.

Sadly, the US, where I currently live, is quite behind in this. Considering going expat (not for this specific reason, but it doesn't help); any expats have recommendations of what countries have worked well for them?

Heavily depends on money available / crime level tolerance - albeit crime level in the US is pretty crazy. Europe is deteriorating incredibly rapidly in terms of crime (due to a combination of economic poverty and uncontrolled immigration from third world countries) - but I think some of the low tax EU countries (Malta, Cyprus, Gibraltar, etc) are a good bet for a few more years. My top choice if I had family (or fri…

> Gibraltar

That's a British Overseas Territory, it isn't in the EU.

Re: OpenVoice: Versatile Instant Voice Cloning

#185

Post by ben_w »

toss1 wrote: post #157
jokethrowaway wrote: post #90

Earlier quoted context omitted.

How? Your bank stores personal data covered by gdpr but enabling crappy secure systems is not the domain of gdpr. Most likely this is caused by SCA another European directive that ruined our lives with extra security hoops (for payment providers) for little extra security - or even worse in case of voice password or security questions

Sadly, the US, where I currently live, is quite behind in this. Considering going expat (not for this specific reason, but it doesn't help); any expats have recommendations of what countries have worked well for them?

I recommend you first narrow it down to somewhere whose main language you can speak. I picked Germany because I already had some experience with the language and slightly Dunning Kruger'd myself. I like it, but… well, even native German speakers say „Deutsche Sprache, schwere Sprache“ ("German is hard").

Cyprus has a lot of English speakers (and indeed a lot of street furniture that looks just like the UK, plus two UK airforce bases[0]), but the national language is Greek… I don't know if I'd risk that, given the one time I tried to ask for «Ένα σάντουιτς και ένα τσάι παρακαλώ»[1] in Athens[2], the person behind the counter replied in English to correct my pronunciation.

[0] https://en.wikipedia.org/wiki/Akrotiri_and_Dhekelia

[1] https://translate.google.com/?sl=el&tl=en&text=Ένα%20σάντουι...

[2] I know that's not in Cyprus, but it is, as you may guess, another place where Greek is the national language.

Re: OpenVoice: Versatile Instant Voice Cloning

#186

Post by whywhywhywhy »

chipper02 wrote: post #154

Now of only youtube would ban the use of this crap. Or at the very least allow you filter those videos.

There's genuine uses, look at Apple offering this tech recently as an accessibility feature for people losing the ability to speak to have text to speech in their own voice in lieu of being able to vocalize it themselves.

You're banning genuine uses like that or just creators who want to fix a fumbled or awkward line without completely re-recording if you ban it.

Re: OpenVoice: Versatile Instant Voice Cloning

#187

Post by whywhywhywhy »

ignu wrote: post #36
danielbln wrote: post #12

Earlier quoted context omitted.

Elevenlabs has been around for a while now. Genie has been out of the bottle for a bit, and the sooner the notion that anything digital can be easily faked seeps into the wider consciousness the better. Trust nothing.

I've seen some prank calls (a YouTuber cloned Tucker Carlson's voice and called Alex Jones) but he just had a sound bank with a few pre-generated lines and it fell apart pretty quickly. At least for now there's too much lag to do a real time conversation with a cloned voice. Speech to Text > LLM Response > Generate Audio If that time can shrink to subsecond, I think there'll be madness. (Specifically thinking of roma…

You don't need an LLM Response

Re: OpenVoice: Versatile Instant Voice Cloning

#188

Post by matheusmoreira »

japanman185 wrote: post #107
pclmulqdq wrote: post #92

Earlier quoted context omitted.

Looking at the website and the examples, it's pretty clearly set up to make stylized anime voices.

This is the driver for a lot of things. Anime. x264 was to enable better compression of weeb videos. This tech will allow fan dubs to better represent the animes in the videos.

Anime also drove the development of a lot of subtitling technology if I remember correctly.

Re: OpenVoice: Versatile Instant Voice Cloning

#189

Post by bryanrasmussen »

squigz wrote: post #125
RagnarD wrote: post #106

My first and ongoing thought is that immoral/criminal uses of voice cloning vastly exceed any legitimate ones.

Out of curiosity, what/how many legitimate use cases have you considered?

Potential legitimate uses I can think of -

1. licensing voice to other uses - people with recognizable trademarkable voices (actors, singers) have another potential revenue stream. yay!

2. use of past voices - voices that are not 'owned' from the past - let's say Humphrey Bogart's voice, can be used in projects without having to pay for imitator. This would be useful for both marketing and artistic projects. But probably less for marketing because they will want to go with step 1.

3. Teach yourself to talk like X. People who need to learn to talk like a particular person / have a particular accent could learn quicker. Just think - you will be able to supplement your comedy routine with kickass Christopher Walken impersonations any day now!

Variations of 3 and 2 together open up interesting modes of aesthetic impression, but I won't go into that here. But definitely I have some ideas that might benefit from being able to do this.

Re: OpenVoice: Versatile Instant Voice Cloning

#190

Post by abetusk »

DandyDev wrote: post #169
abetusk wrote: post #88

Earlier quoted context omitted.

By the commonly held definition of open, in the context of "open source", it is not open. > You can view, use and modify the code to your hearts content. The non-commercial clause of their license specifically prohibits commercial use, so we cannot use this source, and presumably the data that the source uses, to our hearts content. The OSI has a definition of open source that clearly states commercial use is require…

Where do they claim to be “open source”?

In their README in the GitHub repository as well as the paper. I opened an issue [0] and it looks like they've updated their README, at least, to reflect that it's not open source.

[0] https://github.com/myshell-ai/OpenVoice/issues/16

Post reply on HN