Live data from Hacker News

OpenVoice: Versatile Instant Voice Cloning

arxiv.org

101–110 of 207 posts

Re: OpenVoice: Versatile Instant Voice Cloning

#101

current leader in open source voice cloning is RVC, would like to see how it compares to it.

RVC is voice conversion (audio to audio), and it's typically finetuned.

This is zero shot TTS. Samples create vector encodings that serve as input to inference. There's no retraining the model unless you want it to generalize or perform better.

Re: OpenVoice: Versatile Instant Voice Cloning

#103

I had to phone my bank, which is one of the bigger players in the UK high street market, a couple of days ago. They're still encouraging me to enroll in their idiotic "my voice is my password" programme. At this stage in the evolution of AI, that feels simply negligent.

Investec? Yeah thinking I need to phone them to disable mine

Re: OpenVoice: Versatile Instant Voice Cloning

#104

Earlier quoted context omitted.

Thanks for the link to the repo. It's very useful. As for the checkpoint, I'm not allergic and I don't do security theater: https://github.com/myshell-ai/OpenVoice?tab=readme-ov-file#i... links to https://myshell-public-repo-hosting.s3.amazonaws.com/checkpo...

Why do you call that security theater? I found and provided the information, but didn’t make it clickable. Anyone can decide for themselves to navigate there. Your comment comes off as passive aggressive.

I think he's referring to your "defanging" which you implied was security related but doesn't actually achieve anything at all.

Re: OpenVoice: Versatile Instant Voice Cloning

#107
post #75

I commend the authors on making this easy to try! However it doesn't work very well for me for general voice cloning. I read the first paragraph of the wikipedia page on books and had it generate the next sentence. It's obviously computer generated to my ear. Audio sample: https://storage.googleapis.com/dalle-party/sample.mp3 Cloned voice (converted to mp3): https://storage.googleapis.com/dalle-party/output_en_defaul…

Looking at the website and the examples, it's pretty clearly set up to make stylized anime voices.

This is the driver for a lot of things. Anime. x264 was to enable better compression of weeb videos. This tech will allow fan dubs to better represent the animes in the videos.

Re: OpenVoice: Versatile Instant Voice Cloning

#108

That watermark detection rights at the end is real sus

At least right now, there is a literal add_watermark function, so probably easy enough to remove that surface level. Unless they added something cute to the training data to poison the well. https://github.com/myshell-ai/OpenVoice/blob/a33963c3d764bee...

[dead]

Re: OpenVoice: Versatile Instant Voice Cloning

#109
post #45

Earlier quoted context omitted.

Care to elaborate for someone lacking context?

You don't know what voice cloning is and what it can be used for? These people made it even easier to do. That's their achievement. Facilitating fraud, confusion and distrust.

> You don't know what voice cloning is and what it can be used for?

* Real-time translation of a user's voice, maintaining emotion and intonation

* Professional-quality audio from cheap microphone setups (for video tutorials, indie games, etc.)

* Allowing those with speech impairments to communicate using their natural voice again, or:

* Allowing those uncomfortable with their natural voice to communicate closer to how they wish to be perceived

* Customization of voice assistants, such as to use a native accent/dialect

* Movies, podcasts, audiobooks, news broadcasts, etc. made available in a huge range of languages

* And of course: memes, satire, and parody

I also think it opens the door for entirely new kinds of media, but it's hard to foresee exactly what will take off and what will die a gimmick. Maybe immersive-sims where characters can respond intelligently to anything you throw at them? Maybe personalized movies, like the ability to direct scenes yourself?

Re: OpenVoice: Versatile Instant Voice Cloning

#110
post #73

Earlier quoted context omitted.

> Auto non-toxic rephrasing of online chat in video games, let people hear their voice but paraphrase what they said in a manner that doesn't turn the platform into a cesspit. that feels very orwellian

George Orwell — 'If you want a picture of the future, imagine a boot stamping on a human face—for ever.' I think this is closer to the direction of Huxley in Brave New World, where a deeper understanding of how to manipulate without brute force creates a very different dystopian society than 1984.

"Don’t you see that the whole aim of Newspeak is to narrow the range of thought? In the end we shall make thoughtcrime literally impossible, because there will be no words in which to express it."
Post reply on HN