Can someone give me a practical use case where this adds a net benefit to society?
You would be able to translate media into the language of your choice, but also retaining the original voices.
OpenVoice: Versatile Instant Voice Cloning
131–140 of 207 posts
Re: OpenVoice: Versatile Instant Voice Cloning
#132Earlier quoted context omitted.
How? Your bank stores personal data covered by gdpr but enabling crappy secure systems is not the domain of gdpr. Most likely this is caused by SCA another European directive that ruined our lives with extra security hoops (for payment providers) for little extra security - or even worse in case of voice password or security questions
A person's voice is, I believe, personal data. > Processing personal data is generally prohibited, unless it is expressly allowed by law, or the data subject has consented to the processing - https://gdpr-info.eu/issues/consent/
Importantly, you can also revoke consent at any time under the GDPR. Unlimited consent isn't possible, so the bank would have to make the (dubious) claim that such processing did not require permission at all.
Re: OpenVoice: Versatile Instant Voice Cloning
#133Is it possible to use this (or Eleven Labs) to generate a voice model to plug into an Android phone's TTS? I have a friend with a paralysed larynx who is often using his phone or a small laptop to type in order to communicate. I know he would love it if it was possible to take old recordings of him speaking and use that to give him back "his" voice, at least in some small measure.
That would be awesome
Re: OpenVoice: Versatile Instant Voice Cloning
#134Overall, will this be a good thing or a bad thing for society, do you think?
If it is a bad thing, should we cheer it on?
Re: OpenVoice: Versatile Instant Voice Cloning
#135current leader in open source voice cloning is RVC, would like to see how it compares to it.
RVC is voice conversion (audio to audio), and it's typically finetuned. This is zero shot TTS. Samples create vector encodings that serve as input to inference. There's no retraining the model unless you want it to generalize or perform better.
It isn't though, people need to read the paper and the comments from the author they aren't actually doing the voice generation they pass the text off to VITS, and then they're sauce is that they are doing tone mapping on that VITS output, so if anything they're a competitor to RVC, it's just that the version they published includes VITS also
Re: OpenVoice: Versatile Instant Voice Cloning
#136Can someone give me a practical use case where this adds a net benefit to society?
Imagine being able to handle translations live and hearing the persons voice translated as if they were speaking to you in your native language with their own voice is a big one
Re: OpenVoice: Versatile Instant Voice Cloning
#137Is it possible to use this (or Eleven Labs) to generate a voice model to plug into an Android phone's TTS? I have a friend with a paralysed larynx who is often using his phone or a small laptop to type in order to communicate. I know he would love it if it was possible to take old recordings of him speaking and use that to give him back "his" voice, at least in some small measure.
Your friend can take a look at solutions from Acapela [0], SpeakUnique [1] or VOCALiD [2]. Not sure whether they have a solution for Android though.
I recently saw a video from google about a custom voice they created for somebody with ALS but I can't seem to find it online (Does anybody have a link?). Creating custom voices is not yet available on Android though. The latest iOS release (iOS 17) does support creating personalized voices.
ModelTalker [3] is a long-term (research?) project to create custom voices for people with speech disabilities. Their TTS seem to support Android so that might be another option.
[0] https://www.acapela-group.com/ [1] https://www.speakunique.co.uk/ [2] https://vocalid.ai/ [3] https://www.modeltalker.org/
Re: OpenVoice: Versatile Instant Voice Cloning
#138Overall, will this be a good thing or a bad thing for society, do you think? If it is a bad thing, should we cheer it on?
[deleted]
Re: OpenVoice: Versatile Instant Voice Cloning
#139Earlier quoted context omitted.
Real time translation in the speakers own voice.
This is an exceptional use case! Mr Beast talked about translating his videos to other languages to get more reach. This can be done for people with limited budget or just in general so people can watch videos without needing subtitles. I wouldn't be surprised if we saw this incorporated into YT in the near future.
Another really good one would be for RPGs. Instead of clumsy approaches like "Hey Dragonborn" and whatnot, they could actually say your character's name out loud.
Re: OpenVoice: Versatile Instant Voice Cloning
#140Earlier quoted context omitted.
They are making you think about what you are doing before you click the link. that’s not theatre that’s keeping people from clicking arbitrary links to zip files which can auto-execute code once downloaded. I’d suggest that those who think it is theatre probably don’t understand the implications of that action.
We understand exactly the implications of that action. There are no implications. Simply downloading a zip from Amazon has zero risk. Even opening an arbitrary zip has essentially zero risk. RCE from opening a zip is obviously a really critical and valuable vulnerability and would not be wasted with a public link. Combine that with the fact that this comes from a voice cloning GitHub repo and the chance of this havin…
I'll be honest. You've put way more thought into this then I did.
But in the spirit of hacker news, I'll continue the argument.
> There are no implications.
Untrue and absolutist.
> Simply downloading a zip from Amazon has zero risk.
Agreed.
> Even opening an arbitrary zip has essentially zero risk. RCE from opening a zip is obviously a really critical and valuable vulnerability and would not be wasted with a public link.
Broadly agreed. History is full of unzip vulns, but I agree that this doesn't seem likely. Much easier to persuade folks to deliberately run their malware by using the latest fad as a hook. I'm not claiming that happened here.
> Combine that with the fact that this comes from a voice cloning GitHub repo and the chance of this having some 0-day are infinitesimal.
Maybe you know these authors and this repo and trust them. I don't. I'm sure they are lovely, I have no idea, I've done no research, and I've never heard of them before. That being said, if I wanted to distribute a backdoor or cryptominer to a bunch of people with powerful computers, I'd definitely hop on the AI bandwagon.
> Finally just making the link non-clickable does not add security.
I disagree. Some of the commenters here are rather savvy and will properly evaluate what they are downloading. Some are not. Making a link unclickable will prevent a percentage of people from downloading. If shenanigans are discovered, someone will make a very loud comment warning folks to avoid the download. In that case some of those non-downloaders may have been saved from themselves.
Again, this wasn't a well thought out decision, but it was also a rather low impact decision, and I stand by it.