Earlier quoted context omitted.
Your friend can take a look at solutions from Acapela [0], SpeakUnique [1] or VOCALiD [2]. Not sure whether they have a solution for Android though. I recently saw a video from google about a custom voice they created for somebody with ALS but I can't seem to find it online (Does anybody have a link?). Creating custom voices is not yet available on Android though. The latest iOS release (iOS 17) does support creating…
Hi and thanks for the suggestions. Looking through them, it looks like you need to do what they call "voice banking" before you lose your voice. Basically reading a script they provide. Unfortunately my friend's voice is too far gone for that to be possible. Hoping for something where they can use old recordings to generate a voice.
OpenVoice: Versatile Instant Voice Cloning
151–160 of 207 posts
Re: OpenVoice: Versatile Instant Voice Cloning
#152Earlier quoted context omitted.
Your friend can take a look at solutions from Acapela [0], SpeakUnique [1] or VOCALiD [2]. Not sure whether they have a solution for Android though. I recently saw a video from google about a custom voice they created for somebody with ALS but I can't seem to find it online (Does anybody have a link?). Creating custom voices is not yet available on Android though. The latest iOS release (iOS 17) does support creating…
Hi and thanks for the suggestions. Looking through them, it looks like you need to do what they call "voice banking" before you lose your voice. Basically reading a script they provide. Unfortunately my friend's voice is too far gone for that to be possible. Hoping for something where they can use old recordings to generate a voice.
Some of the recent transformer models can work with audio clips just a few seconds long. I'm sure the final output is less good, but perhaps your friend has audio clips that would work for that from e.g. home movies.
Re: OpenVoice: Versatile Instant Voice Cloning
#153My first and ongoing thought is that immoral/criminal uses of voice cloning vastly exceed any legitimate ones.
My first thought is anonymity. I can make YouTube videos without needing to use my real voice... while being able to keep my personal inflections and emphasis, something TTS (AI) voices can't do. Or...! Indie game development. I can learn basic voice acting (to get rid of the cringe), and act out all of my characters using different voices.
The indie game development and animated short content are the primary uses for this type of NN for me. I’m working (not very successfully) at putting together a single source voice — to many result voice ‘style transfer’ solution using standard PyTorch components. Realistically I can pay for the target sample voice to record some amount of varied vocal performance and then hopefully if the net is trained specifically on my voice as the source the hope is the transfer can capture the ‘performance’ qualities in my original.
And in case anyone is concerned, I intend to make the purpose of the vocal samples clear to the provider and then arrange appropriate credit and compensation to those whose voices I used. I also don’t intend to train with anything but public domain and purchased data.
Re: OpenVoice: Versatile Instant Voice Cloning
#154Now of only youtube would ban the use of this crap. Or at the very least allow you filter those videos.
Re: OpenVoice: Versatile Instant Voice Cloning
#155Earlier quoted context omitted.
It is open, just not by your definition. You can view, use and modify the code to your hearts content. Sounds pretty open to me!
By the commonly held definition of open, in the context of "open source", it is not open. > You can view, use and modify the code to your hearts content. The non-commercial clause of their license specifically prohibits commercial use, so we cannot use this source, and presumably the data that the source uses, to our hearts content. The OSI has a definition of open source that clearly states commercial use is require…
> commonly held definition of open, in the context of "open source", it is not open
While this is very true, the context of "open source" can't be assumed.
Re: OpenVoice: Versatile Instant Voice Cloning
#156Welcome to the new era of fakes and scams beyond our wildest imagination !
Maybe this will teach people to rise up awareness and take personal security serious. Like not to trust anyone who is calling, especially from legacy line. Phone number and voice could be easily cloned.
The problem is that it's not just personal security, and it requires significant expertise / research to identify.
Re: OpenVoice: Versatile Instant Voice Cloning
#157Earlier quoted context omitted.
I don't know if GDPR (or any of its cousins) applies to you, but this kind of thing sounds exactly like the sort of thing it's supposed to outlaw.
How? Your bank stores personal data covered by gdpr but enabling crappy secure systems is not the domain of gdpr. Most likely this is caused by SCA another European directive that ruined our lives with extra security hoops (for payment providers) for little extra security - or even worse in case of voice password or security questions
Sadly, the US, where I currently live, is quite behind in this. Considering going expat (not for this specific reason, but it doesn't help); any expats have recommendations of what countries have worked well for them?
Re: OpenVoice: Versatile Instant Voice Cloning
#158If I wanted to do voice cloning on my own hardware can anyone suggest what a good open source project would be to use? What is the state of the art in open source voice cloning?
Re: OpenVoice: Versatile Instant Voice Cloning
#159My first and ongoing thought is that immoral/criminal uses of voice cloning vastly exceed any legitimate ones.
Out of curiosity, what/how many legitimate use cases have you considered?
A legitimate use, in the abstract, is one where a particular individual is willing to have their voice used to say X. The entertainment industry - movies and games - are likely to want this.
But if it's trivial to use somebody's voice to say any arbitrary thing, then it'll be done. Combined with deepfake videos, the result will be the ability to show anyone saying anything, including lies and things they find incredibly objectionable, in a disturbingly realistic way, and more so as time wears on.
The fundamental issue is that we don't live in a rights-respecting world. Making it easy to utter anything in the voice of anyone will lead to many more abuses than legitimate instances.
Re: OpenVoice: Versatile Instant Voice Cloning
#160If I wanted to do voice cloning on my own hardware can anyone suggest what a good open source project would be to use? What is the state of the art in open source voice cloning?
I use Tortoise TTS. It's slow, a little clunky, and sometimes the output gets downright weird. But it's the best quality-oriented TTS I've found that I can run locally.
It's allegedly the basis of the tech used by Eleven Labs.