[deleted]
Lyrebird – An API to copy the voice of anyone
151–160 of 311 posts
Re: Lyrebird – An API to copy the voice of anyone
#152Earlier quoted context omitted.
Huh. That means that recordings of speeches/performances from concert halls are potentially suspicious. Know of any other instances of reverb covering things up? This is interesting!
I haven't worked extensively in voice adaptation, but I learned working in text-to-speech that adding a bit of reverb is quite effective at covering up artifacts. Something similar seems to be going on in live vocals. If you lack confidence in your own voice, adding a bit of reverb can make it sound much better. Not sure what's going on — whether the reverb jams the critical listening facilities in one's brain or som…
> Something similar seems to be going on in live vocals. If you lack confidence in your own voice, adding a bit of reverb can make it sound much better.
a.k.a. why your singing sounds way better in the shower.
Re: Lyrebird – An API to copy the voice of anyone
#153Combined with Face2Face[1] live video impersonation, it is truly time to be very careful verifying videos or even live streams. https://www.youtube.com/watch?v=ohmajJTcpNk
Awesome... Not sure if the voice thing can be done in realtime yet, but you're right... the combination of these two would be awesome
Re: Lyrebird – An API to copy the voice of anyone
#154I appreciate the ethics link up there in the menu. Not sure if I noticed it on any other AI startup (or for that matter, any startup). Given how complex the world is becoming due to ever increasing co-dependence with tech, I can see how such pages could become as important as 'pricing' or 'sign up' pages. (The privacy issues with Unroll.me, Uber and a thousand other such services will only accelerate this trend). Goo…
> but it will be good to read about YOUR ethics
Not just that, but ethical expectations on the users, backed up by legal policy, would seem important for this.
Re: Lyrebird – An API to copy the voice of anyone
#155Combined with Face2Face[1] live video impersonation, it is truly time to be very careful verifying videos or even live streams. https://www.youtube.com/watch?v=ohmajJTcpNk
Awesome... Not sure if the voice thing can be done in realtime yet, but you're right... the combination of these two would be awesome
Holy shit this is crazy!
Re: Lyrebird – An API to copy the voice of anyone
#156While all of these vec2speech type models are impressive, I get the feeling that most of the comments didn't listen to any of the samples. It's still distinctly robotic sounding, probably has quite a bit of garbage output that needs to be filtered manually (as many of these nets often have) and is a far cry from fooling a human.
I personally like this sample the most [0]. Note that these samples are not cherry-picked - having worked with very related algorithms [1] once it is trained well it pretty much "just works".
There is a lot of room for DSP/hacks/tricks to improve audio quality - just the same as in concatenative systems, but the point of this demo is to show what is possible with raw data + deep learning. Also note that this is (as far as I am aware) learned directly on real data such as youtube, or recordings + transcripts. That is quite a bit different than approaches which require commercial grade TTS databases, which are generally professional speakers with more than 10 hours of speech each, and cost a lot of money.
[0] https://soundcloud.com/user-535691776/special-guest-at-iclr
Re: Lyrebird – An API to copy the voice of anyone
#157Earlier quoted context omitted.
Forget dead husbands, with this tech, it will be hard to trust anything a politician said. Basically, once they master adding this to video, ANYTHING could be construed against anyone. Want a video of a politician saying "Hitler was right" to cheering masses? Want a video about a president saying it's time to start Nuclear War One? You can make that.
In the future: PGP signed speeches.
You joke, but I strongly suspect Authenticated Personal Trust is absolutely going to have become a thing.
Re: Lyrebird – An API to copy the voice of anyone
#158This is pretty cool (although, I have no idea what other technologies exist for this kind of thing), but it's definitely not convincing enough to a human listener. This sounds like it might be convincing enough for some programs like "Hey, Siri" but it's not gonna convince your mom. You can listen to the samples on the page linked here and you can immediately tell that Obama and Trump don't sound quite human.
It might become more convincing if audio engineers would edit the results to hide artifacts and make it sound more natural.
Devils advocate: the noise masks the distortion, which is the giveaway.
Re: Lyrebird – An API to copy the voice of anyone
#159It's there any copyright protections for a person's voice? If not, David Attenborough and Morgan Freeman will be lead voice actors in my next game project
If nothing else the source material you use would likely be recordings that others made, so you will not own the copyright on the source material and with how copyright works the synthesized recordings might be considered derivative works of the source material. IANAL, TINLA.
So if you are famous enough to have your voice seen as distinct, you are already screwed... interesting.
Re: Lyrebird – An API to copy the voice of anyone
#160This is pretty basic at the moment and it's terrifying. Yeah, it has an MS Sam feel to it, but as the tech improves and we know it will, you could use a service like this to put words in someone's mouth. Think about how you could trip up a CEO or a Politician by playing some random clip that they never said. When that gets into the Zeitgeist judgments will be made in the court of public opinion devoid of facts or rea…
I don't think the tech will improve fast. I've been watching speech synthesis since the 80s, and progress hasn't accelerated over that time.
Speech synthesis is one of those 90% problems - when you're 90% done, you find you only have 90% left to do.
This level of synthesis is relatively easy. Getting to the 'Can reliably pass for the real thing" level is going to take a huge amount of extra work.
It's not even about computational power - it's about the sophistication of the models, and their ability to parse words into phonemes correctly with some knowledge of social and linguistic context.
"Good enough for some applications" - like phone switchboard systems - is a simpler problem. Virtual impersonation is very much harder.