Live data from Hacker News

Lyrebird – An API to copy the voice of anyone

lyrebird.ai

231–240 of 311 posts

Re: Lyrebird – An API to copy the voice of anyone

#231
post #202

1. Is this company new? 2. Is this better then what Google or Baidu are doing? 3. I remember reading Adobe has something similar. 4. Why ( What happened ) that all of a sudden we have 4 company making voice breakthrough tech like these? 5. What Happen to Voice Acting? Places like Japan where they highly value voice actor. Is Voice even patentable?

Specially to point 4, google pushed their wavenet paper a couple months ago. I wouldn't be surprised if some, if not all of these current break throughs are built on that foundation. This sort of application was the first thing that came to my mind after reading the paper.

https://deepmind.com/blog/wavenet-generative-model-raw-audio...

Re: Lyrebird – An API to copy the voice of anyone

#233
post #202

1. Is this company new? 2. Is this better then what Google or Baidu are doing? 3. I remember reading Adobe has something similar. 4. Why ( What happened ) that all of a sudden we have 4 company making voice breakthrough tech like these? 5. What Happen to Voice Acting? Places like Japan where they highly value voice actor. Is Voice even patentable?

> 5. What Happen to Voice Acting? Places like Japan where they highly value voice actor. Is Voice even patentable?

I don't think this tech knows how to act. However, it could be used to increase the range of a voice actor.

Re: Lyrebird – An API to copy the voice of anyone

#235
post #202

1. Is this company new? 2. Is this better then what Google or Baidu are doing? 3. I remember reading Adobe has something similar. 4. Why ( What happened ) that all of a sudden we have 4 company making voice breakthrough tech like these? 5. What Happen to Voice Acting? Places like Japan where they highly value voice actor. Is Voice even patentable?

Specially to point 4, google pushed their wavenet paper a couple months ago. I wouldn't be surprised if some, if not all of these current break throughs are built on that foundation. This sort of application was the first thing that came to my mind after reading the paper. https://deepmind.com/blog/wavenet-generative-model-raw-audio...

There is an older paper [0] and demo from [1] Alex Graves that inspired a ton of work around handwriting, and then speech. Previous work from Jose Sotelo et. al. (including me) called char2wav [2] is a close neighbor to Graves' approach, though he (Graves) never published the approach for speech so we don't really know. Google's recent Tacotron paper [3] is also a relative to these approaches.

WaveNet certainly changed the game in many ways, but approaches to TTS using RNNs have different roots. WaveNet and friends (incl. DeepVoice and NPSS linked elsewhere in this thread) are largely focused on audio modeling, and generally use something closely related to the "classic" TTS pipeline for text in the frontend. The audio modeling results are stellar, and really blew me away personally - basically changing my perspective on what is possible in audio modeling overnight.

RNN models try to tackle the whole problem (text + audio modeling) at once, though currently (all?) RNN and attention style models need intermediate / high level hints or pretraining from things like vocoder representations or spectrograms, versus WaveNet's approach using the waveform directly. So they are complimentary in many ways, and I am sure we will see people trying to combine them soon - char2wav has this flavor by using SampleRNN, our lab's take on raw waveform generation though we are still working on the fully end-to-end from scratch training, the inference path is truly end-to-end. Though there are still many details to work out as far as output quality, it seems possible that this will be a productive approach (though I am quite biased).

We see similar directions in neural machine translation (NMT) moving from word level representations to word parts or characters directly - one of the big reasons deep learning has come so far, so fast is that a lot of techniques from other subfields can be utilized for new domains, and I think there is a lot more fertile ground for crossover in both directions.

Heiga Zen has a great overview talk about how speech synthesis, as a field, overlaps between different approaches and factorizations [4]. His work on parametric synthesis and TTS generally has laid the foundation for a lot of recent advances, and he was also a co-author on WaveNet!

[0] https://arxiv.org/abs/1308.0850

[1] https://www.youtube.com/watch?v=-yX1SYeDHbg&t=38m0s

[2] http://josesotelo.com/speechsynthesis/

[3] https://google.github.io/tacotron/

[4] https://www.youtube.com/watch?v=nsrSrYtKkT8

Re: Lyrebird – An API to copy the voice of anyone

#238

It sounds like they're training a parametric speech synthesis platform on samples in order to learn the parameters. I wonder if there are are approaches at generating n-phones for concatenative models, or using a hybrid approach. I built a toy concatenative Donald Trump speech system [1], but I don't have an ML background. I've been taking Andrew Ng's online course in addition to Udacity's deep learning program in an…

I tried similar approaches long ago (~2 years now?) with something related to RNN-RBM and it showed some slight glimmer of promise, and still think there might be some clever ways to combine concatenative methods and deep learning to avoid a lot of the noise issues present in parametric models. Then again, maybe it just needs to train longer - it's always hard to tell. I liked jungle.horse, awesome stuff!

Re: Lyrebird – An API to copy the voice of anyone

#239

Earlier quoted context omitted.

I wouldn't be comfortable watching a movie scene if I knew I was looking at computer-generated faces and voices.

Are you comfortable with Auto-Tune in music, not the t-pain / etc exaggerated style... the nearly universal application of Auto-Tune to recording and live performance to ensure a "consistent product", and "save on expensive studio time"? Because the market appears to have spoken on that one and it said "meh, I don't care" with an solid shrug of indifference. By the same logic, one can see artificially produced vocal…

Japan, as usual, is ahead of the game here! [0]

[0] https://www.youtube.com/watch?v=pEaBqiLeCu0

Re: Lyrebird – An API to copy the voice of anyone

#240

I love this. The business model is too good to be true. 1. Open source voice-copying software 2. At worst, create entire market of voice-fraudsters, at best, very few voice-fraudsters but very high and very real perception of fear of such 3. Become leading security experts in voice fraud detection 4. Sell software / time / services to intelligence agencies, governments, law enforcement, news networks Ethically I'm a…

Modern day broken window machine?

http://www.investopedia.com/ask/answers/08/broken-window-fal...

Post reply on HN