71–80 of 80 posts
Who is working on this problem, and how?
Earlier quoted context omitted.
> you can make anyone say anything as long as you have some previous recordings of their voice. That's not what this is doing. They're simply resynthesizing exactly what the person said, in the same voice. It's essentially cheating because they can use the real person's inflection. Generating correct inflection is the hardest part of speech synthesis because doing it perfectly requires a complete understanding of the…
Thank you for clarifying this! We tried fairly hard to make this clear, because as you say, the hard part is generating inflection and duration that sounds natural. There's still a ton of work left to do in this duration – we're clearly nowhere near being able to generate human-level speech. Our work is meant to make working with TTS easier to deep learning researchers by describing a complete and trainable system th…
Earlier quoted context omitted.
How much computing power does this take. When do you see open source implementations running on mobile devices offline?
We take several days (2-3) on 8 Titan X GPUs to train our models, which is quite a lot of compute. Running on mobile devices is quite challenging – the inference is not yet fast enough to support that, and has only been optimized for x86 AVX2 CPUs. It may be possible with a fair amount of future work!
> "We conclude that the main barrier to progress towards natural TTS lies with duration and fundamental frequency prediction, and our systems have not meaningfully progressed past the state of the art in that regard." Who is working on this problem, and how?
does anyone know of good ways to do the opposite, speech to text?
How soon before you make an API available? In other words, how do I make use of Deep Voice for my own applications?
Right now, we do not have plans to make an API available. This paper and blog post are mostly meant to describe our techniques to other deep learning researchers and spur innovation in the field. However, we hope that these techniques will be available eventually, and we'll provide more information when that happens.