Having met some of the people on there, this is uncannily accurate, especially in the High Quality voices. Well done!
Show HN: Neural text to speech with dozens of celebrity voices
51–60 of 174 posts
Re: Show HN: Neural text to speech with dozens of celebrity voices
#52I notice not a single young (or even younger) woman. Closest is Hilary Clinton? Is this on purpose or an oversight?
Re: Show HN: Neural text to speech with dozens of celebrity voices
#53Can you comment a bit on the tech on this? I tried something similar with songs: I wanted artists X to sing a song from artist Y. I cleaned the voices, the audios, but the transfe rjust didnt work. I didnt do any annotations on the text (it shouldnt be that hard since all lyrics are available), but if you could recommend a path or maybe an open source project I be grateful. Thanks and great work by the way!
Re: Show HN: Neural text to speech with dozens of celebrity voices
#54I definitely need this. Looks like I have to wait until you are off the front page of HN though.
I am a writer and found that the best editing comes when I am reviewing audio files of my books from voice talent. Of course, then it is way to late to change anything. With a tool like this I can revise as much as I want!
Re: Show HN: Neural text to speech with dozens of celebrity voices
#55Earlier quoted context omitted.
Check out Modulate.ai! We make real-time, emotive voice skins aimed at gaming voice chat. Audio watermarking is also built-in to prevent fraud. Currently in a closed alpha stage but if you're part of a game studio and have interest please reach out!
Minor point. Its nice when people write URL's so that we can just follow as opposed to requiring mouse interactions to cut and paste.
FYI in Firefox, just highlight and right click to select 'Open in new tab'.
Re: Show HN: Neural text to speech with dozens of celebrity voices
#56I skimmed your about, where you mention it as a hobby demo of your deep work. Do you have a GitHub or technical documentation about how you build this sort of thing to work at scale?
I can make a blog post later, but at a high level: A rust TTS server hosts two models: a mel inference model and a mel inversion model. The ones I'm using are glow-tts and melgan. They fit together back to back in a pipeline. I chose these models not for their fidelity, but for their performance. They're 10x faster at inference than Tacotron 2. If you want something that sounds amazing, you're better off with a dense…
This is incredibly cool. Do you mind sharing how big the models are, and what kind of instances you're deploying them on?
I ask because I help maintain an open source ML infra project ( https://github.com/cortexlabs/cortex ) and we've recently done a lot of work around autoscaling multi-model endpoints. Always curious to see how others are approaching this.
Re: Show HN: Neural text to speech with dozens of celebrity voices
#57I'd love to have an option for Majel Barrett
I was going to mention the same. It would be a childhood dream come true to talk to my computer and have it talk back to me in the TNG computer voice.
Re: Show HN: Neural text to speech with dozens of celebrity voices
#58Can you comment a bit on the tech on this? I tried something similar with songs: I wanted artists X to sing a song from artist Y. I cleaned the voices, the audios, but the transfe rjust didnt work. I didnt do any annotations on the text (it shouldnt be that hard since all lyrics are available), but if you could recommend a path or maybe an open source project I be grateful. Thanks and great work by the way!
Thanks!
There are a lot of neat research threads ongoing in terms of generating vocals.
Nvidia published Mellotron (code + paper + models), and the results are promising:
https://github.com/NVIDIA/mellotron
https://nv-adlr.github.io/Mellotron
The best results I've seen are from researcher Ryuichi Yamamoto (r9y9 on Github). He continually publishes astonishing results and novel architectures:
https://soundcloud.com/r9y9/sets/dnn-based-singing-voice
These results lead me to believe he's going to have a replacement for Vocaloid soon.
There's lots more stuff out there, and I can come back and edit my post later.
Some folks are getting good results by simply combining Tacotron with autotune:
- https://www.youtube.com/watch?v=3qR8I5zlMHs Mister Rogers sings Beautiful World (amazing, super charming, and shows the promise of this tech)
- https://www.youtube.com/watch?v=K1jrDgbRs9Q (Tupac, possibly NSFW lyrics)
- https://www.youtube.com/watch?v=QW16_W0K3qU (Tupac with various results, possibly NSFW)
There's a lot that gets posted to /r/VocalSynthesis and occasionally /r/MediaSynthesis
Re: Show HN: Neural text to speech with dozens of celebrity voices
#59I've built a lot of celebrity text to speech models and host them online: https://vo.codes It has celebrities like Sir David Attenborough and Arnold Schwarzenegger, a bunch of the presidents, and also some engineers: PG, Sam Altman, Peter Thiel, Mark Zuckerberg I'm not far away from a working "real time" [1] voice conversion (VC) system. This turns a source voice into a target voice. The most difficult part is gettin…
(These comments originally were in https://news.ycombinator.com/item?id=23965106 but I've moved them) We'll re-up that thread (see https://news.ycombinator.com/item?id=11662380 for how this works generally). I'm going to move this comment there as well because it includes more background info than you posted there.
Thanks, dang! :)
Re: Show HN: Neural text to speech with dozens of celebrity voices
#60Can you comment a bit on the tech on this? I tried something similar with songs: I wanted artists X to sing a song from artist Y. I cleaned the voices, the audios, but the transfe rjust didnt work. I didnt do any annotations on the text (it shouldnt be that hard since all lyrics are available), but if you could recommend a path or maybe an open source project I be grateful. Thanks and great work by the way!
Thanks! There are a lot of neat research threads ongoing in terms of generating vocals. Nvidia published Mellotron (code + paper + models), and the results are promising: https://github.com/NVIDIA/mellotron https://nv-adlr.github.io/Mellotron The best results I've seen are from researcher Ryuichi Yamamoto (r9y9 on Github). He continually publishes astonishing results and novel architectures: https://github.com/r9y9 h…
Thank you very much, I will look at them!