Show HN: Neural text to speech with dozens of celebrity voices
1–10 of 174 posts
Re: Show HN: Neural text to speech with dozens of celebrity voices
#2I've built a lot of celebrity text to speech models and host them online:
It has celebrities like Sir David Attenborough and Arnold Schwarzenegger, a bunch of the presidents, and also some engineers: PG, Sam Altman, Peter Thiel, Mark Zuckerberg
I'm not far away from a working "real time" [1] voice conversion (VC) system. This turns a source voice into a target voice. The most difficult part is getting it to generalize to new, unheard speakers. I haven't recorded my progress recently, but here are some old rudimentary results that make my voice sound slightly like Trump [2]. If you know what my voice sounds like and you kind of squint at it a little, the results are pretty neat. I'll try to publish newer stuff soon, and that all sounds much better.
I was just about to submit all of this to HN (on "new").
Edit: well, my post [3] didn't make it (it fell to the second page of new). But I'll be happy to answer questions here.
[1] It has about ~1500ms of lag, but I think it can be improved.
[2] https://drive.google.com/file/d/1vgnq09YjX6pYwf4ubFYHukDafxP...
[3] I'm only linking this because it failed to reach popularity. https://news.ycombinator.com/item?id=23965787
Re: Show HN: Neural text to speech with dozens of celebrity voices
#3I skimmed your about, where you mention it as a hobby demo of your deep work.
Do you have a GitHub or technical documentation about how you build this sort of thing to work at scale?
Re: Show HN: Neural text to speech with dozens of celebrity voices
#4really impressed by this.
Re: Show HN: Neural text to speech with dozens of celebrity voices
#5Looks awesome, but haven't been able to get a result back yet. I think you may be getting hugged to death :)
Re: Show HN: Neural text to speech with dozens of celebrity voices
#6[deleted]
Re: Show HN: Neural text to speech with dozens of celebrity voices
#7That's super cool.
I am worried about the potential abuse of this service, are there any existing services that can help to identify audio deep fakes like this one is for making them?
Found Resemblyzer: https://github.com/resemble-ai/Resemblyzer
Re: Show HN: Neural text to speech with dozens of celebrity voices
#8This is my pandemic side project, and I'll be happy to answer any questions about it.
Re: Show HN: Neural text to speech with dozens of celebrity voices
#9I was wondering, wouldn't it be possible to classify the voice of every celebrity based on moods so one could make the voices less monotonic? So one could then add text metadata for the text-to-speech conversion, e.g. "[Angry] I have a dream, [Calm] but it has a patent so you can't copy it! (laughter) [Calm-fade-to-angry] In reality insomnia took it from me!"
Re: Show HN: Neural text to speech with dozens of celebrity voices
#10Looks awesome, but haven't been able to get a result back yet. I think you may be getting hugged to death :)
That's odd. I'm testing it right now and it's working. Which voices are you trying, and which device and browser are you using?