Someone do data
Use deep fake tech to say stuff with your favorite characters
11–20 of 108 posts
Re: Use deep fake tech to say stuff with your favorite characters
#12It's worth mentioning that one similar site is 15.ai[1] [1] https://15.ai
Uberduck[0] has a great selection of voices
Re: Use deep fake tech to say stuff with your favorite characters
#13No Steve Jobs. Which got me thinking would they get sued by Apple if they had it?
Re: Use deep fake tech to say stuff with your favorite characters
#14[deleted]
Re: Use deep fake tech to say stuff with your favorite characters
#15My favorite deepfake is Sassy Justice by the South Park creators Trey Parker and Matt Stone: https://www.youtube.com/watch?v=9WfZuNceFDM
oh wow the ad breaks in this caught me off guard in the best way, thank you for sharing this!
Re: Use deep fake tech to say stuff with your favorite characters
#16This is really cool.
It could use some smoothing of the AI artifacts (no idea how you’d do that though). It’s like they’re talking over a broken mic.
Re: Use deep fake tech to say stuff with your favorite characters
#17This looks like it was previously known as Vocodes, made by echelon who is here on HN:
https://news.ycombinator.com/item?id=23965787
The code repos used are listed in their credits section, and it looks like a mixture of (customised?) Tacotron2, Glow-TTS, HifGan, and others. Videos are generated using Wav2Lip.
Text-To-Speech (TTS) has improved greatly over the past several years, but there's still a lot of metallic sounds in "pure" TTS implementations. I've started exploring voice style conversion, otherwise known as "voice cloning", and there are some interesting repos out there with decent results. These work differently from TTS, in that you don't type out the text to be spoken, but rather pass in an audio file of what you want the cloned speaker to say, and the system outputs an audio file with the same sounds (words, intonation) but with a different speaker identity.
This may be easier to get the right cadence and emotion in the generated audio, as text doesn't capture proper emotion and intonation. I suspect game character audio will use more of voice-style conversion instead of pure TTS simply to get the right emotional cadence of the lines being delivered.
Some interesting voice style conversion repos (in no order, just a random selection if anyone is interested in exploring):
https://github.com/yl4579/StarGANv2-VC
https://github.com/ebadawy/voice_conversion
https://github.com/RussellSB/tt-vae-gan
https://github.com/auspicious3000/autovc
https://github.com/edresson/yourtts
Papers With Code has interesting repos there as well: https://paperswithcode.com/task/voice-conversion/latest
Re: Use deep fake tech to say stuff with your favorite characters
#18It's worth mentioning that one similar site is 15.ai[1] [1] https://15.ai
That one has way less content but the quality is perfect.
Re: Use deep fake tech to say stuff with your favorite characters
#19Fictional characters, sure. Real people? That's crossing a line. I believe I own myself, and manipulating my face and voice to say what I did not and never would say is a misuse of my property. I can't fully justify that belief, but I would certainly be enraged beyond reason to see a representation of my principled father speaking against his values.
Re: Use deep fake tech to say stuff with your favorite characters
#20I have a sudden urge to want to deep fake Steven Hawking's voice. I wonder both how the deep fake tech would handle Stephen Hawking as an input, and I'm just realizing that he just missed the survival threshold for being able to use this tech.