Lyebird: Clone Your Voice • Hacker News Board

Re: Lyebird: Clone Your Voice

#11

Post by prophesi » Wed, Sep 09, 2020, 7:12 PM UTC

happycry wrote: post #7

prophesi wrote: post #2

Before Lyrebird was bought by Descript, this was a simple API endpoint. You could generate short MP3's of your digital voice reading any text of your choosing, for free. I used it extensively in one of my projects, only to find everything broken after leaving it alone for a few months. All of that to say, are there any alternatives out there HN knows of? This isn't an attack on Descript, either. The Lyrebird purchase…

Hey, founder of Resemble ( https://resemble.ai ) here. We're building a custom voice cloning service with APIs and controllability. Shoot me a message if you want to build a voice from raw MP3s.

Wow, this is perfect! It even has a Unity plugin. I'll certainly give Resemble a whirl.

Re: Lyebird: Clone Your Voice

#12

Post by russfink » Wed, Sep 09, 2020, 7:13 PM UTC

shannifin wrote: post #5

I have not yet had any serious use cases with this tech, but I've enjoyed playing around with it and I love its possibilities. (A while back, as an experiment, I recorded samples with a variety of silly character voices and fake accents; when the end result merged them into one, it sounded hilarious.)

Robocalling, with some interactivity. "Hello! This is Camp Ayne running for city council. How are your kids Doris and Eugene?"

Re: Lyebird: Clone Your Voice

#13

Post by summitsummit » Wed, Sep 09, 2020, 7:16 PM UTC

netsec_burn wrote: post #4

The live demo is incredible. I've never heard TTS sound so realistic, when did it get this good?

agreed. it is surprisingly exceptionally good at profanities and vulgar languages.

Re: Lyebird: Clone Your Voice

#14

Post by echelon » Wed, Sep 09, 2020, 7:17 PM UTC

Show HN:

I made https://vo.codes as a side project to democratize text to speech. It's got lots of celebrities, politicians, cartoon characters, and tech figures (Paul Graham, Sam Altman, Mark Zuckerberg, et al)

Kids on YouTube found it and are making incredible music videos with it.

Homer Simpson and SpongeBob cover Money Machine: https://youtu.be/iBpqJF5LXX4

SpongeBob covers WAP (NSFW!) : https://youtu.be/dSgd4PoQofQ

SpongeBob covers 6IX9INE : https://youtu.be/IKs5iWVRE94

I'm planning to do the same thing as these folks after I finish my real time voice conversion system. It's a killer app for Discord and TeamSpeak - you can talk in real time as Gilbert Gottfried, SpongeBob, or Donald Trump.

Re: Lyebird: Clone Your Voice

#15

Post by coupdejarnac » Wed, Sep 09, 2020, 7:17 PM UTC

shannifin wrote: post #5

I have not yet had any serious use cases with this tech, but I've enjoyed playing around with it and I love its possibilities. (A while back, as an experiment, I recorded samples with a variety of silly character voices and fake accents; when the end result merged them into one, it sounded hilarious.)

I'll use this to dub over videos I'm making.

Re: Lyebird: Clone Your Voice

#16

Post by cblconfederate » Wed, Sep 09, 2020, 7:19 PM UTC

I wonder who will make somethingn like this a downloadable, locally executable program.

Re: Lyebird: Clone Your Voice

#17

Post by kundan2510 » Wed, Sep 09, 2020, 7:24 PM UTC

prophesi wrote: post #2

Before Lyrebird was bought by Descript, this was a simple API endpoint. You could generate short MP3's of your digital voice reading any text of your choosing, for free. I used it extensively in one of my projects, only to find everything broken after leaving it alone for a few months. All of that to say, are there any alternatives out there HN knows of? This isn't an attack on Descript, either. The Lyrebird purchase…

Hey! Lyrebird founder here! The simple API endpoint is work in progress. Please fill this form to get an early access: https://descript.typeform.com/to/Phn5zATR

Re: Lyebird: Clone Your Voice

#18

Post by ValentineC » Wed, Sep 09, 2020, 7:24 PM UTC

echelon wrote: post #14

Show HN: I made https://vo.codes as a side project to democratize text to speech. It's got lots of celebrities, politicians, cartoon characters, and tech figures (Paul Graham, Sam Altman, Mark Zuckerberg, et al) Kids on YouTube found it and are making incredible music videos with it. Homer Simpson and SpongeBob cover Money Machine: https://youtu.be/iBpqJF5LXX4 SpongeBob covers WAP (NSFW!) : https://youtu.be/dSgd4PoQo…

Neat stuff!

What would it take to get Morgan Freeman's voice onto it?

Re: Lyebird: Clone Your Voice

#19

Post by echelon » Wed, Sep 09, 2020, 7:27 PM UTC

ValentineC wrote: post #18

echelon wrote: post #14

Show HN: I made https://vo.codes as a side project to democratize text to speech. It's got lots of celebrities, politicians, cartoon characters, and tech figures (Paul Graham, Sam Altman, Mark Zuckerberg, et al) Kids on YouTube found it and are making incredible music videos with it. Homer Simpson and SpongeBob cover Money Machine: https://youtu.be/iBpqJF5LXX4 SpongeBob covers WAP (NSFW!) : https://youtu.be/dSgd4PoQo…

Neat stuff! What would it take to get Morgan Freeman's voice onto it?

Thanks!

I made one attempt at Morgan Freeman but I didn't have enough sample data. He narrated a few audio books, but they've either got background music that ruins the training or he collaborated with other speakers.

What data I gathered I obtained from interviews on YouTube. Unfortunately they're all so short that it's a lot of work to extract meaningful training data.

I really want his voice. I'll definitely get back to it.

Re: Lyebird: Clone Your Voice

#20

Post by kundan2510 » Wed, Sep 09, 2020, 7:29 PM UTC

We just launched a bunch of built-in stock voices as well: this is how they sound: https://twitter.com/andrewmason/status/1303384858249494529?s...

All these voices have been created via our voice cloning pipeline. Something to note: the generated audio is 44.1kHz and super crisp, ready to be useful for voice-overs or editorial corrections. Let me know if you have any questions about the tech. (I am one of the lyrebird founders.)