Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI Audio Models

openai.fm

Post reply on HN
Print view View original

301–310 of 317 posts

Re: OpenAI Audio Models

#301

Post by simonpure »

maest wrote: post #222
MrAssisted wrote: post #143

Earlier quoted context omitted.

For my last video I used https://github.com/warmshao/FasterLivePortrait with a png of the character on my RTX 3090 desktop and recorded the output of that real-time but in the next video I'm going to spin up a runpod instance and do the FasterLivePortrait in the cloud after the fact because then I can get a smooth 60fps which looks better. I think the only real-time cloud way to do AI vtubing in the cloud is my own G…

Do you mind sharing your yt account? If you are okay with linking it to your hn account. I'd quite like to see the results.

I was curious as well.

Not OP but via their website linked in their profile -

https://youtu.be/Tl3pGTYEd2I

Re: OpenAI Audio Models

#303

Post by setsewerd »

dockerd wrote: post #258
setsewerd wrote: post #170

Earlier quoted context omitted.

Any plans to make a Chrome extension variant? Been looking for a high quality and cheap TTS extension for ages (like ElevenLabs Human Reader, except with less absurd pricing)

What is your use-case here?

Primarily for reading articles aloud online. I've been trying the latest Siri TTS which is a big improvement (and free), but it's still nowhere near accurate enough for proper nouns or newer terms, which ElevenLabs handles much better.

Re: OpenAI Audio Models

#304

Post by internet101010 »

huijzer wrote: post #165
benjismith wrote: post #49

If I'm reading the pricing correctly, these models are SIGNIFICANTLY cheaper than ElevenLabs. https://platform.openai.com/docs/pricing If these are the "gpt-4o-mini-tts" models, and if the pricing estimate of "$0.015 per minute" of audio is correct, then these prices 85% cheaper than those of ElevenLabs. https://elevenlabs.io/pricing With ElevenLabs, if I choose their most cost-effectuve "Business" plan for $1100 per…

Yes ElevenLabs is orders of magnitude more expensive than everyone else. Very clever from a business perspective, I think. They are (were?) the best so know that people will pay a premium for that.

Yeah the way I see it this is where we find the value of customization. We are already seeing its use by YouTube video essay creators who turn their own voice into models. I want to see corporate executives get on board so that we can finally ditch the god awful phone quality in earnings calls.

Re: OpenAI Audio Models

#305

Post by whimsicalism »

kuprel wrote: post #152
whimsicalism wrote: post #134

Earlier quoted context omitted.

Sesame is free and pretty good and you can run it yourself.

They released a crippled model: https://github.com/SesameAILabs/csm/issues/63

admittedly i only tested it for a few queries, but it worked fine for me except for lack of consistency in voice

Re: OpenAI Audio Models

#306

Post by asah »

furyofantares wrote: post #139
benjismith wrote: post #49

If I'm reading the pricing correctly, these models are SIGNIFICANTLY cheaper than ElevenLabs. https://platform.openai.com/docs/pricing If these are the "gpt-4o-mini-tts" models, and if the pricing estimate of "$0.015 per minute" of audio is correct, then these prices 85% cheaper than those of ElevenLabs. https://elevenlabs.io/pricing With ElevenLabs, if I choose their most cost-effectuve "Business" plan for $1100 per…

It's way cheaper - everyone is, elevenlabs is very expensive. Nobody matches their quality though. Especially if you want something that doesn't sound like a voice assistant/audiobook/podcast/news anchor/tv announcer. This openai offering is very interesting, it offers valuable features elevenlabs doesn't in emotional control. It also hallucinates though which would need to be fixed for it to be very useful.

haha, yeah this combo was pretty hilarious and highly inconsistent from reading to reading: https://www.openai.fm/#b2a4c1ca-b15a-44eb-9cd9-377f0e47e5a6

Re: OpenAI Audio Models

#307

Post by satvikpendem »

sandspar wrote: post #198
Foreignborn wrote: post #183

Earlier quoted context omitted.

thanks for this, it sounds pretty good. link for anyone else: https://canopylabs.ai/model-releases

These voices are all annoying, though. The thing about Sesame's Miles is that he's cool.

You can clone any voice you want with Orpheus.

Re: OpenAI Audio Models

#308

Post by ashvardanian »

camillomiller wrote: post #267
furyofantares wrote: post #139

Earlier quoted context omitted.

It's way cheaper - everyone is, elevenlabs is very expensive. Nobody matches their quality though. Especially if you want something that doesn't sound like a voice assistant/audiobook/podcast/news anchor/tv announcer. This openai offering is very interesting, it offers valuable features elevenlabs doesn't in emotional control. It also hallucinates though which would need to be fixed for it to be very useful.

It's cheap because everything OpenAI does is subsidized by investors' money. Until that stupid money flows all good! Then either they'll go the way of WeWork, or enshittification will happen to make it possible for them to make the books work. I don't see any other option. Unless Softbank decides it has some 150 Billion to squander on buying them off. There's a lot of head-in-the-sand behavior going on around OpenAI…

To be fair, ElevenLabs has raised of the order of $300M of VC money as well.

Re: OpenAI Audio Models

#310

Post by d4rkp4ttern »

d4rkp4ttern wrote: post #279
crazygringo wrote: post #75

This is astonishing. I can type anything I want into the "vibe" box and it does it for the given text. Accents, attitudes, personality types... I'm amazed. The level of intelligent "prosody" here -- the rhythm and intonation, the pauses and personality -- I wasn't expecting anything like this so soon. This is truly remarkable. It understands both the text and the prompt for how the speaker should sound. Like, we're g…

Didn’t look closely, but is there a way to clone a voice from a few seconds of recording and then feed the sample to generate the text in the same voice?

Apparently Orpheus also has voice cloning.
Post reply on HN