Live data from Hacker News

OpenAI Audio Models

openai.fm

131–140 of 317 posts

Re: OpenAI Audio Models

#131

If I'm reading the pricing correctly, these models are SIGNIFICANTLY cheaper than ElevenLabs. https://platform.openai.com/docs/pricing If these are the "gpt-4o-mini-tts" models, and if the pricing estimate of "$0.015 per minute" of audio is correct, then these prices 85% cheaper than those of ElevenLabs. https://elevenlabs.io/pricing With ElevenLabs, if I choose their most cost-effectuve "Business" plan for $1100 per…

Def prefer the pricing but so far on 4o, no timestamps or diarization sadly

Re: OpenAI Audio Models

#132
post #29

Earlier quoted context omitted.

Indeed. Right now I think our open choices are Piper, Kokoro and Orpheus.

In my opinion GPT-SoVITS is the best if you can put in the effort. I'm still using v2 since the output is so good. Its also the best multilingual one in my testing on Japanese inputs.

hadnt messed with that one before. my needs are more real time for voice assistant but was neat to play with on hugginface.

https://huggingface.co/spaces/lj1995/GPT-SoVITS-v2

Re: OpenAI Audio Models

#133
post #74

If I'm reading the pricing correctly, these models are SIGNIFICANTLY cheaper than ElevenLabs. https://platform.openai.com/docs/pricing If these are the "gpt-4o-mini-tts" models, and if the pricing estimate of "$0.015 per minute" of audio is correct, then these prices 85% cheaper than those of ElevenLabs. https://elevenlabs.io/pricing With ElevenLabs, if I choose their most cost-effectuve "Business" plan for $1100 per…

OpenAI doesn’t have voice cloning

You missed the story:

https://community.openai.com/t/chatgpt-unexpectedly-began-sp...

ChatGPT unexpectedly began speaking in a user’s cloned voice during testing

Re: OpenAI Audio Models

#134

If I'm reading the pricing correctly, these models are SIGNIFICANTLY cheaper than ElevenLabs. https://platform.openai.com/docs/pricing If these are the "gpt-4o-mini-tts" models, and if the pricing estimate of "$0.015 per minute" of audio is correct, then these prices 85% cheaper than those of ElevenLabs. https://elevenlabs.io/pricing With ElevenLabs, if I choose their most cost-effectuve "Business" plan for $1100 per…

Sesame is free and pretty good and you can run it yourself.

Re: OpenAI Audio Models

#135
post #37

Earlier quoted context omitted.

Are these models downloadable, like whisper? What’s the minimum hardware for running them? Would they run on a raspberry pi? Or a smartphone?

not open source at this time. unfortunately they're much to large to run on normal consumer hardware

with devices having unified memory now we are no longer limited to what can fit inside of a 3090 anymore. consumer hardware can have hundreds of gigabytes of memory now, is it really not able to fit in that?

Re: OpenAI Audio Models

#136

Hey, I'm Jeff and I was PM for these models at OpenAI. Today we launched three new state-of-the-art audio models. Two speech-to-text models—outperforming Whisper. A new TTS model—you can instruct it how to speak (try it on openai.fm!). And our Agents SDK now supports audio, making it easy to turn text agents into voice agents. We think you'll really like these models. Let me know if you have any questions here!

would really love to so the new whisper style speech to text model open sourced.

Re: OpenAI Audio Models

#137
post #65

If I'm reading the pricing correctly, these models are SIGNIFICANTLY cheaper than ElevenLabs. https://platform.openai.com/docs/pricing If these are the "gpt-4o-mini-tts" models, and if the pricing estimate of "$0.015 per minute" of audio is correct, then these prices 85% cheaper than those of ElevenLabs. https://elevenlabs.io/pricing With ElevenLabs, if I choose their most cost-effectuve "Business" plan for $1100 per…

ElevenLabs is incredibly over-priced and that's how they were able to achieve the MRR that led to their incredible fundraising. No matter what happens, they'll eventually be undercut and matched in terms of quality. It'll be a race to the bottom for them too. ElevenLabs is going to have a tough time. They've been way too expensive.

[deleted]

Re: OpenAI Audio Models

#138

Earlier quoted context omitted.

Any plans to directly support diarization or voiceprinting?

We're thinking about diarization (adding time awareness to GPT models) but no firm plans to share just yet

Jeff you know what would be magical? Not just vanilla diarization "Speaker 1" and "2" but if the model can know from the conversation this speaker was referred to as "Jeff Harris" or "Jeff" so it uses that instead.

Re: OpenAI Audio Models

#139

If I'm reading the pricing correctly, these models are SIGNIFICANTLY cheaper than ElevenLabs. https://platform.openai.com/docs/pricing If these are the "gpt-4o-mini-tts" models, and if the pricing estimate of "$0.015 per minute" of audio is correct, then these prices 85% cheaper than those of ElevenLabs. https://elevenlabs.io/pricing With ElevenLabs, if I choose their most cost-effectuve "Business" plan for $1100 per…

It's way cheaper - everyone is, elevenlabs is very expensive. Nobody matches their quality though. Especially if you want something that doesn't sound like a voice assistant/audiobook/podcast/news anchor/tv announcer.

This openai offering is very interesting, it offers valuable features elevenlabs doesn't in emotional control. It also hallucinates though which would need to be fixed for it to be very useful.

Re: OpenAI Audio Models

#140
post #121

Earlier quoted context omitted.

We're thinking about diarization (adding time awareness to GPT models) but no firm plans to share just yet

The feature I want is speaker differentiation - I want to feed in an audio file and get back a transcript with "Speaker 1: ..., Speaker 2: ..." indications. That plus timestamps would be incredible. The Google Gemini 2.0 models are showing some promise with this, I can't speak to their reliability just yet though.

I had good results with pyannote and the following model for that use case in the past https://huggingface.co/pyannote/speaker-diarization-3.1
Post reply on HN