>Browser not supported >Please open openai.fm directly in a modern browser Doesn't seem to like firefox
Dittos.
OpenAI Audio Models
311–317 of 317 posts
Re: OpenAI Audio Models
#312Earlier quoted context omitted.
They said themselves that even inference is losing them money tho, or did I get that wrong?
On their subscriptions, specifically the pro subscription, because it's a flatrate to their most expensive model. The API prices are all much more expensive. It's unclear whether they're losing money on the normal subscriptions, but if so, probably not by much. Though it's definitely closer to what you described, subsidizing it to gain 'mindshare' or whatever.
they for sure lose money on some months for some customers, but I expect globally most of subscriptions (including mine that I recently cancelled) would be much better of to migrate to API
everyone that o know that have/had subscription didn't used it very extensively, and that is how it's still profitable in general
I suspect that it's the same for copilot, especially the business variant, while they definitely lose money on my account, believe that when looking on our whole company subscription I wouldn't be surprised that it's even 30% of what we pay
Re: OpenAI Audio Models
#313Hey, I'm Jeff and I was PM for these models at OpenAI. Today we launched three new state-of-the-art audio models. Two speech-to-text models—outperforming Whisper. A new TTS model—you can instruct it how to speak (try it on openai.fm!). And our Agents SDK now supports audio, making it easy to turn text agents into voice agents. We think you'll really like these models. Let me know if you have any questions here!
How about more sample code for the streaming transcription api? I gave o1pro the docs for both the real-time endpoint and the stt API but we couldn't get it working (from Java, but any language would help).
Re: OpenAI Audio Models
#314Earlier quoted context omitted.
Oh I see what you mean that would be a neat feature. Assuming you can get timestamps though it should be trivial to work around the issue?
There are two options that I know of: 1. Merge both channels into one (this is what Whisper does with dual-channel recordings), then map transcription timestamps back to the original channels. This works only when speakers don't talk over each other, which is often not the case. 2. Transcribe each channel separately, then merge the transcripts. This preserves perfect channel identification but removes valuable conver…
(2) is also significantly harder with these new models as they don’t support word timestamps like WHISPR.
see > Other parameters, such as timestamp_granularities, require verbose_json output and are therefore only available when using whisper-1.
Re: OpenAI Audio Models
#315All these voices are too good these days. I want my home assistant to sound like Auto from Wall-E, dammit! Anyone out there doing any nice robotic robot voices? Best I've got so far is a blend of Ralph and Zarvox from MacOS' `say`, haha say -v zarvox -r 180 "[[volm 0.8]] ${message}" & say -v ralph -r 180 "${message}"
You could apply a robotic filter on top of these voices.
Re: OpenAI Audio Models
#316Earlier quoted context omitted.
It's way cheaper - everyone is, elevenlabs is very expensive. Nobody matches their quality though. Especially if you want something that doesn't sound like a voice assistant/audiobook/podcast/news anchor/tv announcer. This openai offering is very interesting, it offers valuable features elevenlabs doesn't in emotional control. It also hallucinates though which would need to be fixed for it to be very useful.
It's cheap because everything OpenAI does is subsidized by investors' money. Until that stupid money flows all good! Then either they'll go the way of WeWork, or enshittification will happen to make it possible for them to make the books work. I don't see any other option. Unless Softbank decides it has some 150 Billion to squander on buying them off. There's a lot of head-in-the-sand behavior going on around OpenAI…
That's not true. ElevenLabs margins are insane and their largest advantage is high quality audio data.
Re: OpenAI Audio Models
#317Most of the voices give "I'm sorry, I can't assist with that request" when I try to input Japanese. They all work for German and Spanish, though.