That was cool, but got up to $1 usage real quick
We had our playground (https://playground.livekit.io) up for a few days using our key. Def racked up a $$$$ bill!
Show HN: Open source framework OpenAI uses for Advanced Voice
11–20 of 63 posts
Re: Show HN: Open source framework OpenAI uses for Advanced Voice
#12Olivier, Michelle, and Romain gave you guys a shoutout like 3 times in our DevDay recap podcast if you need more testimonial quotes :) https://www.latent.space/p/devday-2024
You guys are honestly the best
Re: Show HN: Open source framework OpenAI uses for Advanced Voice
#13That’s some crazy marketing for a „our library happened to support this relatively simple use case“ situation. Impressive!
By the way: The cerebras voice demo also uses LiveKit for this: https://cerebras.vercel.app/
Re: Show HN: Open source framework OpenAI uses for Advanced Voice
#14Re: Show HN: Open source framework OpenAI uses for Advanced Voice
#15Earlier quoted context omitted.
We had our playground ( https://playground.livekit.io ) up for a few days using our key. Def racked up a $$$$ bill!
How much is it per minute of talking?
It shakes out to around $0.15 per minute for an average conversation. If history is a guide though, this will get a lot cheaper pretty quickly.
Re: Show HN: Open source framework OpenAI uses for Advanced Voice
#16Earlier quoted context omitted.
We had our playground ( https://playground.livekit.io ) up for a few days using our key. Def racked up a $$$$ bill!
How much is it per minute of talking?
50% human speaking at $0.06/minute of tokens
50% AI speaking at $0.24/minute of tokens
we (LiveKit Cloud) charge ~$0.0005/minute for each participant (in this case there would be 2)
So blended is $0.151/minute
Re: Show HN: Open source framework OpenAI uses for Advanced Voice
#17That’s some crazy marketing for a „our library happened to support this relatively simple use case“ situation. Impressive! By the way: The cerebras voice demo also uses LiveKit for this: https://cerebras.vercel.app/
There’s a ton of complexity under the “relatively simple use case” when you get to a global, 200M+ user scale.
Re: Show HN: Open source framework OpenAI uses for Advanced Voice
#18Re: Show HN: Open source framework OpenAI uses for Advanced Voice
#19Super cool! Didn't realize OpenAI is just using LiveKit. Does the pricing breakdown to be the same as having a OpenAI Advanced Voice socket open the whole time? It's like $9/hr! It would be theoretically cheaper to use this without keeping the advanced voice socket open the whole time and just use the GPT4o streaming service [1] for whenever inference is needed (pay per token) and use livekits other components to do…
You dont get charged per hour with the openai realtime api, only for tokens from detected speech and response
Re: Show HN: Open source framework OpenAI uses for Advanced Voice
#20Super cool! Didn't realize OpenAI is just using LiveKit. Does the pricing breakdown to be the same as having a OpenAI Advanced Voice socket open the whole time? It's like $9/hr! It would be theoretically cheaper to use this without keeping the advanced voice socket open the whole time and just use the GPT4o streaming service [1] for whenever inference is needed (pay per token) and use livekits other components to do…
Currently it does: all audio is sent to the model. However, we are working on turn detection within the framework, so you won't have to send silence to the model when the user isn't talking. It's a fairly straight forward path to cutting down the cost by ~50%.
Working on this for an internal tool - detecting no speech has been a PITA so far. Interested to see how you go with this.