51–60 of 99 posts
Any word on increased weekly caps on o1 usage?
"10:30 They started with some demos of o1 being used in applications, and announced that the rate limit for o1 doubled to 10000 RPM (from 5000 RPM) - same as GPT-4 now."
> The first big announcement: a realtime API, providing the ability to use WebSockets to implement voice input and output against their models. I guess this is using their "old" turn-based voice system?
No, it's the same thing as ChatGPT advanced voice. Full speech-to-speech model.
> The Realtime API improves this by streaming audio inputs and outputs directly, enabling more natural conversational experiences. It can also handle interruptions automatically, much like Advanced Voice Mode in ChatGPT. > Under the hood, the Realtime API lets you create a persistent WebSocket connection to exchange messages with GPT-4o. The API supports function calling(opens in a new window), which makes it possibl…
saw velvet show hn the other dya, could be usful for storng these https://news.ycombinator.com/item?id=41637550
But seperate from that you typically want some application specific storage of the current "conversation" in a very different format than raw request logging.
I just need their API to be faster. 15-30 seconds per request using 4o-mini isn't good enough for responsive applications.
Earlier quoted context omitted.
> I understand the Realtime API voice novelty, and the techonological achievement it is, but I don't see it from the product point of view. It looks like one of those startups finding a solution before knowing the problem. The market for realistic voice agents is huge, but also very fragmented. Customer service is the obvious example, large companies employ tens of thousands of customer service phone agents, and a la…
And after your mis-led by a sales agent, it doesn't make you as angry because it's just an AI.
It's pretty amazing that they made prompt caching automatic. It's rare that a company gives a 50% discount without the customer explicitly requesting it! Of course... they might be retaining some margin, judging by their discount being 50% vs. Anthropic's 90%.
Earlier quoted context omitted.
And after your mis-led by a sales agent, it doesn't make you as angry because it's just an AI.
they're definitely going to instruct the AI agents to lie to you, and deliberately waste your time, and be pushier than ever, because it's not costing them anything to have a real human on the line even longer. at least we'll have our own agents to waste their compute in turn
The AI isn't changing that equation at all.
Using structured outputs for generative ui is such a cool idea does anyone know some cool web demos related to this ?
If you squint at it, this is what chat bots do now, except with a “terminal” style text UI instead of a GUI or true Web UI.
The first incremental step had already been taken: pretty-printing of maths and code. Interactive components are a logical next step.
It would be a mere afternoon of work to write a web server where the dozens of “controllers” is replaced with a single call to an LLM API that simply sends the previous page HTML and the request HTML with headers and all.
“Based on the previous HTML above and the HTTP request below, output the response HTML.”
Just sprinkle on some function calling and a database schema, and the site is done!
It's pretty amazing that they made prompt caching automatic. It's rare that a company gives a 50% discount without the customer explicitly requesting it! Of course... they might be retaining some margin, judging by their discount being 50% vs. Anthropic's 90%.
This was first done by deepseek. [1] [1]: https://platform.deepseek.com/api-docs/news/news0802/