I've never seen a company publishing consistently groundbreaking features at such a speed like this one. I really wonder how their teams work. It's unprecedented at what i've seen in 15 years software
GPT 5 is writing their code
OpenAI DevDay 2024 live blog
61–70 of 99 posts
Re: OpenAI DevDay 2024 live blog
#62I've never seen a company publishing consistently groundbreaking features at such a speed like this one. I really wonder how their teams work. It's unprecedented at what i've seen in 15 years software
AFAIK a lot of these ideas are not new (the JSON thing was done with OS models before) and OpenAI is possibly the hottest startup with the most funding this decade (maybe even past two decades?), so I think this is actually all within expectations.
> OpenAI is possibly the hottest startup with the most funding this decade (maybe even past two decades?)
It depends on how you define startup but I don't think they will surpass Uber, ByteDance, or SpaceX until this next rumored funding round.
I'm excluding companies that have raised funding post IPO since that's an obvious cutoff for startups. The other cuttof being break even, in which case Uber has raised well over $20 billion.
Re: OpenAI DevDay 2024 live blog
#63Earlier quoted context omitted.
This was first done by deepseek. [1] [1]: https://platform.deepseek.com/api-docs/news/news0802/
Haven’t tried Deepseek - how do they compare to OaI?
They release SOTA open source coding models. [1] Their API us also incredibly cheap due to the novel attention and MoE arch.
Re: OpenAI DevDay 2024 live blog
#64Earlier quoted context omitted.
they're definitely going to instruct the AI agents to lie to you, and deliberately waste your time, and be pushier than ever, because it's not costing them anything to have a real human on the line even longer. at least we'll have our own agents to waste their compute in turn
Any company that is that scummy already has sales people working for it who are that scummy and lying non-stop. The AI isn't changing that equation at all.
AI is actually better here.
1. AI instructions are legible. There is no record asking John to sell the customer things they don't need. There is a record if the AI does it.
2. AI interactions are legible. If a sales guy tells you something false on a zoom call, there is no record of it. If the AI does, there is a record.
Re: OpenAI DevDay 2024 live blog
#65Using structured outputs for generative ui is such a cool idea does anyone know some cool web demos related to this ?
I just had an evil thought: once AIs are fast enough, it would be possible to create a “dynamic” user interface on the fly using an AI. Instead of Java or C# code running in an event loop processing mouse clicks, in principle we could have a chat bot generate the UI elements in a script like WPF or plain HTML and process user mouse and keyboard input events! If you squint at it, this is what chat bots do now, except…
That actually sounds pretty entertaining. Especially if there is dynamic user input, like text box input
Re: OpenAI DevDay 2024 live blog
#66Earlier quoted context omitted.
I agree. I'm wondering if it is possible to disable output streaming of audio and just get the text response event.
It seems so. The configuration of the session accepts a parameter (modalities) that could restrict the response only to text. See it in https://platform.openai.com/docs/api-reference/realtime-clie... .
correct - you should also be able to save a lot by skipping their built-in VAD and doing turn detection (if you need it) locally to avoid paying for silent inputs.
Re: OpenAI DevDay 2024 live blog
#67I just need their API to be faster. 15-30 seconds per request using 4o-mini isn't good enough for responsive applications.
That doesn’t match my experience using it a lot at all
Re: OpenAI DevDay 2024 live blog
#68I understand the Realtime API voice novelty, and the techonological achievement it is, but I don't see it from the product point of view. It looks like one of those startups finding a solution before knowing the problem. The two examples shown in the DevDay are the things I don't really want to do in the future. I don't want to talk to anybody, and I don't want to wait for their answer in a human form. That's why I o…
One thing I'm really excited for is having this real-time voice model in video game characters. It would be really cool to be able to have conversations with NPCs, and actually have to pick their brain for information about a quest or something.
Re: OpenAI DevDay 2024 live blog
#69I understand the Realtime API voice novelty, and the techonological achievement it is, but I don't see it from the product point of view. It looks like one of those startups finding a solution before knowing the problem. The two examples shown in the DevDay are the things I don't really want to do in the future. I don't want to talk to anybody, and I don't want to wait for their answer in a human form. That's why I o…
You're right, having a voice conversation for any reason is just so passe these days. They should stop adding microphones to phones and everything. So old-fashioned and inefficient. And who wants to ever have to actually talk to someone or some AI to ask for anything? I'm sure our vocal cords will evolve away soon. They are so primitive. Vestigial organs.
You made my day
Re: OpenAI DevDay 2024 live blog
#70> The Realtime API improves this by streaming audio inputs and outputs directly, enabling more natural conversational experiences. It can also handle interruptions automatically, much like Advanced Voice Mode in ChatGPT. > Under the hood, the Realtime API lets you create a persistent WebSocket connection to exchange messages with GPT-4o. The API supports function calling(opens in a new window), which makes it possibl…
It's incredible that people are talking about the downfall of software engineering - now, at many companies, hundreds of call center roles will be replaced by a few engineering roles. With image fine-tuning, now we can replace radiologists with software engineers, etc. etc.