Live data from Hacker News

OpenAI DevDay 2024 live blog

simonwillison.net

31–40 of 99 posts

Re: OpenAI DevDay 2024 live blog

#31
post #16

I've never seen a company publishing consistently groundbreaking features at such a speed like this one. I really wonder how their teams work. It's unprecedented at what i've seen in 15 years software

AFAIK a lot of these ideas are not new (the JSON thing was done with OS models before) and OpenAI is possibly the hottest startup with the most funding this decade (maybe even past two decades?), so I think this is actually all within expectations.

Re: OpenAI DevDay 2024 live blog

#32
post #18
post #16

I've never seen a company publishing consistently groundbreaking features at such a speed like this one. I really wonder how their teams work. It's unprecedented at what i've seen in 15 years software

I wonder how much they use their own products internally to speed up development and decisions.

And I wonder how much they use them externally to influence the online conversations about their own products/company.

Re: OpenAI DevDay 2024 live blog

#33

> 11:43 Fields are generated in the same order that you defined them in the schema, even though JSON is supposed to ignore key order. This ensures you can implement things like chain-of-thought by adding those keys in the correct order in your schema design. Why not use an array of key value pairs if you want to maintain ordering without breaking traditional JSON rules? [ {key1:value1}, {key2:value2} ]

I don't think openai models supports this pattern. You can only have array of fixed types. Or basically keys should be same. See [1]

[1]: https://platform.openai.com/docs/guides/structured-outputs/s...

Re: OpenAI DevDay 2024 live blog

#34
post #18
post #16

I've never seen a company publishing consistently groundbreaking features at such a speed like this one. I really wonder how their teams work. It's unprecedented at what i've seen in 15 years software

I wonder how much they use their own products internally to speed up development and decisions.

They definitely use their own products internally, perhaps to a fault: While chatting with OpenAI recruiters, I received calendar events with nonsensical DALLE-generated calendar images, and "interview prep" guides that were clearly written by an older GPT model.

Re: OpenAI DevDay 2024 live blog

#35
post #30

I understand the Realtime API voice novelty, and the techonological achievement it is, but I don't see it from the product point of view. It looks like one of those startups finding a solution before knowing the problem. The two examples shown in the DevDay are the things I don't really want to do in the future. I don't want to talk to anybody, and I don't want to wait for their answer in a human form. That's why I o…

You're right, having a voice conversation for any reason is just so passe these days. They should stop adding microphones to phones and everything. So old-fashioned and inefficient. And who wants to ever have to actually talk to someone or some AI to ask for anything? I'm sure our vocal cords will evolve away soon. They are so primitive. Vestigial organs.

Re: OpenAI DevDay 2024 live blog

#36
I didn't expect an API for advanced voice so soon. That's pretty great. Here's the thing I was really wondering: Audio is $.06/min in, $.24/min out. Can't wait to try some language learning apps built with this. It'll also be fun for controlling robots.

Re: OpenAI DevDay 2024 live blog

#37

Holy crud, I figured they would guard this for a long time and I was really salivating to make some stuff with it. The doors are wide open for all sorts of stuff now, Advanced Voice is the first feature since ChatGPT initially came out that really has my jaw on the floor.

Try notebook LM, it's the chatgpt moment for Google's deepmind

I wish I could but not available in UK, IIRC

Re: OpenAI DevDay 2024 live blog

#38
post #16

I've never seen a company publishing consistently groundbreaking features at such a speed like this one. I really wonder how their teams work. It's unprecedented at what i've seen in 15 years software

AFAIK a lot of these ideas are not new (the JSON thing was done with OS models before) and OpenAI is possibly the hottest startup with the most funding this decade (maybe even past two decades?), so I think this is actually all within expectations.

They're exceptional at executing and delivering, you don't get that just through having more funding.

Re: OpenAI DevDay 2024 live blog

#39
post #26

Earlier quoted context omitted.

> and $0.24 per minute of audio output That is substantially more expensive than TTS (text-to-speech) which already is quite expensive.

I agree. I'm wondering if it is possible to disable output streaming of audio and just get the text response event.

It seems so.

The configuration of the session accepts a parameter (modalities) that could restrict the response only to text. See it in https://platform.openai.com/docs/api-reference/realtime-clie....

Re: OpenAI DevDay 2024 live blog

#40

> 11:43 Fields are generated in the same order that you defined them in the schema, even though JSON is supposed to ignore key order. This ensures you can implement things like chain-of-thought by adding those keys in the correct order in your schema design. Why not use an array of key value pairs if you want to maintain ordering without breaking traditional JSON rules? [ {key1:value1}, {key2:value2} ]

> even though JSON is supposed to ignore key order

Most tools preserve the order. I consider it to be an unofficial feature of JSON at this point. A lot of people think of it as a soft guarantee, but it’s a hard guarantee in all the recent JavaScript and python versions. There are some common places where it’s lost, like JSONB in Postgres, but it’s good to be aware that this unofficial feature is commonly being used.

Post reply on HN