21–30 of 99 posts
I've never seen a company publishing consistently groundbreaking features at such a speed like this one. I really wonder how their teams work. It's unprecedented at what i've seen in 15 years software
Earlier quoted context omitted.
It's probably stuck in legal limbo in the EU. The recently passed EU AI Act prohibits "AI systems aiming to identify or infer emotions", and Advanced Voice does definitely infer the user's emotions. (There is an exemption for "AI systems placed on the market strictly for medical or safety reasons, such as systems intended for therapeutical use", but Advanced Voice probably doesn't benefit from that exemption.)
Apparently this prohibition only applies to " situations related to the workplace and education ", and, in this context, " That prohibition should not cover AI systems placed on the market strictly for medical or safety reasons " So it seems to be possible to use this in a personal context. https://artificialintelligenceact.eu/recital/44/ > Therefore, the placing on the market, the putting into service, or the use of…
From the Realtime API blog post: https://openai.com/index/introducing-the-realtime-api/ > Audio in the Chat Completions API will be released in the coming weeks, as a new model `gpt-4o-audio-preview`. With `gpt-4o-audio-preview`, developers can input text or audio into GPT-4o and receive responses in text, audio, or both. > The Realtime API uses both text tokens and audio tokens. Text input tokens are priced at $5 pe…
That is substantially more expensive than TTS (text-to-speech) which already is quite expensive.
Audio output in the api now but you lose image input. Why ? That's a shame.
Earlier quoted context omitted.
Apparently this prohibition only applies to " situations related to the workplace and education ", and, in this context, " That prohibition should not cover AI systems placed on the market strictly for medical or safety reasons " So it seems to be possible to use this in a personal context. https://artificialintelligenceact.eu/recital/44/ > Therefore, the placing on the market, the putting into service, or the use of…
This is true, though it may not make sense commercially for them to offer an API that can't be used for workplace (business) applications or education.
But then I don't get the spirit of that limitation, as it should be just as applicable to TVs listening in on your conversations and trying to infer your emotions. Then again, I guess that for these cases there are other rules in place which prohibit doing this without the explicit consent of the user.
From the Realtime API blog post: https://openai.com/index/introducing-the-realtime-api/ > Audio in the Chat Completions API will be released in the coming weeks, as a new model `gpt-4o-audio-preview`. With `gpt-4o-audio-preview`, developers can input text or audio into GPT-4o and receive responses in text, audio, or both. > The Realtime API uses both text tokens and audio tokens. Text input tokens are priced at $5 pe…
> and $0.24 per minute of audio output That is substantially more expensive than TTS (text-to-speech) which already is quite expensive.
Earlier quoted context omitted.
This is true, though it may not make sense commercially for them to offer an API that can't be used for workplace (business) applications or education.
I see what you mean, but I think that "workplace" specifically refers to the context of the workplace, so that an employer cannot use AI to monitor the employees, even if they have been pressured to agree to such a monitoring. I think this is unrelated to "commercially offering services which can detect emotions". But then I don't get the spirit of that limitation, as it should be just as applicable to TVs listening…
> I think this
> I don't get the spirit of that limitation
> I guess that
In a nutshell, this uncertainty is why firms are going to slow-roll EU rollout of AI and, for designated gatekeepers, other features. Until there is a body of litigated cases to use as reference, companies would be placing themselves on the hook for tremendous fines, not to mention the distraction of the executives.
Which, not making any value judgement here, is the point of these laws. To slow down innovation so that society, government, regulation, can digest new technologies. This is the intended effect, and the laws are working.
From the Realtime API blog post: https://openai.com/index/introducing-the-realtime-api/ > Audio in the Chat Completions API will be released in the coming weeks, as a new model `gpt-4o-audio-preview`. With `gpt-4o-audio-preview`, developers can input text or audio into GPT-4o and receive responses in text, audio, or both. > The Realtime API uses both text tokens and audio tokens. Text input tokens are priced at $5 pe…
> and $0.24 per minute of audio output That is substantially more expensive than TTS (text-to-speech) which already is quite expensive.
If OpenAI decides to fully ignore ethics and dive deep into voice cloning, then all bets are off.
> The Realtime API improves this by streaming audio inputs and outputs directly, enabling more natural conversational experiences. It can also handle interruptions automatically, much like Advanced Voice Mode in ChatGPT. > Under the hood, the Realtime API lets you create a persistent WebSocket connection to exchange messages with GPT-4o. The API supports function calling(opens in a new window), which makes it possibl…
The two examples shown in the DevDay are the things I don't really want to do in the future. I don't want to talk to anybody, and I don't want to wait for their answer in a human form. That's why I order my food through an app or Whatsapp, or why I prefer to buy my tickets online. In the rare case I call to order food, it's because I have a weird question or a weird request (can I pick it up in X minutes? Can you prepare it in a different way?)
I hope we don't start seeing apps using conversations as interfaces because it would really horrible (leaving aside the fact that a lot of people don't know how to communicate themselves, different accents, sound environments, etc), while clicking or typing work almost the same for everyone (at least much more normalized than talking)