Live data from Hacker News

We are beginning to roll out new voice and image capabilities in ChatGPT

openai.com

741–750 of 914 posts

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#741

Earlier quoted context omitted.

I think you fundamentally don't understand the nature of exponential growth, and the power of diminishing returns. Even if you double the GPU capacity over the next year, you won't even remotely begin to come close enough to producing a step-level growth of capability such as what we experienced between 2 to 3, or even 3 to 4. The LLM concept can only take you so far, and we're approaching the limits of what an LLM i…

>The LLM concept can only take you so far, and we're approaching the limits of what an LLM is capable of. You don't know that. This is literally just an assertion. An unfounded one at that. If you couldn't predict how far in 2017 the LLM concept would take us today, then you definitely have no idea how far it could actually go. >believes we are approaching the limits of LLM size for size’s sake Nothing to do with thi…

Er, that's not how arguments work. What we can't know is that those trends will continue, so it's on you to demonstrate that they will, despite evidence suggesting they won't.

As for as what you linked, Altman is saying the same thing I'm saying:

> That doesn’t mean that OpenAI won't continue to try to make the models bigger, it just means they will likely double or triple in size each year rather than increasing by many orders of magnitude.

This is exactly my point; doubling or tripling of the size will be possible, but it won't result in a doubling of performance. We won't see a GPT 5 that's twice as good as GPT 4, for example. The jump from 2 to 3 was exponential. The jump from 3 to 4 was also exponential, though not as much. The jump from 4 to 5 will follow that curve, according to Altman, which means exactly what he said in my quote; the value will continue to decrease. For a 2 to 3 type jump, GPU technology would have to completely transform in capability, which there are no indications that we've found that innovation.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#742
post #395
post #180

Earlier quoted context omitted.

Google demoed this a few months ago https://www.deepmind.com/blog/rt-2-new-model-translates-visi...

They are really good at keeping demos as demos

I don’t know, a lot of Google demos and papers introduce techniques that are productized fairly soon, just usually not by Google.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#743

Earlier quoted context omitted.

Completely agree, latency is key for unlocking great voice experiences. Here's a quick demo I'm working on for voice ordering https://youtu.be/WfvLIEHwiyo Total end-to-end latency is a few hundred milliseconds: starting from speech to text, to the LLM, then to a POS to validate the SKU (no hallucinations are possible!), and finally back to generated speech. The latency is starting to feel really natural. Building out…

Wow, the latency on requests feels great!! I’m really curious: is this running entirely with Python?

100% Python but with a good deal of multiprocessing, speculative decoding, etc. As we move to production we can probably shave another 100ms off by moving over to a compiled system, but Python is great for rapid iteration.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#745
post #521

Earlier quoted context omitted.

The real problem is distribution of the output of production. We will need something like UBI eventually.

Do we worry about the distribution of oxygen in the atmosphere, so everyone has equal chance of breathing? I know it's hard to comprehend massive abundance of everything, but please try.

there's already massive over abundance and people are still dying in the streets, & no public healthcare in the US

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#746

Earlier quoted context omitted.

I think you fundamentally don't understand the nature of exponential growth, and the power of diminishing returns. Even if you double the GPU capacity over the next year, you won't even remotely begin to come close enough to producing a step-level growth of capability such as what we experienced between 2 to 3, or even 3 to 4. The LLM concept can only take you so far, and we're approaching the limits of what an LLM i…

Moreover you keep saying we can't scale infinitely. Sure...but nobody is saying we have to. 4 is not as scaled from 3 as 3 was from 2. Doesn't matter, still massive gap.

As I said already, the gap from 3 to 4 was substantially smaller than the gap between 2 to 3, and all indications are that the gap from 4 to 5 will also be further smaller than that.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#747
post #521

Earlier quoted context omitted.

The real problem is distribution of the output of production. We will need something like UBI eventually.

I think there will be plenty of work for a while because manual labor - construction, healthcare (doctors, nurses), food preparation, tradespeople - will be hard to replace in the foreseeable future. I see UBI as a solution to inequality (real problem) not as a solution to lack of jobs (not a problem). AI will probably lead to reduction of inequality and therefore there will be less need for UBI. In theory, the "ment…

AI will increase inequality, because most jobs will be automated, & most people will either not have jobs or have incredibly menial physical jobs where they are interchangeable

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#748
post #703

Earlier quoted context omitted.

Completely agree, latency is key for unlocking great voice experiences. Here's a quick demo I'm working on for voice ordering https://youtu.be/WfvLIEHwiyo Total end-to-end latency is a few hundred milliseconds: starting from speech to text, to the LLM, then to a POS to validate the SKU (no hallucinations are possible!), and finally back to generated speech. The latency is starting to feel really natural. Building out…

The voice does not seem to be able to pronounce the L in “else”. What’s happening there?

Good question. Off the shelf TTS systems tend to enunciate every phoneme more like a radio talk show host rather than a regular person, which I find a bit off putting. I've been playing around with trying to get the voice to be more colloquial/casual. But I haven't gotten it to really sound natural yet.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#749
post #473

Earlier quoted context omitted.

That bike example seemed a mix of underwhelming (for being the demo video) and even confusing. 1. It's not smart enough to recognize from the initial image this is a bolt style seat lock (which a human can). 2. The manual is not shown to the viewer, so I can't infer how the model knows this is a 4mm bolt (or if it is just guessing given that's the most likely one). 3. I don't understand how it can know the toolbox is…

Yep. This example basically convinced me that they were unable to figure out anything actually useful to do with the model's new capabilities. Which makes me wonder how capable the new model in fact is.

Yah, pretty sure it is the same feature that's been in Bing Chat for 2 months now. Which feels really like there's only one pass of feature extraction from the image, preventing any detailed analysis beyond a course "what do you see". (Follow-up questions of things it likely didn't parse are highly hallucinated).

This is why they can't extract the seat post information directly from the bike when the user asks. There's no "going back and looking at the image".

Edit: nope, it's a better image analyzer than Bing

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#750

Voice has the potential to be awesome. This demo is really underwhelming to me because of the multi-second latency between the query and response, just like every other lame voice assistant. It doesn't have to be this way! I have a local demo using Llama 2 that responds in about half a second and it feels like talking to an actual person instead of like Siri or something. I really should package it up so people can t…

Completely agree, latency is key for unlocking great voice experiences. Here's a quick demo I'm working on for voice ordering https://youtu.be/WfvLIEHwiyo Total end-to-end latency is a few hundred milliseconds: starting from speech to text, to the LLM, then to a POS to validate the SKU (no hallucinations are possible!), and finally back to generated speech. The latency is starting to feel really natural. Building out…

This is a very slick demo. Nice job!
Post reply on HN