Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

We are beginning to roll out new voice and image capabilities in ChatGPT

openai.com

Post reply on HN
Print view View original

641–650 of 914 posts

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#641

Post by cyrux004 »

TheEzEzz wrote: post #633
modeless wrote: post #459

Voice has the potential to be awesome. This demo is really underwhelming to me because of the multi-second latency between the query and response, just like every other lame voice assistant. It doesn't have to be this way! I have a local demo using Llama 2 that responds in about half a second and it feels like talking to an actual person instead of like Siri or something. I really should package it up so people can t…

Completely agree, latency is key for unlocking great voice experiences. Here's a quick demo I'm working on for voice ordering https://youtu.be/WfvLIEHwiyo Total end-to-end latency is a few hundred milliseconds: starting from speech to text, to the LLM, then to a POS to validate the SKU (no hallucinations are possible!), and finally back to generated speech. The latency is starting to feel really natural. Building out…

This is pretty good. Do you think running models locally will be able to achieve performance (getting task done successfully) compared to cloud based ones.i am assuming for context of a drive through scenario it should be ok but more complex systems might need external infromation

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#642

Post by bottlepalm »

jackallis wrote: post #502

i am terrified now. at the rate this is going, i am sure it will plateau at somepoint, only thing that will stop/slow down progress is computation power.

'i am sure it will plateau'

'only thing that will stop/slow down progress is computation power'

Seems a bit contradictory? When has 'computation power' ever 'plateaued'?

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#643

Post by nbened »

It feels like something like this can be hacked together to be more reliable with some image to text generation plugged into the existing ChatGPT, and enough iterations to make it robust for these how-to applications. Less Turing-y but a different route to the same solution.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#644

Post by olddustytrail »

jgalt212 wrote: post #525
catchnear4321 wrote: post #59

Earlier quoted context omitted.

you can ask podcasts questions? and they answer you?

no, but they don't get the answer wrong 20% of the time and give off 100% correctness vibes.

No, generally podcasts are far worse than that...

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#645

Post by bottlepalm »

warent wrote: post #540

The number of comments here of people fearing there is a ghost in the shell is shocking. Are we really this emotional and irrational? Folks, let's all take a moment to remember that AI is nowhere near conscious. It's an illusion based in patterns that mimic humans.

We have no idea what consciousness is. Therefore we have no way to determine if AI is or is not.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#646

Post by gtowey »

bamboozled wrote: post #156
uoaei wrote: post #143

Earlier quoted context omitted.

I think this post-factual attitude is stronger and more common in some cultures than others. I'm afraid to say but given my extensive travels it appears American culture (and its derivatives in other countries) seems to be spearheading this shift.

Warning, my opinion ahead: I think it's because Americans, more than nearly all other cultures, love convenience. It's why the love for driving is so strong in the US. Don't walk or ride, drive. Once I was walking back from the grocer in Florida with 4 shopping bags, and people pulled over and asked if my car had broken down and if I needed a ride, people were stunned...I was walking for exercise and for the environm…

I agree with this, but I think there is a deeper level which explains this. And that is convenience is a product. The thing that truly defines how corporations in America have shaped our culture is that everything is turned into a way to sell you something.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#647

Post by ndm000 »

SomethingNew2 wrote: post #615

There are a lot of comments attempting to rationalize the value add or differentiation of humans synthesizing information and communicating it to others vs an llm based ai doing something similar. The fact that it’s so difficult to find a compelling difference is insightful in itself.

I think the compelling difference is truthfulness. There are certain people / organizations that I trust their synthesis of information. For LLMs, I can either use what they give me in low impact situations or I have to filter the output with what I know as true or can test.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#648

Post by Jensson »

wccrawford wrote: post #192
rubslopes wrote: post #84

Earlier quoted context omitted.

I've replaced my voice google assistant searches with the voice feature of the Bing app. It's a night and day difference. Bing voice is what I always expected from an AI companion of the future, it is just lacking commands -- setting tasks, home automation, etc.

I got sick of searching Google for in-game recipes for Disney Dreamlight because most of the results are a bunch of pointless text, and then finally the recipe hidden in it somewhere. I used Bing yesterday and it was able to parse out exactly what I wanted, and then give me idiot-proof steps to making the recipe in-game. (I didn't need the steps, but it gave me what I wanted up front, easily.) I tried it twice and it…

> I got sick of searching Google for in-game recipes for Disney Dreamlight

You mean these? Took me a few seconds to find, not sure how an LLM would make that easier. I guess the biggest benefit of LLM then is for people who don't know how to find stuff.

https://dreamlightvalleywiki.com/Cooking

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#649

Post by bottlepalm »

clbrmbr wrote: post #18

The thought of my children being put to bed by a machine is horrifying. Then again, perhaps this is better than many kids have. Shudder.

There are kids right now that spend more time in VRChat than real life. It's really something else.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#650

Post by famouswaffles »

WendyTheWillow wrote: post #617
jader201 wrote: post #565

Earlier quoted context omitted.

This feels fairly naive, ignoring how much progress has happened over the (short) span of one year. This doesn't sound like that tough of a gap to close in another year (again, projecting based off recent progress).

What actually was the innovation in LLMs that produced the kind of AI we're seeing now? Is that innovation ongoing or did it happen, and now we're seeing the various optimizations of that innovation? Is voice and image integration with ChatGPT a whole new capability of LLMs or is the "product" here a clean and intuitive interface through which to use the already existent technology? The difference between GPT 3, 3.5,…

>What actually was the innovation in LLMs that produced the kind of AI we're seeing now? Is that innovation ongoing or did it happen, and now we're seeing the various optimizations of that innovation?

Past the introduction of the transformer in 2017, There is no big "innovation". It is just scale. Bigger models are better. The last 4 years can be summed up that simply.

>Is voice and image integration with ChatGPT a whole new capability of LLMs or is the "product" here a clean and intuitive interface through which to use the already existent technology?

What is existing technology here ? Open ai aren't doing anything so alien you couldn't guess at if you knew what you were doing but image training at the scale of GPT-4 is new and it's not even the cleanest way to do it. We still don't have a "trained from scratch" large scale multimodal LLM yet.

>The difference between GPT 3, 3.5, and 4 is substantially smaller than the difference between GPT 2 and GPT 3

Definitely not lol. The OG GPT-3 was pulling sub 50 on MMLU. Even benchmarks aside, there is a massive gap in utility between 3.5 and 4, never mind 3. 4 was finished training august 2022. It's only 2 years apart from 3.

>I don't think progress is linear here. Rather, it seems more likely that we made the leap about a year or so ago, and are currently in the process of applying that leap in many different ways. But the leap happened, and there isn't seemingly another one coming.

There was no special leap (in terms of theory and engineering). This is scale plainly laid out and there's more of it to go.

>and Sam Altman has directly said there are no plans for a GPT 5.

the same that sat on 4 for 8 months and said absolutely nothing about it ? Take anything altman says about new iterations with a grain of salt.

Post reply on HN