Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

We are beginning to roll out new voice and image capabilities in ChatGPT

openai.com

Post reply on HN
Print view View original

651–660 of 914 posts

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#651

Post by corobo »

jshmrsn wrote: post #445
vdfs wrote: post #204

Earlier quoted context omitted.

I think one mean difference in LLM, is what Micheal Scott said in The Office: "Sometimes I'll start a sentence, and I don't even know where it's going. I just hope I find it along the way. Like an improv conversation. An improversation" Human will know what they want to express, choosing words to express it might be similar to LLM process of choosing words, but for LLM it doesn't have that "Here is what i know to exp…

I can only speak from my own internal experience, but don’t your unspoken thoughts take form and exist as language in your mind? If you imagine taking the increasingly common pattern to “think through the problem before giving your answer”, but hiding the pre-answer text from the user, then it seems like that would pretty analogous to how humans think before communicating.

This depends for me. In the framework of that book Thinking, Fast and Slow - for me the fast version is closer to LLM in terms of I'll start the sentence without consciously knowing where I'm going with it. Sometimes I'll trip over and/or realise I'm saying something incorrect (Disclaimer: ADHD may be a factor)

The thinking slow version would indeed be thought through before I communicate it

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#652

Post by TheEzEzz »

cyrux004 wrote: post #641
TheEzEzz wrote: post #633

Earlier quoted context omitted.

Completely agree, latency is key for unlocking great voice experiences. Here's a quick demo I'm working on for voice ordering https://youtu.be/WfvLIEHwiyo Total end-to-end latency is a few hundred milliseconds: starting from speech to text, to the LLM, then to a POS to validate the SKU (no hallucinations are possible!), and finally back to generated speech. The latency is starting to feel really natural. Building out…

This is pretty good. Do you think running models locally will be able to achieve performance (getting task done successfully) compared to cloud based ones.i am assuming for context of a drive through scenario it should be ok but more complex systems might need external infromation

Definitely depends on the application, agreed. The more open ended the application the more dependent it is on larger LLMs (and other systems) that don't easily fit on edge. At the same time, progress is happening that is increasing the size of LLM that can be ran on edge. I imagine we end up in a hybrid world for many applications, where local models take a first pass (and also handle speech transcription) and only small requests are made to big cloud-based models as needed.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#653

Post by jameshart »

iandanforth wrote: post #579
jameshart wrote: post #518

Earlier quoted context omitted.

That isn’t incompatible with what LLMs do though. The penultimate layer of the LLM could be thought of as the one that figures out ‘given S1..Sn, what concept am I trying to express now?’. The final layer is the function from that to ‘what token should I output next’. The fact that the LLM has to figure that all out again from scratch as part of generating every token, rather than maintaining a persistent ‘plan’, doe…

Correct, but it's functionally very different from how LLMs are implemented and deployed today. What you're highlighting is being experimented with and ties into ideas like scratch pads, world models, RAG, and progressive fine-tuning (if you're googling). It's a bit like saying your computer has everything it needs to manipulate photos but doesn't yet have Photoshop installed.

No, I’m not talking about giving LLMs chain of thought prompts or augmenting them with scratchpads - I’m literally saying that in a multilayer neural network you don’t know what concepts activations on the inner layers mean. The result of ‘where I want this conversation to be in 100 tokens time’ could absolutely be in there somewhere.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#654

Post by kajumix »

make3 wrote: post #521
RivieraKid wrote: post #466

I went from being worried to thinking it won't replace me anytime soon after using GPT4 for a while and now I'm back to being worried. Because the pace of development is intense. I would love to be financially independent and watch this with excitement and perhaps take on risky and fun projects. Now I'm thinking - how do I double or triple my income so that I reach financial independence in 3 years instead of 10 year…

The real problem is distribution of the output of production. We will need something like UBI eventually.

Do we worry about the distribution of oxygen in the atmosphere, so everyone has equal chance of breathing? I know it's hard to comprehend massive abundance of everything, but please try.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#655

Post by richardw »

tombert wrote: post #560
RivieraKid wrote: post #466

I went from being worried to thinking it won't replace me anytime soon after using GPT4 for a while and now I'm back to being worried. Because the pace of development is intense. I would love to be financially independent and watch this with excitement and perhaps take on risky and fun projects. Now I'm thinking - how do I double or triple my income so that I reach financial independence in 3 years instead of 10 year…

I'm not convinced that this pace will continue. We're seeing a lot of really cool, rapid evolution of this tech in a short amount of time, but I do think we'll hit a soft ceiling in the not too distant future as well. If you look at something like smartphones, for example. Smartphones, from my perspective, got drastically better and better from about ~2006-2015 or so. They were rapidly improving cameras and battery l…

The worry is that in your analogy, we’re the SLR. ChatGPT is a 1MP digital camera.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#656

Post by famouswaffles »

TheRoque wrote: post #596
jader201 wrote: post #565

Earlier quoted context omitted.

This feels fairly naive, ignoring how much progress has happened over the (short) span of one year. This doesn't sound like that tough of a gap to close in another year (again, projecting based off recent progress).

The opposite is fairly naive. Software development is not only dumping tokens into a text file. To have a significant impact on the market, it should do much, much, much more: compile and test code, automatically assess the quality of what its done, be aware of the current design trends (if in UI/UX), ideally innovate, it should also be able to run a debugger, inspect all the variables, and deduce from there how it g…

https://arxiv.org/abs/2309.12499

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#657

Post by nerdbert »

surfingdino wrote: post #375

I can imagine people using these new capabilities to diagnose skin conditions. Should dermatologists be worried?

They should be thrilled, they can spend more of their time treating people who need it and less time guessing about who those people are.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#658

Post by pmarreck »

WendyTheWillow wrote: post #516
RivieraKid wrote: post #466

I went from being worried to thinking it won't replace me anytime soon after using GPT4 for a while and now I'm back to being worried. Because the pace of development is intense. I would love to be financially independent and watch this with excitement and perhaps take on risky and fun projects. Now I'm thinking - how do I double or triple my income so that I reach financial independence in 3 years instead of 10 year…

I don’t think any of this materially changes job outlook for software development over the next decade. I use ChatGPT daily for school, and used Copilot daily for software development; it gets a lot wrong a lot of the time, and can’t retain necessary context that is critical for being useful long term. I can’t even get it to consume an entire chapter at once to generate notes or flashcards yet. It may slightly change…

> I can’t even get it to consume an entire chapter at once to generate notes or flashcards yet.

Anthropic’s Claude 100k is your jam, then. And Amazon just invested $1 billion in them.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#659

Post by realce »

lukev wrote: post #575
jader201 wrote: post #565

Earlier quoted context omitted.

This feels fairly naive, ignoring how much progress has happened over the (short) span of one year. This doesn't sound like that tough of a gap to close in another year (again, projecting based off recent progress).

The bitter truth though is that the last 20% always takes 99% of the time and effort. LLMs are a huge breakthrough and we are absolutely speedrunning the 80%, but I see no reason to believe the usual pattern won’t hold when the easy wins are exploited.

Some insurance against this dam breaking wouldn't be so bad however

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#660

Post by chimprich »

satellite2 wrote: post #576
tombert wrote: post #560

Earlier quoted context omitted.

I'm not convinced that this pace will continue. We're seeing a lot of really cool, rapid evolution of this tech in a short amount of time, but I do think we'll hit a soft ceiling in the not too distant future as well. If you look at something like smartphones, for example. Smartphones, from my perspective, got drastically better and better from about ~2006-2015 or so. They were rapidly improving cameras and battery l…

There is clearly a plateau in how good a ux can be. It might be a local optimum but still you solve the task the user wants. I don't see a clear ceiling in intelligence. And if the ceiling is how much of the human tasks can be replaced then I think when we reach it the world is going to look very different from now. (Let's also not discount how much the world changed since the introduction of the smartphone.)

> I don't see a clear ceiling in intelligence

The plateau in this case is presumably how far you can advance intelligence from the current model architectures. There seems to be diminishing returns from throwing more layers, parameters or training data at these things.

We will see improvements but for dramatic increases I think we'll need new breakthroughs. New inventions are hard to predict, pretty much by definition.

Post reply on HN