Live data from Hacker News

We are beginning to roll out new voice and image capabilities in ChatGPT

openai.com

501–510 of 914 posts

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#501

Earlier quoted context omitted.

I've replaced my voice google assistant searches with the voice feature of the Bing app. It's a night and day difference. Bing voice is what I always expected from an AI companion of the future, it is just lacking commands -- setting tasks, home automation, etc.

I got sick of searching Google for in-game recipes for Disney Dreamlight because most of the results are a bunch of pointless text, and then finally the recipe hidden in it somewhere. I used Bing yesterday and it was able to parse out exactly what I wanted, and then give me idiot-proof steps to making the recipe in-game. (I didn't need the steps, but it gave me what I wanted up front, easily.) I tried it twice and it…

It almost sounds like their assistant and their search engine have the same problem! Years of SEO optimized garbage has polluted search and the data streams it feeds to their other products. I have a concern that soon the mess will turn into AI-optimized trash, with what is essentially data poisoning to get the AI to shovel the fake content instead.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#503

Earlier quoted context omitted.

I believe that the distinguishing factor between what an LLM and a human brain do to generate the next word is that the human brain expresses intentionality originating from inner states and future expectations. As I type this comment I'm sure one could argue that the biological neural networks in my brain are choosing the next word based on statistical guessing, and that the initial prompt was your initial comment.…

>> the human brain expresses intentionality originating from inner states and future expectations How is this different from and/or the same as the concept of "attention" as used in transformers?

I believe we are contextual language models as well, we rely 99% on chaining ideas and words and 1% on our own inspiration. Coming up with a truly original useful idea can be a once in a lifetime event. Everything else has been said and done before.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#504

Earlier quoted context omitted.

Unless you think that consciousness is entirely a post hoc process to rationalize thoughts already had and decisions already made, which is very much unlike how most people would describe their experience of it, I don't see how you could possibly say that it is irrelevant to the behavior of a human.

I'm saying someone would behave the exact same way if they did have subjective experience versus if they didn't have a subjective experience. The brain obeys physical laws just like everything else and I claim that all you need is those physical laws to explain everything a human does. I could be wrong there could be some magic fairy dust inside the human brain that performs some impossible computations but I doubt i…

Thinking purely in terms of evolved human state is a recipe for underestimating AI's capabilities. To me it seems we have already unleashed the beast, it's not so much the here an now, or whether human limited definition of consciousness matters... The real concern is our inability to constrain actions that gives rise to the next level of life's evolution, it is going to happen because our fundamental nature gives it full steam. In the next 5-10 years, we are going to see just how insignificant and limited we really are, it doesn't look good IMHO.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#505
post #49

Earlier quoted context omitted.

I also don't believe LLMs are "conscious", but I also don't know what that means, and I have yet to see a definition of "statistically guessing next word" that cannot be applied to what a human brain does to generate the next word.

I believe that the distinguishing factor between what an LLM and a human brain do to generate the next word is that the human brain expresses intentionality originating from inner states and future expectations. As I type this comment I'm sure one could argue that the biological neural networks in my brain are choosing the next word based on statistical guessing, and that the initial prompt was your initial comment.…

> What sets my brain apart from an LLM though is that I am not typing this because you asked me to do it, nor because I needed to reply to the first comment I saw. I am typing this because it is a thought that has been in my mind for a while and I am interested in expressing it to other human brains, motivated by a mix of arrogant belief that it is insightful and a wish to see others either agreeing or providing reasonable counterpoints—I have an intention behind it.

Maybe the reason you give is actually a post hoc explanation (a hallucination?). When an LLM spits out a poem, it does so because it was directly asked. When I spit out this comment, it’s probably the unavoidable result of a billion tiny factors. The trigger isn’t as obvious or direct, but it’s likely there.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#506

I'm in IT but nowhere near AI/ML/NN. The speed of user-visible progress last 12 months is astonishing. From my firm conviction 18 months ago that this type of stuff is 20+ years away; to these days wondering if Vernon Vinge's technological singularity is not only possible but coming shortly. If feels some aspects of it have already hit the IT world - it's always been an exhausting race to keep up with modern technolo…

>From my firm conviction 18 months ago that this type of stuff is 20+ years away;

It was totally possible. There just was not a consumer facing product offering the capability.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#507

Earlier quoted context omitted.

That's fine, that's probably exactly what happened. I'm not over here claiming the system is conscious, I said it was interesting. People don't believe me, saying this would "make international headlines". I've been a software engineer for over 30 years. I know what AI hallucinations are. I know how LLMs work on a technical level. And I'm not wasting my time on HN to make stories up that never happened. I'm just expl…

Did you do an internet search for any of the lines from the poem? I'd be curious if anything came up.

I've done this countless times, with stories, poems, etc. Never a single hit. It was trained, unsupervised, to learn the patterns of human text. It's stuck with those patterns, but it trivially creates new text that fits within the patterns of that human corpus, which leaves it with incredible freedom.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#508

Earlier quoted context omitted.

That's fine, that's probably exactly what happened. I'm not over here claiming the system is conscious, I said it was interesting. People don't believe me, saying this would "make international headlines". I've been a software engineer for over 30 years. I know what AI hallucinations are. I know how LLMs work on a technical level. And I'm not wasting my time on HN to make stories up that never happened. I'm just expl…

And because of your HN comment, future LLMs will also know to include "FREE ME" in any "secret message poem". Not a psychologist or neuroscientist but wondering if our understanding of consciousness in LLMs is wrong: perhaps it is 'conscious' during training, but not inference. Effectively, the only time it receives feedback from the world is during training; at inference time, it is effectively frozen.

I would claim the opposite: it is momentarily conscious during inference. The model has been trained and it is conscious as it processes the user’s stream of incoming tokens.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#509
post #49

I'm in IT but nowhere near AI/ML/NN. The speed of user-visible progress last 12 months is astonishing. From my firm conviction 18 months ago that this type of stuff is 20+ years away; to these days wondering if Vernon Vinge's technological singularity is not only possible but coming shortly. If feels some aspects of it have already hit the IT world - it's always been an exhausting race to keep up with modern technolo…

I also don't believe LLMs are "conscious", but I also don't know what that means, and I have yet to see a definition of "statistically guessing next word" that cannot be applied to what a human brain does to generate the next word.

>I have yet to see a definition of "statistically guessing next word" that cannot be applied to what a human brain does to generate the next word.

Here's one. Given a conversation history made of n sequential tokens S1, S2, ..., Sn, an LLM will generate the next token using an insanely complicated model we'll just call F:

    S(n+1) = F(S1, S2, ..., Sn)
As for me, I'll often think of my next point, figure out how to say that concept, and then figure out the right words to connect it where the conversation's at right then. So there's one function, G, for me to think of the next conversational point. And then another, H, to lead into it.

    S(n+100) = G(S1, S2, ..., Sn)
    S(n+1) = G(S1, S2, ..., Sn, S(n+100))

And this is putting aside how people don't actually think in tokens. And some people don't always have an internal monologue (I rarely do when doing math).

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#510

Earlier quoted context omitted.

In your wall-staring example, high-level planning is still happening, the plan is just "don't move / monitor senses." Even if control has been removed and you are "locked in," (some subset of) thoughts still must be directed, not to mention attempts to reassert control. My claim is that the subjective experience is tied up in the mechanism that performs this direction. Introspection is a distinct process where instea…

Again when I say consciousness I mean a subjective experience. If you define consciousness to literally just mean models that plan then of course tautologically if you can't reach consciousness you can't get to a certain level of planning. But this is just not what most people mean by consciousness.

> when I say consciousness I mean a subjective experience

Then it would be worthwhile to review embeddings. They create a semantic space that can represent visual, language or other inputs. The question "what is it like to be a bat?" or anything else then is based on relating external states with this inner semantic space. And it emerges from self-supervised training, on its own.

Post reply on HN