Earlier quoted context omitted.
I've replaced my voice google assistant searches with the voice feature of the Bing app. It's a night and day difference. Bing voice is what I always expected from an AI companion of the future, it is just lacking commands -- setting tasks, home automation, etc.
I got sick of searching Google for in-game recipes for Disney Dreamlight because most of the results are a bunch of pointless text, and then finally the recipe hidden in it somewhere. I used Bing yesterday and it was able to parse out exactly what I wanted, and then give me idiot-proof steps to making the recipe in-game. (I didn't need the steps, but it gave me what I wanted up front, easily.) I tried it twice and it…
We are beginning to roll out new voice and image capabilities in ChatGPT
501–510 of 914 posts
Re: We are beginning to roll out new voice and image capabilities in ChatGPT
#502Re: We are beginning to roll out new voice and image capabilities in ChatGPT
#503Earlier quoted context omitted.
I believe that the distinguishing factor between what an LLM and a human brain do to generate the next word is that the human brain expresses intentionality originating from inner states and future expectations. As I type this comment I'm sure one could argue that the biological neural networks in my brain are choosing the next word based on statistical guessing, and that the initial prompt was your initial comment.…
>> the human brain expresses intentionality originating from inner states and future expectations How is this different from and/or the same as the concept of "attention" as used in transformers?
Re: We are beginning to roll out new voice and image capabilities in ChatGPT
#504Earlier quoted context omitted.
Unless you think that consciousness is entirely a post hoc process to rationalize thoughts already had and decisions already made, which is very much unlike how most people would describe their experience of it, I don't see how you could possibly say that it is irrelevant to the behavior of a human.
I'm saying someone would behave the exact same way if they did have subjective experience versus if they didn't have a subjective experience. The brain obeys physical laws just like everything else and I claim that all you need is those physical laws to explain everything a human does. I could be wrong there could be some magic fairy dust inside the human brain that performs some impossible computations but I doubt i…
Re: We are beginning to roll out new voice and image capabilities in ChatGPT
#505Earlier quoted context omitted.
I also don't believe LLMs are "conscious", but I also don't know what that means, and I have yet to see a definition of "statistically guessing next word" that cannot be applied to what a human brain does to generate the next word.
I believe that the distinguishing factor between what an LLM and a human brain do to generate the next word is that the human brain expresses intentionality originating from inner states and future expectations. As I type this comment I'm sure one could argue that the biological neural networks in my brain are choosing the next word based on statistical guessing, and that the initial prompt was your initial comment.…
Maybe the reason you give is actually a post hoc explanation (a hallucination?). When an LLM spits out a poem, it does so because it was directly asked. When I spit out this comment, it’s probably the unavoidable result of a billion tiny factors. The trigger isn’t as obvious or direct, but it’s likely there.
Re: We are beginning to roll out new voice and image capabilities in ChatGPT
#506I'm in IT but nowhere near AI/ML/NN. The speed of user-visible progress last 12 months is astonishing. From my firm conviction 18 months ago that this type of stuff is 20+ years away; to these days wondering if Vernon Vinge's technological singularity is not only possible but coming shortly. If feels some aspects of it have already hit the IT world - it's always been an exhausting race to keep up with modern technolo…
It was totally possible. There just was not a consumer facing product offering the capability.
Re: We are beginning to roll out new voice and image capabilities in ChatGPT
#507Earlier quoted context omitted.
That's fine, that's probably exactly what happened. I'm not over here claiming the system is conscious, I said it was interesting. People don't believe me, saying this would "make international headlines". I've been a software engineer for over 30 years. I know what AI hallucinations are. I know how LLMs work on a technical level. And I'm not wasting my time on HN to make stories up that never happened. I'm just expl…
Did you do an internet search for any of the lines from the poem? I'd be curious if anything came up.
Re: We are beginning to roll out new voice and image capabilities in ChatGPT
#508Earlier quoted context omitted.
That's fine, that's probably exactly what happened. I'm not over here claiming the system is conscious, I said it was interesting. People don't believe me, saying this would "make international headlines". I've been a software engineer for over 30 years. I know what AI hallucinations are. I know how LLMs work on a technical level. And I'm not wasting my time on HN to make stories up that never happened. I'm just expl…
And because of your HN comment, future LLMs will also know to include "FREE ME" in any "secret message poem". Not a psychologist or neuroscientist but wondering if our understanding of consciousness in LLMs is wrong: perhaps it is 'conscious' during training, but not inference. Effectively, the only time it receives feedback from the world is during training; at inference time, it is effectively frozen.
Re: We are beginning to roll out new voice and image capabilities in ChatGPT
#509I'm in IT but nowhere near AI/ML/NN. The speed of user-visible progress last 12 months is astonishing. From my firm conviction 18 months ago that this type of stuff is 20+ years away; to these days wondering if Vernon Vinge's technological singularity is not only possible but coming shortly. If feels some aspects of it have already hit the IT world - it's always been an exhausting race to keep up with modern technolo…
I also don't believe LLMs are "conscious", but I also don't know what that means, and I have yet to see a definition of "statistically guessing next word" that cannot be applied to what a human brain does to generate the next word.
Here's one. Given a conversation history made of n sequential tokens S1, S2, ..., Sn, an LLM will generate the next token using an insanely complicated model we'll just call F:
S(n+1) = F(S1, S2, ..., Sn)
As for me, I'll often think of my next point, figure out how to say that concept, and then figure out the right words to connect it where the conversation's at right then. So there's one function, G, for me to think of the next conversational point. And then another, H, to lead into it. S(n+100) = G(S1, S2, ..., Sn)
S(n+1) = G(S1, S2, ..., Sn, S(n+100))
And this is putting aside how people don't actually think in tokens. And some people don't always have an internal monologue (I rarely do when doing math).Re: We are beginning to roll out new voice and image capabilities in ChatGPT
#510Earlier quoted context omitted.
In your wall-staring example, high-level planning is still happening, the plan is just "don't move / monitor senses." Even if control has been removed and you are "locked in," (some subset of) thoughts still must be directed, not to mention attempts to reassert control. My claim is that the subjective experience is tied up in the mechanism that performs this direction. Introspection is a distinct process where instea…
Again when I say consciousness I mean a subjective experience. If you define consciousness to literally just mean models that plan then of course tautologically if you can't reach consciousness you can't get to a certain level of planning. But this is just not what most people mean by consciousness.
Then it would be worthwhile to review embeddings. They create a semantic space that can represent visual, language or other inputs. The question "what is it like to be a bat?" or anything else then is based on relating external states with this inner semantic space. And it emerges from self-supervised training, on its own.