LLM are definitely not sentient. As someone with a PhD in this domain, I attribute the 'magic' to large scale statistical knowledge assimilation by the models - and reproduction to prompts which closely match the inputs' sentence embedding. GPT-3 is known to fail in many circumstances which would otherwise be commonplace logic. (I remember seeing how addition of two small numbers yielded results - but larger numbers…
Is an inability to add large numbers together evidence against sentence? Because if so, I have bad news for about 90% of people alive
Google fires engineer who called its AI sentient
441–450 of 749 posts
Re: Google fires engineer who called its AI sentient
#442LLM are definitely not sentient. As someone with a PhD in this domain, I attribute the 'magic' to large scale statistical knowledge assimilation by the models - and reproduction to prompts which closely match the inputs' sentence embedding. GPT-3 is known to fail in many circumstances which would otherwise be commonplace logic. (I remember seeing how addition of two small numbers yielded results - but larger numbers…
> As someone with a PhD in this domain you dont need to use phd credentials to have an opinion on this matter
(If I was credentials hopping I would rather put a longer list of illustrious institutions, co-authors and awards, just saying. I am not - its just justifying that I know reasonably enough to share a sane opinion, which you may or may not agree with)
Re: Google fires engineer who called its AI sentient
#443Earlier quoted context omitted.
You should check out the YouTube of the cat that was trained to use buttons to speak. It sometimes says things that are surprising which it wasn't trained to say directly - like complaining that its owners music is bad. I realize that this isn't contradicting your thesis of language models not being conscious - but I just generally think people should check out things like that cat. So I'm not trying to disagree with…
I already have, and I'm considering trying it out with my own cat at some point. Cats are way more intelligent than people give them credit for, I agree. But I think you can get very far without the ability to turn the mind's eye inward, and I don't think it's controversial to state that cats don't have a great deal of self-awareness and metacognitive ability. Neosocial insects like ants are amazing indeed. I often w…
I thought this quote was about the octopus that correctly predicted the outcome of games in a FIFA world cup. But seems it was something else?
Re: Google fires engineer who called its AI sentient
#444Earlier quoted context omitted.
Thanks for clarifying. I think the question is more about sentience than ML. So, a PhD in philosophy would suit better your initial claim.
No it would not. Philosophy people wrap themselves up in so many circular self justifying presuppositions that they can make up whatever arguments they want to justify almost anything. It is much better to listen to people who study other, more falsifiable claims, in the material world.
As a field of study, sentience has been a topic of philosophy more than ML. That’s why top-level comment’s claim of having a PhD in “this domain” is not apt. Comparative quality of studies in different domains is a different question.
Re: Google fires engineer who called its AI sentient
#445LLM are definitely not sentient. As someone with a PhD in this domain, I attribute the 'magic' to large scale statistical knowledge assimilation by the models - and reproduction to prompts which closely match the inputs' sentence embedding. GPT-3 is known to fail in many circumstances which would otherwise be commonplace logic. (I remember seeing how addition of two small numbers yielded results - but larger numbers…
Is an inability to add large numbers together evidence against sentence? Because if so, I have bad news for about 90% of people alive
Re: Google fires engineer who called its AI sentient
#446Earlier quoted context omitted.
> Objectively, Zeus does not exist Speaking as a theoretical physicist: we don't know that. What we do know is we have a better explanation for lightning within a conceptually simple framework (starting from a few simple principles) with predictive power, compared to an explanation that involves some mysterious old dude doing mysterious things with no evidence whatsoever. Could Zeus or Thor or whatever exist? Sure; t…
Issue is that we don’t need it to explain humans either. Most people think that a human is sentient and a rock isn’t – but humans and rocks are both atoms bouncing around, so you need an explanation for what’s different. I think most physicists think that if you started with a description of the positions and velocities etc of all the particles in a human, and put them into a supercomputer the size of the moon, and h…
Just created a throwaway to reply to this. As a trained therapist (currently working in another field), with a degree in psychology, this seems... Seriously ill informed. Do physicists really think this?
Imagine you create your perfect simulated human, that responds according to the exact phenotype of the person you're simulating. Lets remember you'll have to either duplicate an existing person, or simulate both the genotype and the in-vitro environment (especially the mix of uterine hormones) present for the developing foetus. Now you have to simulate the bio, psycho, social environment of the developing person. Or again, replicate an existing person at a specific moment of their development - which depending on which model of brain function is correct may require star trek transporter level of functional neuroimaging and real time imagining of the body, endrocrhine system etc.
So lets assume you can't magically scan an existing person, you have to create a believable facsimile of embodiment - all the afferent and efferent signals entering the network of neurons that run through the body (since cognition doesn't terminate in the cortex). You have to simulate the physical environment your digital moon child will experience. Now comes the hard part. You have to simulate their social environment too - unless you want to create the equivalent of a non-verbal, intellectually disabled feral child. And you have to continually keep up this simulated social and physical environment in perpetuity, unless you want your simulated human to experience solitary psychosis.
This isn't any kind of argument against AGI, or AGI sentience by the way. It's just a clarification that simulating a human being explicitly and unavoidably requires simulating their biological, physical and social environment too. Or allowing them to interface with such an environment - for example in some kind of biological robotic avatar that would simulate ordinary development, in a normative social / physical space.
Re: Google fires engineer who called its AI sentient
#447Everyone seems to be focussing on the debate about sentience, but iirc he was fired for breaching the employee confidentiality policy by talking to the media without approval. My understanding is a normal employee talking to the press about commercially confidential matters against policy and without approval would only have protection from retaliation under certain pretty narrow "whistleblower" public interest carve…
Everyone’s focusing on that because they want to discuss the interesting bit - is it sentient. What you’re pointing out is true, but not really interesting to discuss because everyone already knows that and it’s not that controversial. (For limited values of everyone. Obvi not all readers actually know that.) I mean, it could be interesting to discuss a more European style of employment where he couldn’t be fired for…
As a French person employed by a French Company, I can assure you that a regular employee talking to the media without the proper chain of approval is a fire-able offence (without any severance). Especially if your comments are not a glowing praise of the company.
Re: Google fires engineer who called its AI sentient
#448LLM are definitely not sentient. As someone with a PhD in this domain, I attribute the 'magic' to large scale statistical knowledge assimilation by the models - and reproduction to prompts which closely match the inputs' sentence embedding. GPT-3 is known to fail in many circumstances which would otherwise be commonplace logic. (I remember seeing how addition of two small numbers yielded results - but larger numbers…
> ELIZA came out few decades ago Like, 6. It's just amusing how old this example is. The Mechanical Turk was much much older - but easily shown to be a person hiding in the mechanism. I think ELIZA was in some sense a mirror, reflecting back consciousness, and that's the feeling we get from these systems.
Re: Google fires engineer who called its AI sentient
#449Re: Google fires engineer who called its AI sentient
#450Earlier quoted context omitted.
As a fellow sentient being with absolutely zero credentials in any sort of statistical modeling field, I can simply disagree. And therein lies the problem. How can anybody possibly prove a concept that depends almost entirely on one’s philosophical axioms… which we can debate for eternity (or at least until we further our understanding of how to define sentience to the point where we can do so objectively enough to f…
I think the actual firing is very objective. He was under NDA but violated it. They reminded him to please not talk in public about NDA-ed stuff and he kept doing it. So now they fired him with a gentle reminder that "it's regrettable that [..] Blake still chose to persistently violate [..] data security policies". And from a purely practical point of view, I believe it doesn't even matter if Lemoine's theory of sent…
> Also, we as society have already chosen how to deal with sentient beings, and it's mostly ignorance.
The Orville Season 3 Episode 7 is about that theme. Highly recommend it.