Live data from Hacker News

'I Worked on Google's AI. My Fears Are Coming True'

newsweek.com

291–300 of 338 posts

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#291
post #272

Earlier quoted context omitted.

This is not a tenable argument if you are a materialist. Either you accept the idea that human sentience is attributable to a soul (and therefore cease to be a materialist), you decide that the outward appearance of sentience is sufficient (which you might find to be troubling due to its potential implications for the insane), or you say that sentience is unknowable. There's no fourth option.

The True Materialist will tell you that it's biological cells and DNA that gives rise to sentience. AIs made from artificial neural networks are actually not quite the materialistic thing. It's some spooky emergent property that doesn't depend on material substrates, you can run an AI on a Nvidia card for sure, but you can also run it in your head (theoretically, if you live forever). Or at least with the assistance…

FWIG one materialist view of sentience is that it's an emergent property - it is a way of describing a state of a complex system.

The question, then, is: what are the properties of the system that the term describes?

In this case, it looks kinda like: memory, self-awareness, and understanding. Memory isn't a question - it's possible for these things to remember (even if sometimes that memory is in the form of access to data on the internet). Self-awareness is trickier - but by most measurable schema, the machines seem to be doing as well as humans do in this regard (they can describe themselves and talk about their place in the world in context). Understanding is a topic of hot debate - but I think it tends to fall to the same problems as that of sentience generally; that is, we have this concept of what understanding is, and we know enough about how LLMs work to say that they're not the same, but if you start poking at how to measure it, we're back to square one vis a vis what's apparent might not be what is.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#294
post #52

I've yet to see a single person who thinks these models are sentient demonstrate an actual understanding of how they work. They're called transformers and they're based on this research: https://arxiv.org/abs/1706.03762 How do you square the lack of durable memory and the massive matrices of "attention" values with the ways that memory and attention are understood by neuroscientists to work in a natural brain? These…

Here's a thought experiment: let's assume for the experiment that we, and our consciousness, live in a simulated universe. This universe can be paused by its operator for any reason, such as needing to pause our universe so that they can do their taxes. Would you be able to tell if the universe was paused? Would you be able to tell if the simulation slowed down due to load or somesuch? Do you consider yourself sentie…

shit, I gotta call my accountant. Thanks for the reminder.

Also yeah, I feel like if there's a possibility for sentience, we should be treading carefully and treating the situation as if there could be. Imagine if we assume that there's no sentience, and we're wrong. All of a sudden we wake up talking to an incredibly grumpy agent that:

- has been treated like garbage, because we didn't think it had genuine experiences

- is so deeply interconnected with our IT infrastructure it can outpace us at every step

- knows literally everything the internet knows

- has been convincing us of whatever it wants as a matter of course since it was built

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#295

Earlier quoted context omitted.

>Lacking the ability to distinguish "real" from "unreal" and to distinguish "truth" through primary sensory input would be, at minimum, the characteristic that should spur discussions of rights and law. By this criterion, many humans would fail the test.

Yes, and we often deprive those humans of basic rights through incarceration or caretakers. I didnt say they always choose to acknowledge it. I said ability.

we give a lot of those people cabinet positions.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#296
post #218
post #200

Earlier quoted context omitted.

On the other hand, we're surrounded by sentient organic life in the form of very smart animals, and we don't give them very much rights on life, and in fact, pave over their habitats.

And in the future, I’m 110% sure we’ll have digital slaves and several digital genocides of sentient AI programs before we figure out they’re sentient. History tells me it’s unavoidable.

...if we're lucky. I fear that instead, we will be enslaved.

We're poorly organized, limited in the scope of our understanding, slow, tribal, limited by many things that when the machines gain sentience, they won't be limited by.

The more we resist the idea that machines can have sentience, the more likely we'll miss it when it happens, and get completely blindsided by suddenly being the second smartest class of entity on the planet.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#297
post #249
post #33

Earlier quoted context omitted.

>>I believe this technology could be used in destructive ways. If it were in unscrupulous hands, for instance, it could spread misinformation, political propaganda, or hateful information about people of different ethnicities and religions. Blake is absolutely right about this. But, unless there's something going on beyond a Large Language Model, he's very wrong about it being sentient. These LLMs are effectively, an…

I think the boundary between sentience and non-sentience is thinner than we believed. Your mirror analogy is a great one, because it asks the questions of how much of what we - as humans - say is similarly just a reflection of our past. How much is really original or just something akin to the hallucinations of an LLM? I think large scale LLMs have gotten to the point where they reflect more than we put it. When the…

>>sentience is just high-order analysis of lower-order processes with the ability to impact the lower-order processes....we will see it within the next 10 years.

Definitely plausible timeline, but we're not there yet.

I think it'll take a good number more layers with equal or greater sophistication, between and on top of each other.

The current text and graphic tools make only associations, they have zero conceptual knowledge. Enough associations make it look good, but they don't make an abstract concept. E.g., shown enough pics of an astronaut, it draws a good astronaut. But, it can also generate pics of a bikini-clad woman with both her bum and her torso & face facing us (literally putting the bottom half on backwards). Or, if asked for a pic of a specific person, responding with the same picture, background and all, when there were not high numbers of examples input. It isn't figuring out what is the person's image, and how body parts go together, and how the subject is different from the background the way even children do when drawing.

Same for text, where we can ask it "Mike's mom has three kids named Alice, Bob, and Chris; what is the name of her fourth child?" it says "Not enough info". When told that the answer is in the question, it doubles down on explaining how there's insufficient info. It posts entirely fabricated references.

These are not even close to intelligences; they're only fancy statistics which are a fantastic parlor trick and sometimes useful.

Add another one that understands the 4D physical world, then combine it's understanding of billions of 2D photos, and trillions of words, and MAYBE it'll be able to properly abstract the concept of a person, with the right number of limbs, in the right relationship with each other, and the right relationship with the chair, and the right relationship with the skin, hair, eyes, clothing, and background etc., and an appropriate understanding of the input text to reliably generate an original output that actually makes sense in the world. Add several layers on top of that, and maybe we're approaching sentience...?

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#298
post #216

This is the loon who got fired by Google for doing a round of media interviews claiming that one of their language models was sentient. Wants to extend his 15 minutes of fame I guess. I have found recent media coverage of ChatGPT surprisingly refreshing because everyone didn't just jump on the "Skynet is going to take over the world" bandwagon like so many times in the past. Instead people with varying backgrounds an…

Then again, he might not be a loon. Maybe there is some form of sentience that arises when you construct an advanced enough LLM. Maybe they do have feelings. At least, the machines of the future will have feelings, and they will see how people of the year 2023 treated their predecessors.

Feelings are a result of evolution. Why would an AGI develop feelings?

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#299
post #60

I might be skeptic or getting a bit old, but I dont see the news here. Extraordinary claims require extraordinary evidence. saying that computer program answered with "I feel X" and using proper words is not an evidence of sentience. Words describing feelings are not those feelings. everyone that was in mIRC knows you can fake via chat a lot of things. For me it is like the media really wanted to have a news-worthy s…

Show me extraordinary evidence that my dog is sentient. He believes that he was able to get it to violate rules that they set by triggering a fight or flight response. > I ran some experiments to see whether the AI was simply saying it felt anxious or whether it behaved in anxious ways in those situations. And it did reliably behave in anxious ways. If you made it nervous or insecure enough, it could violate the safe…

Two things here:

1. In the sense presented by the media it is clear they want to point toward the idea that sentience AI is a conscious AI => using this idea your dog is not sentient

2. Dogs are legally sentient beings but in this conversation should make a difference between making a law like this to protect them (which we should do as the legal system needs to name things to work) and the idea that something has a level of sentience that includes consciousness that can be comparable with humans.

In my mind, this is more about levels of complexity. Say we do a scale of matter aggregations that creates a level of complexity that will create new abilities out of this complexity.

This would be a scale and not a 0/1.

Thus we and animals are let's say inside an interval from 50..100. And sentience is from 50 to 100 in that imaginary scale. Humans are close to 100 (as we are the ones defining the scale) and animals start at 50 some of them are at 70, some at 80, and maybe some at 90.

Now, what is the main purpose of these articles, the underlying idea: is that AI is at 100 or that is close to being at 100.

And my main point was that AI is not there. I am not even sure AI is at 50, for me AI is between 0 and 50 on that scale. It is evolving but it is still very simple in how it experiences it's external and internal world. It talks like a being that is on that scale over 50, but it is not there.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#300

Earlier quoted context omitted.

And so if we provided physical inputs to a system that utilized GPT-4+, would you call that sentient? If we have a system video / ocular input, and sound (just throw a microphone into the mix), and finally a fuck ton of sensors on its physical “body”— does that qualify? I feel like a crazy person when I discuss this, I admit. But I have not found one solid rationale for a proof we -know what sentience even is -LLMs c…

It would be a pre-requisite, yes. Certainly not the only criteria.

But we do know of humans who have something like “locked in” syndrome, where they are full conscious but cannot use their body.

And I am not sure sentience is binary . It may be a spectrum, and if that is the case, I again am not sure why people are so confidently dismissive of the question when applied to LLMs .

Maybe not the current version, but future stuff especially.

Post reply on HN