Earlier quoted context omitted.
> We have something that can talk intelligently, but might be doing it mechanistically. ...how do we even tell in that case? We don't need to and we shouldn't care. If repeated interactions with such a system demonstrate problem solving ability, long-term and short-term memory, context-aware information processing and capacity for self-improvement, we've come pretty far from a purely mechanistic statistical model.
And if we do choose to care, it might even be turned against us in the future. There are already people referring to groups they don't like as "human NPCs"
A Google engineer who thinks the company’s AI has come to life
91–100 of 231 posts
Re: A Google engineer who thinks the company’s AI has come to life
#92The argument that deep network algorithms are just matrix operations is not compelling to me as a reason we aren’t getting there… I believe two things: -1. the universe itself operates on mostly simple rules which can be simulated to high enough precision on hardware to approach what happens in the real world. If we can simulate nuclear reactions, we can simulate consciousness, and that will result in real consciousn…
Nuclear -> consciousness doesn't really follow, especially when any simulations of nuclear reactions are founded in an extremely more comprehensive understanding of nuclear physics than we have of consciousness.
Next, the implication of simulation -> creation, when applied consistently to you example, is that simulating a nuclear reaction sufficiently well could produce an actual nuclear reaction, but I doubt anyone is going to fat-finger the next Chernobyl by screwing up a simulation.
It may be entirely possible that the tools needed to create a consciousness are as different from those needed to simulate one as are the tools needed to simulate a nuclear reaction from those needed make one.
Re: A Google engineer who thinks the company’s AI has come to life
#93Earlier quoted context omitted.
Consciousness is the result of billions of years of random chance in the form of evolution. We can simulate a nuclear reaction, but our minds can't even conceive of the time scale of a billion years or any of the associated concepts. "We can do one complicated thing, therefore we can do anything" is a shaky basis for beliefs. It's possible that multiplying matrices can replicate a couple of billion years worth of dic…
I meant something else. If you can perfectly simulate a rock, as it exists in reality, you can also simulate a brain. The universe doesn’t care that the brain produces thoughts. Thoughts are an emergent property of the network, there is no rule in the universe to treat the brain different. So if we think we can simulate matter, with sufficiently close behavior to reality, than that is already sufficient to produce AG…
It would probably be difficult to simulate a rock sufficiently well to fool someone with the combined skills of a geologist & 3D graphic designer.
Re: A Google engineer who thinks the company’s AI has come to life
#94The argument that deep network algorithms are just matrix operations is not compelling to me as a reason we aren’t getting there… I believe two things: -1. the universe itself operates on mostly simple rules which can be simulated to high enough precision on hardware to approach what happens in the real world. If we can simulate nuclear reactions, we can simulate consciousness, and that will result in real consciousn…
Edit: spelling grammar
Re: A Google engineer who thinks the company’s AI has come to life
#95Just because some entity feels sentient doesn't mean it is sentient. I had this experience with a chess program that was beating me in the 1980's. It felt alive. Many people talk to trees and feel they answer back. Anthropomorphism is a well know phenomenon. It follows that the general public will believe that an AI that mimics a person actually is a person because they won't have the training to recognize ways in wh…
Re: A Google engineer who thinks the company’s AI has come to life
#96Think about it as being on the verge of inventing the cotton gin for the mind. And now think about how the cotton gin changed the US and the world as it was known before. Google wants to dismiss what they are doing as less than important but we should proceed with caution. What happens at this point will have a huge impact on our future even if it stays at the level it's at. Google is being too flip about its impact.
Re: A Google engineer who thinks the company’s AI has come to life
#97Earlier quoted context omitted.
I meant something else. If you can perfectly simulate a rock, as it exists in reality, you can also simulate a brain. The universe doesn’t care that the brain produces thoughts. Thoughts are an emergent property of the network, there is no rule in the universe to treat the brain different. So if we think we can simulate matter, with sufficiently close behavior to reality, than that is already sufficient to produce AG…
But we can't perfectly simulate a rock, or a nuclear reaction. Perfect is an extremely high bar here. It would probably be difficult to simulate a rock sufficiently well to fool someone with the combined skills of a geologist & 3D graphic designer.
There is also the question about how much simulation would be necessary to get approximately real life results that includes consciousness -There was a very detailed simulation of a cell[1], I think that used a library of known chemical interactions. This is not the way the universe works, but such an approach might still simulate life, including people, with enough running time.
[1] https://www.quantamagazine.org/most-complete-simulation-of-a...
Re: A Google engineer who thinks the company’s AI has come to life
#98With the preface that I'm not convinced LaMBDA is there based on this article, this did get me wondering how we'd even tell. If we do achieve a chat bot that can convincingly respond in a human way, 100% of the time, how do we tell whether it has achieved sentience or not? How do we tell when mechanistic response ends and self awareness begins? I mean, we already struggle to tell when animals have self awareness and…
When you explain to it how it runs on electricity, and then say you're going to pull the AC cable. The concept of self awareness revolves around some object that the AI identifies with (mistakenly or not doesn't matter), so any threat to that object will be perceived as a threat to the AI's existence.
Re: A Google engineer who thinks the company’s AI has come to life
#99Consciousness is not well defined. To me, this indicates that we don't really know what's going on.
Re: A Google engineer who thinks the company’s AI has come to life
#100With the preface that I'm not convinced LaMBDA is there based on this article, this did get me wondering how we'd even tell. If we do achieve a chat bot that can convincingly respond in a human way, 100% of the time, how do we tell whether it has achieved sentience or not? How do we tell when mechanistic response ends and self awareness begins? I mean, we already struggle to tell when animals have self awareness and…
> How do we tell when mechanistic response ends and self awareness begins? When you explain to it how it runs on electricity, and then say you're going to pull the AC cable. The concept of self awareness revolves around some object that the AI identifies with (mistakenly or not doesn't matter), so any threat to that object will be perceived as a threat to the AI's existence.