Artificial neural networks are making strides towards consciousness?
21–30 of 85 posts
Re: Artificial neural networks are making strides towards consciousness?
#22Earlier quoted context omitted.
Yes but that’s not necessarily progress towards consciousness.
I argue that the effectiveness of the matrix factorizations (creations of abstractions) in the embeddings points to the fact that the math works. Meaning, abstractions that are meaningful are created. Which is a building block of consciousness.
Re: Artificial neural networks are making strides towards consciousness?
#23Re: Artificial neural networks are making strides towards consciousness?
#24Queue the hacker news haters. As someone that works with neural networks on a daily basis, I am constantly stunned by the effectiveness of modern attention based NLP models. They actually work for real world tasks, and you don't need to be an expert in them to apply them. Not only that, the newer ones are drastically better than the ones only two years ago. These are the models released in public. The sheer amount of…
Because you don't have to pay them. They don't have feelings. They won't argue with you, and they don't have opinions.
Watch the collective losing of everyone's shit the first time something goes from somewhat quirky function simulator, to something that deigns to have a viewpoint seperate from the desired output.
Capitalism's core tenet is don't pay for anything you can possibly find a way not to (cost minimization).
Re: Artificial neural networks are making strides towards consciousness?
#25Earlier quoted context omitted.
The question being asked isn't "are language models really good?", though. It's "are language models (moving towards being) conscious?".
What's your definition of consciousness?
>In this view, consciousness isn’t a mysterious ghost in the machine, but merely the word we use to describe what it’s “like” to model ourselves and others.
>When we model others who are modelling us in turn, we must carry out the procedure to higher orders: what do they think we think? What might they imagine a mutual friend thinks about me?
While I certainly buy that this sort of modeling is one effective way to be good at the language modeling task, I am unconvinced that it is the only way, and thus the fact that the networks are undeniably very good at the language modeling task does not necessarily imply they are doing so through consciousness (as defined above), or something on the road to consciousness.
Re: Artificial neural networks are making strides towards consciousness?
#26Queue the hacker news haters. As someone that works with neural networks on a daily basis, I am constantly stunned by the effectiveness of modern attention based NLP models. They actually work for real world tasks, and you don't need to be an expert in them to apply them. Not only that, the newer ones are drastically better than the ones only two years ago. These are the models released in public. The sheer amount of…
Re: Artificial neural networks are making strides towards consciousness?
#27Ugh. You can’t say “strides towards consciousness” until you define consciousness AND have a metric that can provide objective measure of such things.
I don't see why this is true. Just because a thing is difficult to precisely define, doesn't mean it doesn't exist, nor does it mean you can't get closer to it. I could say that I'm "taking strides towards becoming a better person" and that could still have meaning, despite the lack of any objective measure and, even, with the understanding that "a better person" could change over time.
Re: Artificial neural networks are making strides towards consciousness?
#28Consciousness in an AI is merely a curiosity, not something to strive for.
Re: Artificial neural networks are making strides towards consciousness?
#29Ugh. You can’t say “strides towards consciousness” until you define consciousness AND have a metric that can provide objective measure of such things.
Which I wonder if we'll ever have as consciousness is a strictly subjective thing.
For example, you can try to imagine what it's like to be a dog, but it doesn't make much sense to ask what it's like to be a toaster.
What's it like to be an artificial neural network? I don't think that's valid, nor is there any good evidence that we're making progress.
Re: Artificial neural networks are making strides towards consciousness?
#30Would be awesome if they could also make strides towards a working fingerprint sensor on their flagship Pixel phones. The accuracy on my P6 is 30% on a good day.
Instead, some future Pixel phone will probably start feeling bad about it. ;)
>Not unnaturally, many elevators imbued with intelligence and precognition became terribly frustrated with the mindless business of going up and down, up and down, experimented briefly with the notion of going sideways, as a sort of existential protest, demanded participation in the decision-making process and finally took to squatting in basements sulking