Just watched the nobel prize live stream, surprised by the topic, looks very engineering to me rather than physics, do algorithms make physics subsidiary?
[deleted]
Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
421–430 of 876 posts
Re: Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
#422I suppose LeCun and Bengio are way too young for a Nobel prize these days[0]
Re: Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
#423Did Hinton win for the restricted Boltzmann machine? I believe Paul Smolensky has some priority with the Harmonium, but Hinton certainly deserves it. But worth reading Smolensky’s paper, it is a classic!! https://stanford.edu/~jlmcc/papers/PDP/Volume%201/Chap6_PDP8...
I don't see a date in the PDF. When was it written?
Re: Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
#424Earlier quoted context omitted.
Except that the development of deep neural networks took direct inspiration biological neuroscience with neurons and synapses. Neural is even in the name. https://en.wikipedia.org/wiki/Deep_learning
It was a source loose of inspiration for sure, but it still have nothing to do with neurosciences. “Neural” network are as close to actual nervous system as the “Democratic” Republic of Korea is to democracy.
>nothing to do with
So what is the meaning of to do with and nothing to do with? Inspiration seems to be a relationship.
Consider a different relationship between cellular biology and the Cells at Work anime. Clearly any relationship is unidirectional. Any cellular biology learns nothing from the anime, but the anime wouldn't exist without cellular biology.
Do we say the show has nothing to do with cellular biology? That doesn't seem right to me, given it depends upon it despite taking an amazing degree of artistic freedom.
Re: Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
#425I suppose LeCun and Bengio are way too young for a Nobel prize these days[0] [0] https://www.ageing.ox.ac.uk/images/fig01.jpeg
No, these are the proper laureates (for that topic anyways, whether the topic is appropriate in the first place is another matter). LeCun and Bengio's works are undoubtedly immensely impactful, but there's no denying that they are standing on shoulders of giants.
Re: Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
#426Earlier quoted context omitted.
You're mistaken. The perceptron was invented by Rosenblatt, a psychologist. This field has deep roots in neuroscience.
People always repeat these stupid things like they're lore. Ok let's suppose this is true. What else is true is that neurology itself was inspired by phrenology and the practice of exorcisms. Should we now start recognizing and exalting those connections given how divorced modern (useful!) neurology is?
Major distinction given those practices have been abandoned as pseudo science or even worse, so they aren't fields of science continued to be developed which further useful connections might be found.
In psychiatry, there is a certain amount that we continue to study social standards of normalcy in other (including historic) societies to determine what should count as a mental disorder, but more to make sure we aren't doing a 21st century equivalent of labeling something as a demon possession because it contrasts with our current deeply held social norms.
Re: Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
#427Re: Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
#428A profound moment where physics, neuroscience and artificial intelligence intersect.
very little to do with neuroscience
At the very least neuroscience provides an "existence proof". Somehow this stuff must be possible using some sort of trained machine comprising a large number of simple components...
Re: Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
#429[flagged]
Re: Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton [pdf]
#430I suppose LeCun and Bengio are way too young for a Nobel prize these days[0] [0] https://www.ageing.ox.ac.uk/images/fig01.jpeg
No, these are the proper laureates (for that topic anyways, whether the topic is appropriate in the first place is another matter). LeCun and Bengio's works are undoubtedly immensely impactful, but there's no denying that they are standing on shoulders of giants.
Schmidhuber enters the room and has lots of things to say.