Live data from Hacker News

LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

people.idsia.ch

11–20 of 95 posts

Re: LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

#11

It's him again. That must be enough to give context on who I am talking about. I do not know what to tell about him. Sure he has explored a lot of topic and never got the limelight like others. But I think it's time for him to stop gaslighting about other researchers just because they didn't cite his papers. Sure, they could have never read it. He can make his work shout by publishing better papers and better design.…

We are scientists and can use names. 'him' is Jürgen Schmidhuber. He's a luminary of ML, but he has entered into several attribution controversies. He famously accused Ian Goodfellow of appropriating his work to create generative adversarial networks (GANs) in a public venue (a NeurIPS workshop).

I agree with the parent comment. Ultimately, Science is about advancing the human condition more than celebrating great individuals. While I'm sympathetic to Schmidhuber's feelings he isn't given sufficient credit, he's still an internationally recognized, fully tenured professor.

Re: LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

#12
Lecun's post is not even a paper as stated in the foreward of the paper. But thanks for bringing it up, i will read it

> This document is not a technical nor scholarly paper in the traditional sense, but a position paper expressing my vision for a path towards intelligent machines that learn more like animals and humans, that can reason and plan, and whose behavior is driven by intrinsic objectives, rather than by hard-wired programs, external supervision, or external rewards. Many ideas described in this paper (almost all of them) have been formulated by many authors in various contexts in various form. The present piece does not claim priority for any of them but presents a proposal for how to assemble them into a consistent whole. In particular, the piece pinpoints the challenges ahead. It also lists a number of avenues that are likely or unlikely to succeed.

Re: LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

#13
background from the great Genius Makers history of ML:

The press needed heroes for its AI narrative. It chose Hinton, LeCun, Bengio, and sometimes Ng, thanks largely to the promotional efforts of Google and Facebook. The narrative did not extend to Jürgen Schmidhuber, the German researcher based on Lake Lugano who carried the torch for neural networks in Europe during the 1990s and 2000s. Some took issue with Schmidhuber's exclusion, including Schmidhuber. In 2005, he and Alex Graves, the researcher who later joined DeepMind, had published a paper describing a speech recognition system based on LSTMs-neural networks with short-term memory. "This is that crazy Schmidhuber stuff," Hinton had told himself, "but it actually works." Now the technology was powering speech services at companies like Google and Microsoft, and Schmidhuber wanted his due. After Hinton, LeCun, and Bengio published a paper on the rise of deep learning in Nature, he wrote a critique arguing that "the Canadians" weren't as influential as they influence would soon reverberate across the industry-Schmidhuber stood up in the audience and chastised him for not citing similar work in Switzerland from the 1990s. He did this kind of thing so often, it became its own verb-as in: "You have been Schmidhubered."

Re: LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

#14
post #11

It's him again. That must be enough to give context on who I am talking about. I do not know what to tell about him. Sure he has explored a lot of topic and never got the limelight like others. But I think it's time for him to stop gaslighting about other researchers just because they didn't cite his papers. Sure, they could have never read it. He can make his work shout by publishing better papers and better design.…

We are scientists and can use names. 'him' is Jürgen Schmidhuber. He's a luminary of ML, but he has entered into several attribution controversies. He famously accused Ian Goodfellow of appropriating his work to create generative adversarial networks (GANs) in a public venue (a NeurIPS workshop). I agree with the parent comment. Ultimately, Science is about advancing the human condition more than celebrating great in…

Well said.

Attribution is important but it's impossible to know all the literature that is out there and even when you've tried your best to seek out prior arts there is always a possibility that you've missed something or not understood the connection with something previously read. Heck even when something is similar you may not cite it since it's so old the relevance is no longer there for a working research paper.

I've always thought that Schmidhuber was toxically uncharitable - what is the point of accusing and blaming? If someone has a similar idea to mine I'd celebrate them, seek to collaborate and encourage. Wouldn't that mean your research program is getting advanced for free! Heck you should thank them for doing your work for you.

Re: LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

#15

background from the great Genius Makers history of ML: The press needed heroes for its AI narrative. It chose Hinton, LeCun, Bengio, and sometimes Ng, thanks largely to the promotional efforts of Google and Facebook. The narrative did not extend to Jürgen Schmidhuber, the German researcher based on Lake Lugano who carried the torch for neural networks in Europe during the 1990s and 2000s. Some took issue with Schmidh…

Reading some Schmidhuber's writings on this issue is a great way to learn the history and development of AI and ANN's that is often missed. At the same time Schmidhuber's tone and anal-retentive attitude explains why he is considered so annoying.

The field is full of huge egos and overly simplified narratives from a singular point of view.

For example, it's true that Hinton was a torchbearer of neural networks for several decades and was off mainstream. That gives him well earned legendary status. But it's also true that other methods worked better until early or mid 2000s and had more rigorous theory behind it (theory behind older methods is still better, nn is still mostly experimenting and wandering). Hinton also had position and funding to do pioneering research and collect students all over the world. I remember reading his product of experts paper as a student in 2002 when I worked with boosting and bagging, so clearly he was not completely out of sight.

Re: LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

#17

It's him again. That must be enough to give context on who I am talking about. I do not know what to tell about him. Sure he has explored a lot of topic and never got the limelight like others. But I think it's time for him to stop gaslighting about other researchers just because they didn't cite his papers. Sure, they could have never read it. He can make his work shout by publishing better papers and better design.…

>Sure he has explored a lot of topic and never got the limelight like others. But I think it's time for him to stop gaslighting about other researchers just because they didn't cite his papers.

I can't believe you're defending academic plagiarism. His papers were not obscure, they were foundational. So what if he has a bad attitude; you would too if people kept stealing your ideas without giving you any credit.

Re: LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

#18
post #11

It's him again. That must be enough to give context on who I am talking about. I do not know what to tell about him. Sure he has explored a lot of topic and never got the limelight like others. But I think it's time for him to stop gaslighting about other researchers just because they didn't cite his papers. Sure, they could have never read it. He can make his work shout by publishing better papers and better design.…

We are scientists and can use names. 'him' is Jürgen Schmidhuber. He's a luminary of ML, but he has entered into several attribution controversies. He famously accused Ian Goodfellow of appropriating his work to create generative adversarial networks (GANs) in a public venue (a NeurIPS workshop). I agree with the parent comment. Ultimately, Science is about advancing the human condition more than celebrating great in…

>Ultimately, Science is about advancing the human condition more than celebrating great individuals.

Giving proper credit to prior work is a fundamental component of scientific progress. Just look at the Chinese academic system to see what happens to science when people are given free reign to plagiarise.

Re: LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

#19
post #11

Earlier quoted context omitted.

We are scientists and can use names. 'him' is Jürgen Schmidhuber. He's a luminary of ML, but he has entered into several attribution controversies. He famously accused Ian Goodfellow of appropriating his work to create generative adversarial networks (GANs) in a public venue (a NeurIPS workshop). I agree with the parent comment. Ultimately, Science is about advancing the human condition more than celebrating great in…

Well said. Attribution is important but it's impossible to know all the literature that is out there and even when you've tried your best to seek out prior arts there is always a possibility that you've missed something or not understood the connection with something previously read. Heck even when something is similar you may not cite it since it's so old the relevance is no longer there for a working research paper…

>Attribution is important but it's impossible to know all the literature that is out there and even when you've tried your best to seek out prior arts there is always a possibility that you've missed something or not understood the connection with something previously read.

It's not like Schmidhuber's papers are obscure.

>I've always thought that Schmidhuber was toxically uncharitable - what is the point of accusing and blaming

You're engaging in toxic victim-shaming. What, you expect him to just bend over and accept people stealing his ideas without giving him credit? Fundamentally the researchers who stole from him were engaging in unethical behaviour and shouldn't be allowed to get away with that without consequence.

Re: LeCun's 2022 paper on autonomous machine intelligence does not cite prior work

#20

background from the great Genius Makers history of ML: The press needed heroes for its AI narrative. It chose Hinton, LeCun, Bengio, and sometimes Ng, thanks largely to the promotional efforts of Google and Facebook. The narrative did not extend to Jürgen Schmidhuber, the German researcher based on Lake Lugano who carried the torch for neural networks in Europe during the 1990s and 2000s. Some took issue with Schmidh…

In my opinion the difference that Hinton students made was using GPUs to run deep learning models. First in 2010, when publishing Theano at NIPS, making deep learning on a single computer node with a large GPUs very approachable ( using a Python framework, precursor to TensorFlow). Then in 2012, with Alex Krizhevsky masterfully using two GPUs to build the landmark model AlexNet, which outperformed traditional computer vision models and was easy to use in practice.
Post reply on HN