Earlier quoted context omitted.
Funny ... According to [1], the papers [42,43] showed that plain backprop was capable of solving complex tasks without pretraining on a GPU. From [1]: > Our team then showed that good old backpropagation [A1] on GPUs (with training pattern distortions [42,43] but without any unsupervised pre-training) I can't verify since I have a barely stable connection and little battery, but somebody else should be able to. [1] h…
Sorry what's your contention? or do you have one? Backprop is backprop on CPU or GPU - it just runs (way) faster on GPU. So while you can do some stuff with NN's on CPU, you can do more stuff with NN's on GPU. Further, the sources you reference are from before advances made in software and hardware for massively parallel GPGPU architectures (CUDA), so it's kind of a moot point anyways. Those researchers may have had…
Time of publication. I merely pointed that Schmidhuber et al's results were published long before Hinton et al's work (I included year of publication for a reason), ergo the comment that was in support of Hinton was refuted and my comment gives further validity to Schmidhuber's claims of misattribution and plagiarism, while pointing at yet another paper tiger in the claims that the three pioneered the field.
If anything, Schmidhuber may have deserved a Turing award on his own, and what we see is the result of politics.
This is pure speculation, but to me the whole ordeal hints at manipulation from the companies where 2 of the 3 worked at, which would essentially increase the pool of candidates the respective companies have only by association with their employee.