61–70 of 102 posts
Quite incredible that he was interested in NNs back in 1990. He closed this thread very well.
An underappreciated aspect of this is finding an academic department that would allow you to submit something this concise as a senior thesis. My experience, mostly in grad school, was that anyone editing my work wanted more verbiage. If you only needed a short, one-sentence paragraph to say something, it just wasn’t accepted. There had to be more. Jeff Dean is an uncommonly good communicator. But he also benefited f…
It's kind of remarkable. There really is no literature review in this paper. As a supervisor I would have no problem with a content part of this length, but I would also insist on doing the scholarly work that is not demonstrated here. Don't just throw out some code and describe it but put it into the context of what exists. Give credit to where ideas originate. That shouldn't add too much. No more than a few pages.…
Earlier quoted context omitted.
It's kind of remarkable. There really is no literature review in this paper. As a supervisor I would have no problem with a content part of this length, but I would also insist on doing the scholarly work that is not demonstrated here. Don't just throw out some code and describe it but put it into the context of what exists. Give credit to where ideas originate. That shouldn't add too much. No more than a few pages.…
From the readers perspective, what would be the point?
Earlier quoted context omitted.
It's kind of remarkable. There really is no literature review in this paper. As a supervisor I would have no problem with a content part of this length, but I would also insist on doing the scholarly work that is not demonstrated here. Don't just throw out some code and describe it but put it into the context of what exists. Give credit to where ideas originate. That shouldn't add too much. No more than a few pages.…
That seems to be a key difference between science and engineering. One likes to survey the field and insist that their paper offers something novel - no matter how big or small. The other just wants to do some solid work and get the results.
Quite incredible that he was interested in NNs back in 1990. He closed this thread very well.
Lots of good work with neural networks was done back then:
A learning algorithm for Boltzmann machines
DH Ackley, GE Hinton, TJ Sejnowski - Cognitive science, 1985
Learning representations by back-propagating errors
DE Rumelhart, GE Hinton, RJ Williams - nature, 1986
Phoneme recognition using time-delay neural networks
A Waibel, T Hanazawa, G Hinton, K Shikano, KJ Lang - Readings
in speech recognition, 1990An underappreciated aspect of this is finding an academic department that would allow you to submit something this concise as a senior thesis. My experience, mostly in grad school, was that anyone editing my work wanted more verbiage. If you only needed a short, one-sentence paragraph to say something, it just wasn’t accepted. There had to be more. Jeff Dean is an uncommonly good communicator. But he also benefited f…
I have in the past been subadvisor to various bacc. theses. I value conciseness dearly, and prefer quality over quantity in scientific writing, i.e. I would accept incredibly short theses, if the content is sufficiently presented (reproducible and comprehensive), and most of all, contains a valuable contribution. The reason I typically have to request "more verbiage" and an own section on the state of the art, is bec…
It's strange to expect an undergrad to do new and interesting work when they haven't even finished their basic education in the field. Solve problems that are easy but not important enough for professional academics, sure. Do an application of a standard idea in a specific environment (like porting an pp to Android), sure. But not new approaches to the field.
An underappreciated aspect of this is finding an academic department that would allow you to submit something this concise as a senior thesis. My experience, mostly in grad school, was that anyone editing my work wanted more verbiage. If you only needed a short, one-sentence paragraph to say something, it just wasn’t accepted. There had to be more. Jeff Dean is an uncommonly good communicator. But he also benefited f…
> anyone editing my work wanted more verbiage I _never_ got that feedback. My mentors all emphasized economy of language and nobody cared how "thick" my thesis was. This is a pretty amusing story about verbiage. Back in the old days, you would send a manuscript/research article to colleagues/friends by _snail-mail_ to get their feedback. You'd wait a month, and maybe they would mail a 'red-inked' copy of your manuscr…
So this puts the reviewer in a situation with misaligned incentives. They might prefer to tell you to prioritize concise communication, but believe the risk is high that such a thing will get vetoed by the committee for Dilberty reasons, and thus their feedback gets optimized for what the committee will superficially think.
When the committee is mostly attentive professors, this isn’t so bad and everybody is aligned on short, to-the-point style.
But my experience is that this is hardly true. Maybe one committee member will be an attentive technical authority, sometimes only your advisor. The others will be deans or directors of various sorts who view it as an administrative chore to even have to sign off, and probably farm that review out to grad students or adjuncts, who are far more likely to take a capricious point of view about e.g. heavy literature review or conclusion sections.
Quite incredible that he was interested in NNs back in 1990. He closed this thread very well.
Interesting coding style with too much whitespace. Is it some standardized pattern? I found something similar in the code written by John Carmack.
Earlier quoted context omitted.
Lots of people get accepted to fancy-ass schools but then can't afford to attend, and state schools will bend over backwards to get those people.
Is this still true? Most of the top schools today appear to have pretty generous aid compared to my undergrad, which was a state school. Only exception I can think of could be out of state public schools like Berkeley or Georgia Tech or CMU.