Live data from Hacker News

Geoffrey Hinton has joined Google

plus.google.com

71–80 of 102 posts

Re: Geoffrey Hinton has joined Google

#71
post #48

Earlier quoted context omitted.

Google simply hasn't been around long enough to earn the kind of credibility that Bell Labs and Xerox PARC had.

So when is the last time that PARC or Bell Labs produced anything of note? Seriously. 15 or 20 years? You can only rest on laurels for so long before they dry up and blow away. Google meanwhile is an incredible company. Are you saying you know better than Hinton where the real progress is being made?

You're arguing a point he's not making.

Re: Geoffrey Hinton has joined Google

#72
post #3

Sigh. I don't know whether I'm alone in being saddened that many of the excellent thinkers of our time, who once might have spent their lives probing the the very limits of our comprehension in their field, now end up comfortably turning their minds to the services of (in the long term) rather short sighted commercial ends. I can imagine that this sentiment is probably against the prevailing HN mood, but I've been th…

The problem with this type of research in particular is that these deep learning networks shine when they are trained for a very long time across many machines, and on huge quantities of data. In other words, serious engineering muscle is necessary that goes beyond what a few graduate students can do in a University setting.

Re: Geoffrey Hinton has joined Google

#73

Earlier quoted context omitted.

http://research.google.com/pubs/ArtificialIntelligenceandMac...

Thanks, I didn't know about that. But you'll probably agree that it's unimpressive: 270 publications (and that appears to be all-time, going back 10 years) for a team of 515 researchers. In academia, you'd expect several per year per researcher.

That's because at university the researchers are being evaluated mainly on the number of papers they produce. Google has other options for evaluation.

Source: some bozos count my papers every couple of years and write an evaluation which displays complete ignorance of my field.

Re: Geoffrey Hinton has joined Google

#74
post #48

Earlier quoted context omitted.

Google simply hasn't been around long enough to earn the kind of credibility that Bell Labs and Xerox PARC had.

So when is the last time that PARC or Bell Labs produced anything of note? Seriously. 15 or 20 years? You can only rest on laurels for so long before they dry up and blow away. Google meanwhile is an incredible company. Are you saying you know better than Hinton where the real progress is being made?

I wasn't suggesting that Hinton or anyone else should go to Bell Labs or PARC these days. I was just pointing out that back in the day, nobody would have been disappointed or considered it selling out for a notable figure to leave academia for one of those corporate research centers. For all that Google may aspire to have that kind of reputation for research, they don't have it, yet. So some doubting is allowable. However, I can't think of any other for-profit employer that seems to be as willing and able as Google to build that kind of legacy.

Re: Geoffrey Hinton has joined Google

#75
post #3

Sigh. I don't know whether I'm alone in being saddened that many of the excellent thinkers of our time, who once might have spent their lives probing the the very limits of our comprehension in their field, now end up comfortably turning their minds to the services of (in the long term) rather short sighted commercial ends. I can imagine that this sentiment is probably against the prevailing HN mood, but I've been th…

It remains to be proved that an university is particularly better at innovation that anything else. At least in Computer Science most major historic breakthroughs happened in army departments and in commercial laboratories (Bell Labs, Xerox Parc) and today they are still strong, for example many of the most cited CS publications come from Microsoft Research. Google faces some of the biggest challenges in Machine Learning and has some of the brightest people in the field, I doubt they will be looking for "ways of making people click on an ad". The advantage of a commercial or military laboratory is the constant flow of new problems needing to be solved that can give everyone huge visible benefits, it is emotionally stimulating, in comparison to the somewhat vacuous atmosphere of an universities thinking for thinkings sake.

Re: Geoffrey Hinton has joined Google

#76
post #38
post #2

So is Google now more appealing to academics than academia?

In a way, yes. Research in industry has the advantage that you don't have to "waste" your time applying for grants in order to fund your own research group. A lot of people seem to live in an illusion that professors actually spend most of their time doing research, they are the managers of research groups more than anything else and growing those research groups is hard work and takes up close to all of your time (t…

This is a very good summation of why I'm heading to Google once I finish grad school this academic year.

Re: Geoffrey Hinton has joined Google

#77
post #48

Earlier quoted context omitted.

Google simply hasn't been around long enough to earn the kind of credibility that Bell Labs and Xerox PARC had.

So when is the last time that PARC or Bell Labs produced anything of note? Seriously. 15 or 20 years? You can only rest on laurels for so long before they dry up and blow away. Google meanwhile is an incredible company. Are you saying you know better than Hinton where the real progress is being made?

Real progress in computing is made by former PARC guys at VPRI http://vpri.org/html/writings.php

For example STEPS a full modern computing environment in 20KLOC from the metal up using DSLs and a reimagining of what an OS and the Web means.

Some more Info here: "STEPS 2011 Progress Report (personal computing in 20kLOC)" http://lambda-the-ultimate.org/node/4436

"Alan Kay: How Simply and Understandably Could The "Personal Computing Experience" Be Programmed?" http://vimeo.com/10260548

"Programming and Scaling" http://www.tele-task.de/archive/lecture/overview/5819/

Re: Geoffrey Hinton has joined Google

#78
post #39
post #35

Earlier quoted context omitted.

I think this is unfair to at least Microsoft Research, which as far as I know has outpublished Google by a wide margin. (Full disclosure - I'm a contractor working on F#-related stuff at MSR)

As I am not a contractor or affiliated with MSR in any way, I can back you up. In my field MSR is light years ahead of Google when it comes to research impact. Google has been gaining a stronger presence and they are generally seen as more innovative. But for those of my colleagues that want an industry research job, MSR and Google are both very attractive, the old stable one and the new kid in town.

(Disclaimer: I work for Microsoft Research Asia) On the other hand, what Google does get around to publishing is often very strong. Outside of universities, and since IBM lost/dropped/??? most of its researchers, we are the only two big companies left that have strong ties to research.

Re: Geoffrey Hinton has joined Google

#79
post #3

Sigh. I don't know whether I'm alone in being saddened that many of the excellent thinkers of our time, who once might have spent their lives probing the the very limits of our comprehension in their field, now end up comfortably turning their minds to the services of (in the long term) rather short sighted commercial ends. I can imagine that this sentiment is probably against the prevailing HN mood, but I've been th…

The common lament about Google being just a place that optimizes ad clicks is overused, and lazy thinking. I don't even think it's a conclusion that's the result of actual thought anymore, just reverb. Google is a big company. It would not even be worth it or effective to have every single engineer dedicated to this ad click business. There's a team for that, and there are lots of other teams, for lots of other inter…

Follow the money. Where does the money come from? Google is not a charity for intellectual projects, it is a business.

Re: Geoffrey Hinton has joined Google

#80

This is exciting for Hinton I'm sure, but also somewhat worrying for broader community. Hinton has always been very open with his research: http://www.nytimes.com/2012/11/24/science/scientists-see-adv... One of the most striking aspects of the research led by Dr. Hinton is that it has taken place largely without the patent restrictions and bitter infighting over intellectual property that characterize high-technology…

Sounds like a good fit for Google, who are leading patent disarmament among tech giants:

http://www.google.com/patents/licensing/index.html

Though Google seem to think you can still make money despite/because of sharing, through other means than patent licencing.

Post reply on HN