Live data from Hacker News

Andrew Ng and the Quest for the New AI

wired.com

31–40 of 73 posts

Re: Andrew Ng and the Quest for the New AI

#31

Earlier quoted context omitted.

That's awesome to hear! I'm taking the Coursera class now, and it's been great so far. It just started a couple weeks ago, so it definitely isn't too late to join! https://www.coursera.org/course/ml

thanks very much for pointing this out, joined the class now, hope i can catch up

Haha me too late to the party. I just joined. Frantically watching the video lectures since the assignments are due today (hard deadline)!

Re: Andrew Ng and the Quest for the New AI

#32
post #5

OT: His online Machine Learning class last year was great. He is the best professor I've ever had, and explains things so clearly that you understand them the first time. You are lucky if you ever get to work or study under him.

I have to blame you, because now I had to take the course in coursera! I always wanted to learn machine learning. Better late than never!

Re: Andrew Ng and the Quest for the New AI

#33

I've said this before, but deep learning is terribly powerful precisely because you don't have to spend lots of time doing feature engineering. Multi layer networks that are trained in semi-supervised, unsupervised and supervised fashions all can now produce networks that meet or beat the state of the art hand created models for speech, handwriting recognition, ocr, and object recognition. We are only just beginning…

This has been said about neural nets two times already. Sadly, they did never deliver.

There are still applications where e.g. random forests beat the crap out of all kinds of deep learning algorithms in (a) training time (b) predictive quality (c) prediction time.

We should stop hyping this. I am a researcher working in deep learning myself, but the current deep learning hype is actually what makes me worry that I will have trouble getting a job because industry will be disappointed a third time.

Re: Andrew Ng and the Quest for the New AI

#36

There is a very quick reference to the person who inspired him, Jeff Hawkins, whose book is worth a read: http://www.amazon.com/On-Intelligence-Jeff-Hawkins/dp/080507... Edit: update link

I just saw Jeff Hawkins give a talk and it was quite interesting. I was a bit worried, however, that he is basing his theory of intelligence on the human neocortex, while claiming to go after general principles.

This is guaranteed not to be terribly general, considering the many bits of matter on this planet that exhibit intelligence without a neocortex. By many, I mean ones that hugely outnumber humans.

So very interesting stuff, but not the answer that I think he wants it to be.

Re: Andrew Ng and the Quest for the New AI

#37
So I am a little confused. Where are we on the learning part of AI? As I understand it, the current consensus is to throw as much data as you can at your model (millions of cat pictures in this article's example) to make it pick up patterns and yet still claim that we are closing in on how the brain works? As far as I can tell no human brain would need that many pictures to see a pattern. In fact, and this is probably more apparent in language, we humans tend to work with degenerate data and still end up with perfect models.

Re: Andrew Ng and the Quest for the New AI

#38
post #31

Earlier quoted context omitted.

thanks very much for pointing this out, joined the class now, hope i can catch up

Haha me too late to the party. I just joined. Frantically watching the video lectures since the assignments are due today (hard deadline)!

Okay, now you got me scared. The hard deadlines for all my assignments are on July 8th 8:59AM (that's CEST, so it's probably July 7th in PST.)

Re: Andrew Ng and the Quest for the New AI

#39
post #17

Earlier quoted context omitted.

Please think about what a source is. This isn't reddit.

Bullshit. There is nothing wrong with using personal experience for reference so long as it is properly cited. It beats "This guy is wrong (source: random blog post that I didn't really read)", anyway. Edit: To be clear, I don't love the Reddit snowclones, but there's nothing wrong with the sentiment behind "I'm a scholar in this field, and I think this guy is a hack."

>Bullshit. There is nothing wrong with using personal experience for reference so long as it is properly cited.

I agree with the sentiment, but "properly cited" suggests a bit more than a one line comment from a username with barely a handful of posts (generally pertaining to bitcoin and intermediate level networking certifications) on an anonymous website.

>It beats "This guy is wrong (source: random blog post that I didn't really read)", anyway.

I have to disagree. At least a random blog post presents the potential for useful information or a fully articulated opinion. What we here is 4 words and an unsubstantiated appeal to authority.

Re: Andrew Ng and the Quest for the New AI

#40

There is a very quick reference to the person who inspired him, Jeff Hawkins, whose book is worth a read: http://www.amazon.com/On-Intelligence-Jeff-Hawkins/dp/080507... Edit: update link

Grok (formerly Numenta) has a slightly more technical white paper that goes into more detail on the actual algorithms from On Intelligence:

https://www.groksolutions.com/htm-overview/education/HTM_Cor...

There are some subtle differences between HTMs and straight up deep learning, mainly the requirement for HTM data to be temporal and spatial.

I know Andrew used to sit on an advisory committee at Numenta, I don't know if he still does.

Post reply on HN