Live data from Hacker News

Ask HN: What are the foundational texts for learning about AI/ML/NN?

news.ycombinator.com

21–30 of 114 posts

Re: Ask HN: What are the foundational texts for learning about AI/ML/NN?

#21

"Introduction to Statistical Learning" - https://www.statlearning.com/ (there's also "Elements of Statistical Learning" which is a more advanced version) AI: A Modern Approach - https://aima.cs.berkeley.edu/

The Elements of Statistical Learning, by Jerome H. Friedman, Robert Tibshirani, and Trevor Hastie. I’ve seen it referenced quite a few times and the TOC looks good.

Re: Ask HN: What are the foundational texts for learning about AI/ML/NN?

#23
To add to the great recommendations on this thread, I really like Moritz Hardt and Benjamin Recht's "Patterns, Predictions, and Actions". It's published by Princeton University Press here: https://press.princeton.edu/books/hardcover/9780691233734/pa...

But is also available online as a preprint here: https://mlstory.org/

Re: Ask HN: What are the foundational texts for learning about AI/ML/NN?

#24

Haugeland is GOFAI/cognitive science, not directly relevant to modern machine learning variety of models unless you are doing reinforcement learning or trees stuff (hey poker/chess/Go bots are pretty cool!). Russel and Norvig are the typical introductory textbooks for those. Marks and Haykins are all severely out of date (they have solid content, but they don't have the same scale of modern deep learning which has ma…

Does the order matter for Kochenderfer? Any one of those put more emphasis on controls than the others?

Re: Ask HN: What are the foundational texts for learning about AI/ML/NN?

#25
post #16
post #12

You may want to also consider this one: Artificial Intelligence, a modern approach – Stuart Russell, Peter Norvig

The big book of stuff that doesn't work.

Prop it up with a small stick and put some cracked walnuts below to catch mice with it.

Re: Ask HN: What are the foundational texts for learning about AI/ML/NN?

#27
It’s probably a bit off the beaten path, but I can highly recommend Probability Theory, The Logic of Science, by E. T. Jaynes.

In the opening chapter Jaynes describes a hypothetical system he calls “The Robot”. He then lays out the mathematics of the “The Robot’s” thinking in detail: essentially Bayesian probability theory. This is the best summary of an ideal ML/AI system I’ve come across. It’s also very philosophically enlightening.

Re: Ask HN: What are the foundational texts for learning about AI/ML/NN?

#28

I personally consider Linear algebra to be foundational in AI/ML. Intro to Linear algebra, Gilbert Strang. And his free course on MIT OCW is fantastic too. While having strong mathematical foundation is useful, I think developing intuition is even more important. For this, I recommend Andrew Ng's coursera courses first before you dive too deep.

I never took beyond Precalculus in school, thanks for the tip!

Many of the suggestions so far are assuming you have taken undergraduate linear algebra and calculus. I'd start with those two subjects, you really can't build a foundational understanding of modern AI techniques without them.

Re: Ask HN: What are the foundational texts for learning about AI/ML/NN?

#29

This is off the beaten path, but consider Abu-Mostafa et al.'s "Learning from Data". https://www.amazon.com/Learning-Data-Yaser-S-Abu-Mostafa/dp/... I adore PRML, but the scope and depth is overwhelming. LfD encapsulates a number of really core principles in a simple text. The companion course is outstanding and available on EdX. The tradeoff is that LfD doesn't cover a lot of breath in terms of looking at specific a…

I strongly second this. Abu Mostafa has videos and homework for this course too. This course was the one that made a LOT of fundamental things “click”, like, why does learning even work and what are some broad expectations about what we can and cannot learn.

Re: Ask HN: What are the foundational texts for learning about AI/ML/NN?

#30

It’s probably a bit off the beaten path, but I can highly recommend Probability Theory, The Logic of Science, by E. T. Jaynes. In the opening chapter Jaynes describes a hypothetical system he calls “The Robot”. He then lays out the mathematics of the “The Robot’s” thinking in detail: essentially Bayesian probability theory. This is the best summary of an ideal ML/AI system I’ve come across. It’s also very philosophic…

seconded! it's a great book.
Post reply on HN