Live data from Hacker News

Understanding Machine Learning: From Theory to Algorithms (2014)

cs.huji.ac.il

31–40 of 58 posts

Re: Understanding Machine Learning: From Theory to Algorithms (2014)

#31
I'm a math geek, but I'm also a mostly self-taught data scientist.

"The Elements of Statistical Learning" (https://web.stanford.edu/~hastie/local.ftp/Springer/OLD/ESLI...) is far and away the best book I've seen.

It took me hundreds of hours to get through it, but if you're looking to understand things at a pretty deep level, I'd say it's well-worth it.

Even if you stop at chapter 3, you'll still know more than most people, and you'll have a great foundation.

Hope this helps!

Re: Understanding Machine Learning: From Theory to Algorithms (2014)

#32
post #26

Earlier quoted context omitted.

I interview a lot of developers for ML positions at our company. The first red flag is always a lack of math. Candidates who come in with API-level competence ie. can implement an ML algo using this,that or the other API, without any understanding of some basic math behind it, always fare poorly. Atleast in ML, not having an understanding of math is pretty much like claiming expertise in riding a bicycle by watching…

A lack of mathematical intuition is a serious problem for many people from engineering to biology to economics. It certainly plagued me throughout my engineering bachelors studies and is something I continually work to get better at. In my opinion, physics students learn the best framework for thinking and get a very good mathematical intuition. For example, here's a problem from an introductory QM book that really t…

99%?

Re: Understanding Machine Learning: From Theory to Algorithms (2014)

#33
post #30

Earlier quoted context omitted.

A lack of mathematical intuition is a serious problem for many people from engineering to biology to economics. It certainly plagued me throughout my engineering bachelors studies and is something I continually work to get better at. In my opinion, physics students learn the best framework for thinking and get a very good mathematical intuition. For example, here's a problem from an introductory QM book that really t…

> A needle of length L is dropped at random onto a sheet of paper ruled with parallel lines a distance L apart. What is the probability that the needle will cross a line? Thickness of line is needed right? Otherwise P approaches 100% as thickness approaches 0?

The lines are infinitely thin. Equivalently you can imagine the paper is divided into regions of width L, and the question is whether the needle will cross a region boundary (https://en.wikipedia.org/wiki/Buffon's_needle).

Re: Understanding Machine Learning: From Theory to Algorithms (2014)

#35
post #26

Earlier quoted context omitted.

I interview a lot of developers for ML positions at our company. The first red flag is always a lack of math. Candidates who come in with API-level competence ie. can implement an ML algo using this,that or the other API, without any understanding of some basic math behind it, always fare poorly. Atleast in ML, not having an understanding of math is pretty much like claiming expertise in riding a bicycle by watching…

A lack of mathematical intuition is a serious problem for many people from engineering to biology to economics. It certainly plagued me throughout my engineering bachelors studies and is something I continually work to get better at. In my opinion, physics students learn the best framework for thinking and get a very good mathematical intuition. For example, here's a problem from an introductory QM book that really t…

https://en.wikipedia.org/wiki/Buffon%27s_needle for anyone that's interested.

Re: Understanding Machine Learning: From Theory to Algorithms (2014)

#36
I've read this book and warmly recommend it. It has a very pragmatic "no bullshit" approach and it's very mathematical and concise.

The neural networks chapter is tiny (but that's ok - that's not the focus) and some of the questions are really hard - but overall I've really enjoyed it.

Re: Understanding Machine Learning: From Theory to Algorithms (2014)

#37

I'm a math geek, but I'm also a mostly self-taught data scientist. "The Elements of Statistical Learning" ( https://web.stanford.edu/~hastie/local.ftp/Springer/OLD/ESLI... ) is far and away the best book I've seen. It took me hundreds of hours to get through it, but if you're looking to understand things at a pretty deep level, I'd say it's well-worth it. Even if you stop at chapter 3, you'll still know more than mos…

I am a graduate student at MIT, and can second this recommendation. It is a fantastic book for machine learning and nothing else I have seen comes close.

Re: Understanding Machine Learning: From Theory to Algorithms (2014)

#38
post #12

Earlier quoted context omitted.

Andrew Ng's Coursera ML course is supposed to be pretty accessible. I've also heard good things about Machine Learning for Hackers ( http://www.amazon.com/Machine-Learning-Hackers-Drew-Conway/d... ). Ultimately, ML is a mathematical discipline. You can ask for a gentle approach that gets you to the foot of the mountain, but "if you want to learn about nature, to appreciate nature, it is necessary to understand the la…

I'm currently taking Andrew Ng's Coursera course and I'd agree it's quite accessible. In fact, if you have a solid understanding of calculus and linear algebra, you might find it a bit slow at times.

For people who are disappointed by the shallowness of it, I recommend supplementing it with the notes to his Stanford class: http://cs229.stanford.edu/materials.html. The combination worked well for me.

Re: Understanding Machine Learning: From Theory to Algorithms (2014)

#39
post #26

Earlier quoted context omitted.

I interview a lot of developers for ML positions at our company. The first red flag is always a lack of math. Candidates who come in with API-level competence ie. can implement an ML algo using this,that or the other API, without any understanding of some basic math behind it, always fare poorly. Atleast in ML, not having an understanding of math is pretty much like claiming expertise in riding a bicycle by watching…

A lack of mathematical intuition is a serious problem for many people from engineering to biology to economics. It certainly plagued me throughout my engineering bachelors studies and is something I continually work to get better at. In my opinion, physics students learn the best framework for thinking and get a very good mathematical intuition. For example, here's a problem from an introductory QM book that really t…

Since the lines are parallel you can rephrase the problem:

A circle of radius L is centered x far away from a border 0How much of the 2pi boundary is outside the zone?

When x -> 0 then it's going to be 50% since one boundary line becomes a tangent and the other goes through the middle. When we move x by k (e.g. f(x+k)) then 2k new points will be added on the left side while 2*k points leave the boundary on the right side. When x=L/2 then the boundary lines will split the circle in four equal parts (since they're tangent to the radius at r/2 on both sides) so intuitively its 50%.

Re: Understanding Machine Learning: From Theory to Algorithms (2014)

#40

I'm a math geek, but I'm also a mostly self-taught data scientist. "The Elements of Statistical Learning" ( https://web.stanford.edu/~hastie/local.ftp/Springer/OLD/ESLI... ) is far and away the best book I've seen. It took me hundreds of hours to get through it, but if you're looking to understand things at a pretty deep level, I'd say it's well-worth it. Even if you stop at chapter 3, you'll still know more than mos…

Having read significant chunks of both ESL and Understanding Machine Learning (albeit UML much more recently) I would argue that for many readers UML is superior.

ESL pays short shrift to the computational complexity of learning whereas UML explicitly handles both statistical and computational complexity concerns. It doesnt matter how statistically pure your algorithm is if its running time scales exponentially with your data.

All of UML's chapters are conceptually unified even when discussing different ML algorithms, with ESL being more of a grab-bag by chapter.

Still, both high quality and free!

Post reply on HN