The argument that this is 90% of what matters in ML seems a bit bold. AFAICT it is completely missing reinforcement learning, which has been source of some mindblowing results (from Deepmind) in the past decade. It is also missing other stuff that I as a layman found fascinating (graph neural networks, 1.5 bit networks, ..). Also, I am not sure how much the Kolmogorov complexity actually matters, it's more philosophical than practical. So beware, it is a very opinionated list.
Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
41–50 of 117 posts
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#42The argument that this is 90% of what matters in ML seems a bit bold. AFAICT it is completely missing reinforcement learning, which has been source of some mindblowing results (from Deepmind) in the past decade. It is also missing other stuff that I as a layman found fascinating (graph neural networks, 1.5 bit networks, ..). Also, I am not sure how much the Kolmogorov complexity actually matters, it's more philosophi…
> AFAICT it is completely missing reinforcement learning
There's no RL in there, nor diffusion. There are many other very interesting papers that I think have lots more to offer — but I just have a master's degree here. I am not a phd let alone a distinguished researcher.
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#43The headline belies the scope of this task. If you click in to see what these are: - one is a full course in convolutional neural networks https://cs231n.github.io/ - one is a 500 page text book https://www.lirmm.fr/~ashen/kolmbook-eng-scan.pdf - another one is an 80 page text book (?) https://arxiv.org/pdf/math/0406077 and so on. I would guess it is possible to go through this list if you make it your full time job…
Reportedly, Carmack did it an a week by locking himself in an hotel room
Almost forgot about how Carmack is the one that will give the world AGI...Easy to take the eyes of the ball with all these OpenAI and Google distractions...
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#44Earlier quoted context omitted.
Reportedly, Carmack did it an a week by locking himself in an hotel room
If he could've done it in a week then he didn't really need to do it at all.
Yup, prerequisites is all you need. I can go through any course of study in a week as long as I'd mastered it before.
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#45Earlier quoted context omitted.
Tony Stark was able to do it in a cave with a box of scraps.
Maria Hill: When did you become an expert in thermonuclear astrophysics? Tony Stark: Last night. The Avengers (2012)
That is nothing..Sam Altman did it, on his way to this podcast... https://youtu.be/4gASfaRWe7s
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#46Earlier quoted context omitted.
If you can't take a single week off of work during an entire year in order to advance your career, then you're satisfied with your current one. There is no need to direct negativity toward others for making time to learn. Carmack is in this position today because of such work ethic, not in spite of it.
What a strangely narrow way of looking at this. Work isn’t the only responsibility. What is the correlation between taking a week away from responsibilities - work, family, etc. - and job satisfaction?
If one cannot disappear for a week to think or study he is putting himself at some serious life disadvantage. My 2c.
I do not mean telling family that I am disappearing for a week starting tomorrow, but that I want to disappear for a week in a couple of months and the family would cover responsibilities for me (I should be willing to reciprocate).
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#47Earlier quoted context omitted.
Ah, the freedoms of not having any other responsibilities.
If you can't take a single week off of work during an entire year in order to advance your career, then you're satisfied with your current one. There is no need to direct negativity toward others for making time to learn. Carmack is in this position today because of such work ethic, not in spite of it.
Sometimes it's nice to take a week off to do things like going outside.
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#48Earlier quoted context omitted.
If you can't take a single week off of work during an entire year in order to advance your career, then you're satisfied with your current one. There is no need to direct negativity toward others for making time to learn. Carmack is in this position today because of such work ethic, not in spite of it.
[flagged]
Got a source on that? I know that they were married for 25 years. That's a lot of time for people to change and for differences between their needs and wants to grow.
I can say that he is exactly where he wants to be professionally, and I don't think you're suggesting that taking a week out of a year to learn new things is too risky because your wife might leave you.
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#49The headline belies the scope of this task. If you click in to see what these are: - one is a full course in convolutional neural networks https://cs231n.github.io/ - one is a 500 page text book https://www.lirmm.fr/~ashen/kolmbook-eng-scan.pdf - another one is an 80 page text book (?) https://arxiv.org/pdf/math/0406077 and so on. I would guess it is possible to go through this list if you make it your full time job…
Reportedly, Carmack did it an a week by locking himself in an hotel room
How hard can it be? It's only 30 papers.
Maybe someone should ask Chuck Norris how long it took him. Who wants to go first?
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#50Earlier quoted context omitted.
If you can't take a single week off of work during an entire year in order to advance your career, then you're satisfied with your current one. There is no need to direct negativity toward others for making time to learn. Carmack is in this position today because of such work ethic, not in spite of it.
What a strangely narrow way of looking at this. Work isn’t the only responsibility. What is the correlation between taking a week away from responsibilities - work, family, etc. - and job satisfaction?
I assumed someone would retort with this angle, but I hoped people would interpret my comment charitably without me littering it with a dozen caveats.
Of course work isn't the only responsibility.
Of course some people have kids, pets, parents, medical conditions, etc.
It's one week away from work. It can still be done. You weren't going to be taking care of any other responsibilities during your normal 9-5 hours, so that should have no bearing on the week you take off; treat it as any other work week, except you're working for yourself.