Just learn 30 papers
Or keep doom scrolling some other shit. Your choice.
At least this is relevant information for people who are actually interested.
Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
11–20 of 117 posts
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#12Reading 30 studies does not mean "learned and understood". Especially if you start from zero.
Disagree, I’ve already changed my title to “ML professional” on linked in. Aside from the odd hallucination, I’m indistinguishable from an expert to the average hiring team.
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#13There are a few past discussions, going back to October 2022. I wonder how out of date the list is now.
Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack? https://news.ycombinator.com/item?id=34641359
396 points by alan-stark on Feb 3, 2023 | 137 comments
--
John Carmack’s ‘Different Path’ to Artificial General Intelligence (dallasinnovates.com) https://news.ycombinator.com/item?id=34637650
378 points by cmdr2 on Feb 3, 2023 | 495 comments
--
Ask HN: Where can I find an updated AI reading list? https://news.ycombinator.com/item?id=33166948
3 points by costant on Oct 11, 2022 | 6 comments
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#14Reading 30 studies does not mean "learned and understood". Especially if you start from zero.
People will conveniently disregard the fact that it's meant for Carmack, so not an aspiring coder.
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#15The headline belies the scope of this task. If you click in to see what these are:
- one is a full course in convolutional neural networks https://cs231n.github.io/
- one is a 500 page text book https://www.lirmm.fr/~ashen/kolmbook-eng-scan.pdf
- another one is an 80 page text book (?) https://arxiv.org/pdf/math/0406077
and so on.
I would guess it is possible to go through this list if you make it your full time job for a year or so. That might be worth it depending on your priorities. Regardless, it bears mentioning.
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#16Source?
I don’t think John Carmack will gain much knowledge by studying a game engine.
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#17Apparently, this is the list Ilya gave to John Carmack more than a year ago [1], which was shared by an OpenAI employee 10 days ago [2]. [1] https://dallasinnovates.com/exclusive-qa-john-carmacks-diffe... [2] https://twitter.com/keshavchan/status/1787861946173186062
I failed to find any evidence that this person is an OpenAI employee, but please correct me if I'm wrong.
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#18This is just someone’s bookmarks folder. Where’s the proof these were recommended by Ilya? This looks like a subtle way to advertise a VC funded web browser.
Carmack has more or less confirmed it. https://twitter.com/ID_AA_Carmack/status/1622673143469858816
> A canonical list of references from a leading figure would be appreciated by many.
That confirms the opposite, no?
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#19Apparently, this is the list Ilya gave to John Carmack more than a year ago [1], which was shared by an OpenAI employee 10 days ago [2]. [1] https://dallasinnovates.com/exclusive-qa-john-carmacks-diffe... [2] https://twitter.com/keshavchan/status/1787861946173186062
a backup just in case
https://nlp.seas.harvard.edu/annotated-transformer/
https://scottaaronson.blog/?p=762
https://karpathy.github.io/2015/05/21/rnn-effectiveness/
https://colah.github.io/posts/2015-08-Understanding-LSTMs/
https://arxiv.org/pdf/1409.2329.pdf
https://www.cs.toronto.edu/~hinton/absps/colt93.pdf
https://arxiv.org/pdf/1506.03134.pdf
https://proceedings.neurips.cc/paper_files/paper/2012/file/c...
https://arxiv.org/pdf/1511.06391.pdf
https://arxiv.org/pdf/1811.06965.pdf
https://arxiv.org/pdf/1512.03385.pdf
https://arxiv.org/pdf/1511.07122.pdf
https://arxiv.org/pdf/1704.01212.pdf
https://arxiv.org/pdf/1706.03762.pdf
https://arxiv.org/pdf/1409.0473.pdf
https://arxiv.org/pdf/1603.05027.pdf
https://arxiv.org/pdf/1706.01427.pdf
https://arxiv.org/pdf/1611.02731.pdf
https://arxiv.org/pdf/1806.01822.pdf
https://arxiv.org/pdf/1405.6903.pdf
https://arxiv.org/pdf/1410.5401.pdf
https://arxiv.org/pdf/1512.02595.pdf
https://arxiv.org/pdf/2001.08361.pdf
https://arxiv.org/pdf/math/0406077.pdf
https://www.vetta.org/documents/Machine_Super_Intelligence.p...
Re: Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
#20The headline belies the scope of this task. If you click in to see what these are: - one is a full course in convolutional neural networks https://cs231n.github.io/ - one is a 500 page text book https://www.lirmm.fr/~ashen/kolmbook-eng-scan.pdf - another one is an 80 page text book (?) https://arxiv.org/pdf/math/0406077 and so on. I would guess it is possible to go through this list if you make it your full time job…
> If you make it your full time job for a year or so
Sounds like a good MSc program