They asked on Twitter and he didn’t reply. We need someone with a blue check mark to ask. https://twitter.com/ifree0/status/1620855608839897094
Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
11–20 of 144 posts
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#12(Partly copied from https://news.ycombinator.com/item?id=34640251 .) On models: Obviously, almost everything is Transformer nowadays (Attention is all you need paper). However, I think to get into the field, to get a good overview, you should also look a bit beyond the Transformer. E.g. RNNs/LSTMs are still a must learn, even though Transformers might be better in many tasks. And then all those memory-augmented model…
I do wonder whether people behind Attention is all you need paper Will receive Turing Award It is being cited often
Came here expecting a Haiku.
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#13(Partly copied from https://news.ycombinator.com/item?id=34640251 .) On models: Obviously, almost everything is Transformer nowadays (Attention is all you need paper). However, I think to get into the field, to get a good overview, you should also look a bit beyond the Transformer. E.g. RNNs/LSTMs are still a must learn, even though Transformers might be better in many tasks. And then all those memory-augmented model…
I do wonder whether people behind Attention is all you need paper Will receive Turing Award It is being cited often
The Adam optimizer is another possibility. It's unbelievably good and everyone uses it.
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#14>90% of what matters today Strikes me as the kind of thing where that last 10% will need 400 papers
"The first 90% is easy. It's the second 90% that kills ya."
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#15Earlier quoted context omitted.
Clearly do this by tweet storming him via LLM
As an AI LLM, I cannot decide which academic papers are "best" as the idea of "best" is subjective and there are many different factors that need to be considered.
I apologize for the oversight, you are correct. Let me know if there's anything else I can help you with.
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#16Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#17Carmack says he's pursuing a different path to AGI, then goes straight to the guy at the center of the most saturated area of machine learning (deep learning)?
I would've hoped he'd be exploring weirder alternatives off the beaten path. I mean, neural networks might not even be necessary for AGI, but no one at OpenAI is going to tell Carmack that.
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#18Following: https://twitter.com/u3dcommunity/status/1621524851898089478?...
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#19[flagged]
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#20Carmack says he's pursuing a different path to AGI, then goes straight to the guy at the center of the most saturated area of machine learning (deep learning)? I would've hoped he'd be exploring weirder alternatives off the beaten path. I mean, neural networks might not even be necessary for AGI, but no one at OpenAI is going to tell Carmack that.
Wouldn't it be fair to say that one has to know what the current path is and have some idea where it leads and what its issues are, before forging a new path?
I mean, any idiot can go off-trail and start blundering around in the weeds, and ultimately wind up tripping, falling, hitting their head on a rock, and drowning to death in a ditch. But actually finding a new, better, more efficient path probably involves at least some understanding of the status quo.