Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
131–140 of 144 posts
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#132"The email including them got lost to Meta's two-year auto-delete policy by the time I went back to look for it last year. I have a binder with a lot of them printed out, but not all of them." RIP. If it's any consolation, it sounds like the list is at least three years old by now. Which is a long time considering that 2016 is generally regarded as the date of the deep learning revolution.
Sorry - where is that sourced from? Or are you meaning it was a personal communication to you? Or it's a joke?
He told me.
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#133Earlier quoted context omitted.
> breaking basic ethics This didn't happen
https://fortune.com/2022/12/13/elon-musk-neuralink-animal-ex...
This criticism is coming from an "ethics group" that is literally funded by PETA and is frequently criticized by an actual, legitimate group: the American Medical Association. It's baseless garbage, and the hypocrisy is not lost on me that it's published on Fortune, which is owned by a billionaire whose majority wealth comes from Charoen Pokphand. This company is responsible for some of the worst factory farming conditions on the planet along with being accused by the Guardian of using slave labor on their shrimping boats - an accusation they later admitted to. Fortune in general is a shit publication with an axe to grind against Elon.
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#134While not all papers, this list contains a lot of important papers, writings, and conversations currently in AI: https://docs.google.com/document/d/1bEQM1W-1fzSVWNbS4ne5PopB...
[dead]
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#135Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#136> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…
Computer time is paid for.
Isn't it a similar problem to humans on hostile biosphere like the promised Martian colonies?
Even breathing and drinking water are sourced by megacorps-in-charge
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#137> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…
I wonder if those Franks and Amys would just think they are working remote jobs hammering out tickets from their studio apartments lol.
There is a video game called 'Soma' that touches on this very topic.
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#138Carmack says he's pursuing a different path to AGI, then goes straight to the guy at the center of the most saturated area of machine learning (deep learning)? I would've hoped he'd be exploring weirder alternatives off the beaten path. I mean, neural networks might not even be necessary for AGI, but no one at OpenAI is going to tell Carmack that.
What a waste it would be to think you are pursuing a different path only to discover you spent a year reinventing something that you could have learned by reading papers for a few days.
> "I have been amazed at what we've found here," he told
them. "A few weeks ago I would not have believed, did not
believe, that records such as you have in your Memorabilia
could still be surviving from the fall of the last mighty
civilization. It is still hard to believe, but evidence forces us
to adopt the hypothesis that the documents are authentic.
> Their survival here is incredible enough; but even more fantastic, to me, is the fact that they have gone unnoticed during this century, until now. Lately there have been men capable of appreciating their potential value– and not only myself. What Thon Kaschler might have done with them while he was alive!– even seventy years ago."
> The sea of monks' faces was alight with smiles upon hearing so favorable a reaction to the Memorabilia from one so gifted as the thon. Paulo wondered why they failed to sense the faint undercurrent of resentment– or was it suspicion?– in the speaker's tone. "Had I known of these sources ten years ago," he was saying, "much of my work in optics would have been unnecessary." Ahha! thought the abbot, so that's it. Or at least part of it. He's finding out that some of his discoveries are only rediscoveries, and it leaves a bitter taste. But surely he must know that never during his lifetime can he be more than a recoverer of lost works; however brilliant, he can only do what others before him had done. And so it would be, inevitably, until the world became as highly developed as it had been before the Flame Deluge.
-- A Canticle for Leibowitz
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#139Earlier quoted context omitted.
https://fortune.com/2022/12/13/elon-musk-neuralink-animal-ex...
This criticism is coming from an "ethics group" that is literally funded by PETA and is frequently criticized by an actual, legitimate group: the American Medical Association. It's baseless garbage, and the hypocrisy is not lost on me that it's published on Fortune, which is owned by a billionaire whose majority wealth comes from Charoen Pokphand. This company is responsible for some of the worst factory farming cond…
The criticism is coming from current and former employees, regardless of who's amplifying the message.
Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?
#140From ChatGPT, although personally I think this list is bit old but should be at the 60% mark at the very least Deep Learning: AlexNet (2012) VGGNet (2014) ResNet (2015) GoogleNet (2015) Transformer (2017) Reinforcement Learning: Q-Learning (Watkins & Dayan, 1992) SARSA (R. S. Sutton & Barto, 1998) DQN (Mnih et al., 2013) A3C (Mnih et al., 2016) PPO (Schulman et al., 2017) Natural Language Processing: Word2Vec (Mikolo…
You are getting downvoted because this list if from ChatGPT, but as a researcher in the field, this list is actually really good, except for perhaps the SARSA and GLUE papers, which are less generally relevant. I would add WaveNet, the Seq2Seq paper, GANs, some optimizer papers (e.g. Adam), diffusion models, and some of the newer Transformer variants. I'm very confident that this is pretty much what any researcher, i…
As a hobbyst I would add Tsetlin Machines, DreamerV3, DiffusER and most RL from DeepMind.