Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

news.ycombinator.com

Post reply on HN
Print view View original

41–50 of 144 posts

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#41

Post by LeonenTheDK »

unixhero wrote: post #29
zomglings wrote: post #26

[flagged]

I don't care. The cat was probably put down painlessly at a vet. I don't see the issue at all. Let's not do these cancelling attempts.

Having a living thing killed because it did something you don't like, that it doesn't understand is wrong, is so incredibly heartless. Pets aren't toys meant to be tossed when you get tired of them, they're living creatures deserving of a good life.

Now if it was peeing everywhere because of a terminal medical issue causing it pain, that's a bit of a different story. I don't know the situation he and the cat were in. But if it is just as the parent comment says, why kill the thing instead of giving it up for a chance at a better life?

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#42

Post by RC_ITR »

hardware2win wrote: post #6
albertzeyer wrote: post #2

(Partly copied from https://news.ycombinator.com/item?id=34640251 .) On models: Obviously, almost everything is Transformer nowadays (Attention is all you need paper). However, I think to get into the field, to get a good overview, you should also look a bit beyond the Transformer. E.g. RNNs/LSTMs are still a must learn, even though Transformers might be better in many tasks. And then all those memory-augmented model…

I do wonder whether people behind Attention is all you need paper Will receive Turing Award It is being cited often

>Will receive Turing Award

This is the weird thing - hopefully not! Hopefully there's even better NN models coming out every 5-10 years and we look back on transformers as 'just a phase' sort of like how we look back at RNN's (which were no less of an amazing achievement - look at the proliferation of voice assistants), as potentially obsolete technology today.

Fore example, attention is great and does a really good job of simulating context in language, but what if we come up with a clever way to simulate symbology? Then we actually are back on the path to AGI and transformers will look like child's play.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#43

Post by andrelaszlo »

fastball wrote: post #28
maxbond wrote: post #16

Earlier quoted context omitted.

The authors who wrote "Attention is all you need" - Turing candidates?

The people behind "Attention is all you need" Are often cited

Attention.

Attention.

Attention.

- Ikkyū

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#44

Post by qwertyforce »

mattcaldwell wrote: post #12
hardware2win wrote: post #6

Earlier quoted context omitted.

I do wonder whether people behind Attention is all you need paper Will receive Turing Award It is being cited often

Came here expecting a Haiku.

Neural nets advance,

Attention is all you need,

Computing ascends.

#by chatgpt

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#45

Post by nathias »

layer8 wrote: post #19

[flagged]

I got:

Some of the highly influential papers in the field of AI that could have been on the list include "Generative Adversarial Networks" by Ian Goodfellow et al., "Attention is All You Need" by Vaswani et al., "AlexNet: ImageNet Classification with Deep Convolutional Neural Networks" by Alex Krizhevsky et al., "Playing Atari with Deep Reinforcement Learning" by Volodymyr Mnih et al., "Human-level control through deep reinforcement learning" by Volodymyr Mnih et al., "A Few Useful Things to Know About Machine Learning" by Pedro Domingos, among many others.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#46

Post by hungryforcodes »

icepat wrote: post #31
unixhero wrote: post #29

Earlier quoted context omitted.

I don't care. The cat was probably put down painlessly at a vet. I don't see the issue at all. Let's not do these cancelling attempts.

Having an animal killed for no good reason, other than it caused you problems, is a bit twisted. In situations like this, rehoming them is the ethical thing to do. This is literally saying 'I don´t care if he´s killing kittens'.

I enjoyed my meatballs today, btw!I'm joking in the sense I didn't eat meatballs today, but we kill animals all the time. That's what humans do. Do you eat meat or foods cooked with animal fats?

I think you get my point.

A life is a life. I don't see why pets are somehow more important than other animals.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#50

Post by chrgy »

From ChatGPT, although personally I think this list is bit old but should be at the 60% mark at the very least Deep Learning:

AlexNet (2012) VGGNet (2014) ResNet (2015) GoogleNet (2015) Transformer (2017) Reinforcement Learning:

Q-Learning (Watkins & Dayan, 1992) SARSA (R. S. Sutton & Barto, 1998) DQN (Mnih et al., 2013) A3C (Mnih et al., 2016) PPO (Schulman et al., 2017) Natural Language Processing:

Word2Vec (Mikolov et al., 2013) GLUE (Wang et al., 2018) ELMo (Peters et al., 2018) GPT (Radford et al., 2018) BERT (Devlin et al., 2019)

Post reply on HN