Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

news.ycombinator.com

Post reply on HN
Print view View original

91–100 of 144 posts

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#91

Post by sillysaurusx »

moglito wrote: post #89
sillysaurusx wrote: post #86

"The email including them got lost to Meta's two-year auto-delete policy by the time I went back to look for it last year. I have a binder with a lot of them printed out, but not all of them." RIP. If it's any consolation, it sounds like the list is at least three years old by now. Which is a long time considering that 2016 is generally regarded as the date of the deep learning revolution.

"considering that 2016 is generally regarded as the date of the deep learning revolution" -- I thought it was 2012, when AlexNet took the imagenet crown?

That's probably fair. But you'd be hard-pressed to find a DL stack to try out your ideas with prior to 2016, since that's when Tensorflow launched. :)

(Gosh, it's been less than a decade. Time sometimes doesn't fly, considering how much it's changed the world since then...)

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#92

Post by hosolmaz »

sho_hn wrote: post #90

> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…

Related: https://qntm.org/mmacevedo

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#93

Post by GuB-42 »

optimalsolver wrote: post #17

Carmack says he's pursuing a different path to AGI, then goes straight to the guy at the center of the most saturated area of machine learning (deep learning)? I would've hoped he'd be exploring weirder alternatives off the beaten path. I mean, neural networks might not even be necessary for AGI, but no one at OpenAI is going to tell Carmack that.

If you want to be off the beaten path, you have to know where the beaten path is.

Otherwise you may end up walking the ditch beside the beaten path. It is slow and difficult, but it won't get you anywhere new.

For example, you may try an approach that doesn't look like deep learning, but after a lot of work, realize that you actually reinvented deep learning, poorly. We call these things neurons, transformers, backpropagation, etc... but in the end, it is just maths. If you end up finding that your "alternative" ends up being very well suited to linear algebra and gradient descent, once you have found the right formulas, you may realize that they are equivalent to the ones used in traditional "deep learning" algorithms. It help to recognize this early and take advantage of all the work done before you.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#94

Post by klabb3 »

sho_hn wrote: post #90

> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…

I think there’s broad consensus that slavery only applies to human labor. Even within that spectrum people avoid the term (see forced prison labor). We also don’t use it for animal labor, for instance.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#95

Post by abrichr »

sillysaurusx wrote: post #91
moglito wrote: post #89

Earlier quoted context omitted.

"considering that 2016 is generally regarded as the date of the deep learning revolution" -- I thought it was 2012, when AlexNet took the imagenet crown?

That's probably fair. But you'd be hard-pressed to find a DL stack to try out your ideas with prior to 2016, since that's when Tensorflow launched. :) (Gosh, it's been less than a decade. Time sometimes doesn't fly, considering how much it's changed the world since then...)

Theano was first released in 2007.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#96

Post by throwaway4837 »

Wow, crazy coincidence that you all read this article yesterday too. I was thinking of emailing one of them for the list, then I fell asleep. Cold emails to scientists generally have a higher success-rate than average in my experience.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#97

Post by throwaway4837 »

optimalsolver wrote: post #17

Carmack says he's pursuing a different path to AGI, then goes straight to the guy at the center of the most saturated area of machine learning (deep learning)? I would've hoped he'd be exploring weirder alternatives off the beaten path. I mean, neural networks might not even be necessary for AGI, but no one at OpenAI is going to tell Carmack that.

Did you read the full article? In science, you should usually have a very solid understanding of what the top minds in the field are fixated on as it allows you to try something different with confidence, and prevents you from pulling a Ramanujan, reinventing the exact same wheel. I can't think of a single scientist who caused a paradigm shift and didn't have an intimate understanding of the current status quo.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#98

Post by aj7 »

sho_hn wrote: post #90

> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…

Computer time is paid for.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#99

Post by sho_hn »

klabb3 wrote: post #94
sho_hn wrote: post #90

> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…

I think there’s broad consensus that slavery only applies to human labor. Even within that spectrum people avoid the term (see forced prison labor). We also don’t use it for animal labor, for instance.

> animal labor

The context uses human-like/human-level a lot, but I agree what level and type of intelligence commands human respect is tricky business.

> forced prison labor

Would be interesting if we found ways to convince ourselves the AIs had it coming.

Generally speaking, slavery has been morally acceptable and popular before, and I will also not be surprised if we return to those ways.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#100

Post by sho_hn »

aj7 wrote: post #98
sho_hn wrote: post #90

> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…

Computer time is paid for.

Will the AIs own the computers?
Post reply on HN