Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

news.ycombinator.com

Post reply on HN
Print view View original

101–110 of 144 posts

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#101

Post by mirekrusin »

ilaksh wrote: post #57

My guess is that multimodal transformers will probably eventually get us most of the way there for general purpose AI. But AGI is one of those very ambiguous terms. For many people it's either an exact digital replica of human behavior that is alive, or something like a God. I think it should also apply to general purpose AI that can do most human tasks in a strictly guided way, although not have other characteristic…

AGI will be AI which can improve it's own code after N iterations where N will be blurry.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#102

Post by sho_hn »

hosolmaz wrote: post #92
sho_hn wrote: post #90

> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…

Related: https://qntm.org/mmacevedo

I was quoting "Measure of a Man" :-)

"Lena" is a bit of different case because it's not AGI. Probably ripe for the "forced prison labor" suggested by your sibling as the moral cop-out. Imagine being sentenced to being a cloud VM image!

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#104

Post by sillysaurusx »

abrichr wrote: post #95
sillysaurusx wrote: post #91

Earlier quoted context omitted.

That's probably fair. But you'd be hard-pressed to find a DL stack to try out your ideas with prior to 2016, since that's when Tensorflow launched. :) (Gosh, it's been less than a decade. Time sometimes doesn't fly, considering how much it's changed the world since then...)

Theano was first released in 2007.

That’s actually fascinating. Were there many experiments done in it back in the 00’s?

I’m just trying to imagine the things you could do with it back then. 2007 had relatively fast gpus for the time, but certainly nothing compared to today. Yet it’d certainly be enough for MNIST training, which makes me wonder what else could be done.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#105

Post by i_s »

sho_hn wrote: post #90

> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…

Sounds like 'Age of Em' by Robin Hanson: https://ageofem.com/

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#106

Post by EamonnMR »

sho_hn wrote: post #102
hosolmaz wrote: post #92

Earlier quoted context omitted.

Related: https://qntm.org/mmacevedo

I was quoting "Measure of a Man" :-) "Lena" is a bit of different case because it's not AGI. Probably ripe for the "forced prison labor" suggested by your sibling as the moral cop-out. Imagine being sentenced to being a cloud VM image!

Is there a good way to distinguish between the brain dumps in Lena and what you'd call an AGI?

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#107

Post by bathtub365 »

klabb3 wrote: post #94
sho_hn wrote: post #90

> "You’ll find people who can wax rhapsodic about the singularity and how everything is going to change with AGI. But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like…

I think there’s broad consensus that slavery only applies to human labor. Even within that spectrum people avoid the term (see forced prison labor). We also don’t use it for animal labor, for instance.

Human slaves were often considered to be less than human or, at the very least, not deserving of basic rights that other humans enjoyed, as part of the moral and ethical frameworks that supported the practice. I think we might see the same shift in dominant ideology if we do have “true” AGI. I’m sure I could be convinced that an intelligence that develops and grows over a number of years begins to have a right to exist and a right to freedom of expression and movement.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#108

Post by ladberg »

sillysaurusx wrote: post #104
abrichr wrote: post #95

Earlier quoted context omitted.

Theano was first released in 2007.

That’s actually fascinating. Were there many experiments done in it back in the 00’s? I’m just trying to imagine the things you could do with it back then. 2007 had relatively fast gpus for the time, but certainly nothing compared to today. Yet it’d certainly be enough for MNIST training, which makes me wonder what else could be done.

FWIW in 2016 I was at an ML team at Apple that had been shipping production neural networks on-device for a while already. At the everyone used an assortment of random tools (Theano, Torch, Caffe). I worked on an internal tool that originally started as a Theano fork but was closer to a modern-day Tensorflow XLA (and has since been axed in favor of Tensorflow for most teams).

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#109

Post by pengaru »

sillysaurusx wrote: post #86

"The email including them got lost to Meta's two-year auto-delete policy by the time I went back to look for it last year. I have a binder with a lot of them printed out, but not all of them." RIP. If it's any consolation, it sounds like the list is at least three years old by now. Which is a long time considering that 2016 is generally regarded as the date of the deep learning revolution.

> If it's any consolation, it sounds like the list is at least three years old by now.

In my experience when it comes to learning technical subjects from a position of relative total ignorance, it's the older resources that are the easiest to bootstrap knowledge from. Then you basically work your way forward through the newer texts, like an accelerated replay of a domain's progress.

I think it's kind of obvious that this would be the case when you think about it. Just like how history textbooks can't keep growing in size to give all past events an equal treatment, nor can technical references as a domain matures.

You're forced to toss out stuff deemed least relevant to today, and in technical domains that's often stuff you've just started assuming as understood by the reader... where early editions of a new space would have prioritized getting the reader up to speed in something totally novel to the world.

Re: Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack?

#110

Post by sho_hn »

EamonnMR wrote: post #106
sho_hn wrote: post #102

Earlier quoted context omitted.

I was quoting "Measure of a Man" :-) "Lena" is a bit of different case because it's not AGI. Probably ripe for the "forced prison labor" suggested by your sibling as the moral cop-out. Imagine being sentenced to being a cloud VM image!

Is there a good way to distinguish between the brain dumps in Lena and what you'd call an AGI?

A brain dump has a history, and we ascribe meaning to the past. As mentioned the thread here has mentioned forced prison labor as a form of socially acceptable slavery, and society could convince itself that a given brain dump deserves its fate, even that it is a form of atonement.

Artifical life on the other hand is presumably "pure at birth".

Of course it's not that easy. You could discuss whether individual instances have unique sets of human rights, and value potential futures over pasts.

Post reply on HN