Live data from Hacker News

John Carmack’s ‘Different Path’ to Artificial General Intelligence

dallasinnovates.com

221–230 of 506 posts

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#221

I can't wait to become completely useless and to finish my life under a bridge begging for food. On a more technical point of few I'm always surprised to read these articles and never read the work reasoning

I think, as long as your AGI overlords allowed it, you'd be off growing food, hunting etc.

Probably have a really fulfilling life.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#222

This paragraph took me aback: But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like you can cloud-access computing resources, if you could cloud-access essentially arti…

As soon as we reach real AI, even at the level of a 5 years old, it is game over. So education or not education people will become completely useless to the rich that will own the AI

you can also translate "being useless" as "they having no reason to manipulate me into slaving as a cog in their machine/society/whatever"... I'd say uselessness should be our highest aspiration, when people higher up have no need to constantly brainwash you and social condition you into being just another cog in the machine you get true freedom.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#223

Earlier quoted context omitted.

Came here to say the same thing, but a few off the top of my head - attention is all you need - image is worth 16x16 words (vit) - openai clip - transformer XL - memorizing transformers / retro - language models are few shot learners (gpt) A few newer papers - recurrent block wise transformers - mobilevit (conv + transformer) - star (self taught transformer)

Most of these papers you list are about the model, and there is the original Transformer paper, and most of the others are some variations of the Transformer. I think to get into the field, to get a good overview, you should also look a bit beyond the Transformer. E.g. RNNs/LSTMs are still a must learn, even though Transformers might be better in many tasks. And then all those memory-augmented models, e.g. Neural Tur…

We should have an Ask HN where the people in the know can agree on 40 papers that the rest of us idiots can go out and consume.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#225

I stopped reading after the passage “and works independently [to achieve AGI]”. In my book, it’s impossible to achieve such breakthrough by working alone, regardless who the man/woman is.

> In my book, it’s impossible to achieve such breakthrough by working alone, regardless who the man/woman is.

Another fascinating opportunity for AGI - no sole contributor is all on their own, they can just spin up a community to embed into.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#226
post #32

This paragraph took me aback: But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like you can cloud-access computing resources, if you could cloud-access essentially arti…

I think AI will mostly communicate with other AI. For instance you have an AI assistant whom you task to organize a diner. That assistant will then talk to the assistants of all invitees, the assistant of the venue, the cooks, etcetera, and fill in the calendars.

All I can think of is "Colossus: The Forbin Project".

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#227

This paragraph took me aback: But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like you can cloud-access computing resources, if you could cloud-access essentially arti…

Legitimately think that if you haven’t secured yourself financially in the next 5-8 years, its going to be a rough ride.

Don't worry, General AI has always been just a decade away.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#228
post #2

Fun interview but barely any meat for those in the field. Just very general questions and answers, saying that the road is murky, but nothing about e.g. if Transformers / attention are the way to go forward, multi-modal models, reinforcement learning + self-supervised learning.

Yep. Does it ever get around to answering the question implicit in the title: what is it that he is going to do "different" to the rest? Seems more like he's talking to and following up with Altman, "Y Combinator conference" and the rest. Is that "bucking the trend", taking your own "path", really?

Lol I feel like this is going to be a high school valedictorian goes on to be an average student in Stanford kind if story.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#229
post #2

Fun interview but barely any meat for those in the field. Just very general questions and answers, saying that the road is murky, but nothing about e.g. if Transformers / attention are the way to go forward, multi-modal models, reinforcement learning + self-supervised learning.

Yep. Does it ever get around to answering the question implicit in the title: what is it that he is going to do "different" to the rest? Seems more like he's talking to and following up with Altman, "Y Combinator conference" and the rest. Is that "bucking the trend", taking your own "path", really?

I assume it's to know which directions have shown the most recent potential, to catch up on the techniques and literature so you can talk/think intelligently on the matter. But I see your more general point, he has to be careful not to get caught up I the groupthink he is (understandably?) critical of.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#230
post #213

Earlier quoted context omitted.

My take on this is that if anyone can learn a particular skill entirely from an AI, then it's not a skill you'd be able to monetize. And I really have no idea what, if any, are skills that AIs wouldn't be able to tackle in a decade.

People can learn skills from books, which are entirely passive. The learning process ultimately resides within the student; issues of motivation, morale, direction, diligence, discipline, time, and mental health matter a lot more than just going through some material.

No, but that's the thing I was implying (but haven't started clearly) - learning from books vs learning from an AI "teacher". Once the AI reaches a level in which it can "teach" then the game is almost over for that skill.

To clarify, I'd define a major component of effective teaching to be the ability to break down an arbitrary typical problem in that domain into sub-problems and heuristics that are "simple" enough to manage for someone without that skill. If an AI can do that, it can most likely effectively perform the task itself (which cannot be said for a book).

Post reply on HN