Like Mozart, Beethoven, and Chopin, John Carmack is one of those men who will never really die. He’ll simply become code.
John Carmack’s ‘Different Path’ to Artificial General Intelligence
191–200 of 506 posts
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#192This paragraph took me aback: But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like you can cloud-access computing resources, if you could cloud-access essentially arti…
Wouldn’t this be literal slavery? AGI = a person Instantiating people for work and ending their existence afterward seems like the virtual hell that Iain M Banks and Harlan Ellison wrote about. https://en.wikipedia.org/wiki/I_Have_No_Mouth,_and_I_Must_Sc...
Would turning one off be murder? Or does that only apply to deletion?
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#193This paragraph took me aback: But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like you can cloud-access computing resources, if you could cloud-access essentially arti…
Wouldn’t this be literal slavery? AGI = a person Instantiating people for work and ending their existence afterward seems like the virtual hell that Iain M Banks and Harlan Ellison wrote about. https://en.wikipedia.org/wiki/I_Have_No_Mouth,_and_I_Must_Sc...
We still have a form of slavery in the US. Prison labor is forced work that earns pennies a day: https://www.aclu.org/news/human-rights/captive-labor-exploit...
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#194This paragraph took me aback: But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like you can cloud-access computing resources, if you could cloud-access essentially arti…
Nice how the goal for artificial general AI (which is literally defined as a sentient artificial being) is to commoditize it and enslave it to capitalism.
It's funny that all of these weird fantasies people have about AI are about replacing the rank and file workers. Why isn't anyone fantasizing about building an AI that out-performs the best stock traders, or captains an industry better than famous CEOs. I think a lot of it is just people projecting weird power fantasies on others.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#195This paragraph took me aback: But if I just look at it and say, if 10 years from now, we have ‘universal remote employees’ that are artificial general intelligences, run on clouds, and people can just dial up and say, ‘I want five Franks today and 10 Amys, and we’re going to deploy them on these jobs,’ and you could just spin up like you can cloud-access computing resources, if you could cloud-access essentially arti…
> People are going to have to up their game. Let's help them by making adult education more affordable. The good thing is that education will be provided to the mases by a cluster of Franks and Amys configured as teachers and tutors. /(sarcasm with a hint of dread)
My take on this is that if anyone can learn a particular skill entirely from an AI, then it's not a skill you'd be able to monetize.
And I really have no idea what, if any, are skills that AIs wouldn't be able to tackle in a decade.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#196Would be interesting to get a list of those 40 papers mentioned
Came here to say the same thing, but a few off the top of my head - attention is all you need - image is worth 16x16 words (vit) - openai clip - transformer XL - memorizing transformers / retro - language models are few shot learners (gpt) A few newer papers - recurrent block wise transformers - mobilevit (conv + transformer) - star (self taught transformer)
Most of these papers you list are about the model, and there is the original Transformer paper, and most of the others are some variations of the Transformer.
I think to get into the field, to get a good overview, you should also look a bit beyond the Transformer. E.g. RNNs/LSTMs are still a must learn, even though Transformers might be better in many tasks. And then all those memory-augmented models, e.g. Neural Turing Machine and follow-ups, are important too.
It also helps to know different architectures, such as just language models (GPT), attention-based encoder-decoder (e.g. original Transformer), but then also CTC, hybrid HMM-NN, transducers (RNN-T).
Diffusion models is also another recent different kind of model.
But then, what comes really short in this list, are papers on the training aspect. Most of the papers you list do supervised training, using cross entropy loss. However, there are many others:
You have CLIP in here, specifically to combine text and image modalities.
There is the whole field on unsupervised or self-supervised training methods. Language model training (next label prediction) is one example, but there are others.
And then there is the big field on reinforcement learning, which is probably also quite relevant for AGI.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#197What would we actually consider an AGI? Wikipedia lists the following tests > The Turing Test (Turing): A machine and a human both converse unseen with a second human, who must evaluate which of the two is the machine, which passes the test if it can fool the evaluator a significant fraction of the time. Note: Turing does not prescribe what should qualify as intelligence, only that knowing that it is a machine should…
I think GTP is very far from solving 1), at least if you happen to know anything about LLMs.
I think the easiest one of these would be 4) actually.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#198Earlier quoted context omitted.
Wouldn’t this be literal slavery? AGI = a person Instantiating people for work and ending their existence afterward seems like the virtual hell that Iain M Banks and Harlan Ellison wrote about. https://en.wikipedia.org/wiki/I_Have_No_Mouth,_and_I_Must_Sc...
We still have a form of slavery in the US. Prison labor is forced work that earns pennies a day: https://www.aclu.org/news/human-rights/captive-labor-exploit...
Why is that a bad thing? Most of those people are a burden to society. Let them pay it down a little.
I mean I’d rather they were getting free education and preparing themselves for reintegration into society, but it’s not a perfect world. Prisons in the US are oriented towards punishment and labor can be a part of that. They should be oriented towards rehabilitation.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#199Earlier quoted context omitted.
> People are going to have to up their game. Let's help them by making adult education more affordable. The good thing is that education will be provided to the mases by a cluster of Franks and Amys configured as teachers and tutors. /(sarcasm with a hint of dread)
My take on this is that if anyone can learn a particular skill entirely from an AI, then it's not a skill you'd be able to monetize. And I really have no idea what, if any, are skills that AIs wouldn't be able to tackle in a decade.
And here's a more disturbing thought I just had: management (or at least middle management) is probably going to be a relatively easy role for AIs to step into. So if there will be any roles that are difficult for AIs, it'll be the AI manager hiring five Franks and ten Amys from the human population to tackle these.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#200Earlier quoted context omitted.
We still have a form of slavery in the US. Prison labor is forced work that earns pennies a day: https://www.aclu.org/news/human-rights/captive-labor-exploit...
Why is that a bad thing? Most of those people are a burden to society. Let them pay it down a little. I mean I’d rather they were getting free education and preparing themselves for reintegration into society, but it’s not a perfect world. Prisons in the US are oriented towards punishment and labor can be a part of that. They should be oriented towards rehabilitation.
The justice system is not just, plain and simple. People face higher rates of incarceration because of their race, country of origin, etc.