Arguably he got started on this years ago. The story goes that Quake 3's AI was so sophisticated, that when left alone for 4 years on a bot vs bot server, the units learned pacifism as a self-preservation strategy. https://www.forbes.com/sites/erikkain/2013/07/02/quake-iii-a...
That story is fake, its source is 4chan. Carmack himself debunked it[1]
I don't understand how he could contribute to the field of AGI research from home, by himself, and maybe with his son. It's the kind of problem that requires incredible amounts of data, hardware, and theory to make any progress. Wouldn't it make more sense for him to join a cutting-edge team, like DeepMind or OpenAI?
I think many people expect that a lot of the missing "special sauce" for AGI (if anyone can figure it out at all) is going to be something for which massive GPU power isn't a key factor.
Maybe there is no secret. Just like image recognition is just a bunch of well connected matrices running a dumb algorithm, but at a great speed by GPUs, intelligence is just 100 billions dumb nano-computers with the logic of a fairly simple finite state automata, but with 10 thousand network connections per node. How does nematoda transfer intelligence to its copies? By encoding the FSA properties in the DNA. If this is the case, we'll see the next chapter of AI once a typical smartphone runs a million dumb programmable nanocomputers with a very sense network topology: people will just run the same dumb algorithms on this devices and discover that it exhibits the basic properties of nematoda-level AI. And thus AI would be a dumb engineering problem.
What's a useful definition of what AGI is? If you have a computer that does some clever AI stuff, what criteria do you look for to decide that it has a general intelligence?
AGI means it can solve any problem posed to it and interface with any sensory and motor peripheral.
Progress in AI is due to data and computational power advances. I wonder what kind of advances are needed for AGI. 1. Biological brains are non-differentiable spiking networks much more complicated than backpropagated ANNs. 2. Ion channels may or may not be affected by quantum effects. 3. The search space is huge (but organisms aren't optimal and natural selection is probably local search) 4. If it took ~3.8b years t…
This reminds me of a interesting armchair moral dilemma: Assume we have the tech to replicate/simulate a biological brain. Now say we want to study the effects of extreme pain/torture etc on the brain. Instead of studying living animals or humans we'd just simulate a brain, and simulate sending it pain signals and see what happens. But, if this is a 100% replicated brain, doesn't that mean its suffering is just as re…
> But, if this is a 100% replicated brain, doesn't that mean its suffering is just as real as a real brain's suffering, and therefor just as cruel?
Yann LeCun's [0] comment on the post: Welcome to the club, John. A word of warning though: There is no such thing as AGI. Reaching human-level AI is a good goal. But human intelligence is very, very specialized. [0] https://en.wikipedia.org/wiki/Yann_LeCun?fbclid=IwAR2e9mzCqS...
LeCun is more accomplished and smarter than I will ever be, but his thoughts on the term 'AGI' just seem like dumb pedantry regarding word definitions to me.
Humans optimize for activating the opioid receptor. These receptors are distributed all over the brain and tied into all sorts of subtle neural networks. That's why opioid addicts don't do much when they're high. As far as the entire structure of the brain is concerned, an opioid addict's brain is done optimizing and the fitness function is pegged at 1. I think an AGI will end up being like an AI that plays the Sims…
Isn't this backwards a bit or did I get it wrong - not sure if I am phrasing this right. But to simplify from a laymen's perspective a reading of The Selfish Gene - all creatures will work to continue their genetic line unless misdirected as you describe. So if in some way continuing their genetic offspring is something that activates their opioid receptor, that's what we'll do, creating and raising offspring or as grandparents/cousins/aunts/uncles, helping raise relatives. This can be applied generally to all life on earth.
What a weird future it would be if Carmack turns out to be the one to figure out the critical path and get it all working. An entire field of brilliant researchers be damned. History books (for as long as those continue to exist) would cite AGI as his major contribution to society, and his name would be more renowned than Edison or Tesla. An Einstein. None of his other contributions will matter, as the machines will…
Doom. Just think about that name for a second. He might really be onto something.
I am thinking the guy that made Doom is the guy that's making SkyNet and I'm totally cool with that.