Live data from Hacker News

John Carmack: I’m going to work on artificial general intelligence

facebook.com

461–470 of 930 posts

Re: John Carmack: I’m going to work on artificial general intelligence

#461
post #226
post #187

Earlier quoted context omitted.

Current ML technology probably has little or nothing to do with whatever technology will eventually be needed to produce true AGI.

And programmers are probably not the ones who will come up with AI ideas. I'd bet on mathematicians that prove those Fermat's or ABC theorems.

That’s assuming maths is the fundamental building block of our brain, our consciousness. I happen to think there are some physical and chemical givens preceding it :)

Re: John Carmack: I’m going to work on artificial general intelligence

#462

This doesn't surprise me at all. He went on a week long cabin-in-the-middle-of-nowhere trip about a year ago to dive in to AI (that's all this guy needs to become pretty damn proficient). (edit: I'm not claiming he's a field expert in a week guys, just that he can probably learn the basics pretty fast, especially given ML tech shares many base maths with graphics) As recent as his last Oculus Connect keynote, he exto…

> about a year ago to dive in to AI (that's all this guy needs to become pretty damn proficient). (edit: I'm not claiming he's a field expert in a week guys, just that he can probably learn the basics pretty fast, especially given ML tech shares many base maths with graphics) To be honest anyone who has a very good working knowledge of Linear Algebra can learn much of ML-math in a day. There really isn't anything mat…

If you know about math you're just as good at ML as a person who read everything about swimming is in swimming. You got to run experiments to see what happens, build an intuition, understand the problem from the inside. Math leaves you with a few pretty formulas and nothing else.

Re: John Carmack: I’m going to work on artificial general intelligence

#463

Earlier quoted context omitted.

Mathematically, AI is a pretty well modelled field. AGI is a philosophical problem.

you're possibly thinking of the problem of consciousness, which is a totally separate thing. AGI is just what it says on the tin - a general intelligence. That is, a problem solver that can operate at a human or greater level in a broad variety of domains. This ability is plausibly totally orthogonal to "having the lights on" - having subjective experience.

That's just what an ML expert would say ;p Problem solvers, maximizers, and utility functions all go in the waste bin when working on AGI. And the problem peals away into other large "hard problems," like the nature of consciousness. NLP can just follow rules, but language understanding (before even reaching some general, high school level), requires knowledge outside of language itself. That leads to questions about embodiment and phenomenal consciousness, p-zombies, and the like. If it was an easy problem to encapsulate, it would have been "solved" by now.

Re: John Carmack: I’m going to work on artificial general intelligence

#464

Earlier quoted context omitted.

A dog brain can't design an artificial dog brain, and a human brain probably can't design a human-level AGI. It will likely be machine-evolved on cheap, massively parallel hardware, with the key problem being speeding up evolutionary search.

A dog brain can't design an artificial dog brain, and a human brain probably can't design a human-level AGI. That's ridiculous. A dog can't draw a dog, therefore a human can't draw a human?

https://lmgtfy.com/?q=analogy

Re: John Carmack: I’m going to work on artificial general intelligence

#465
post #311

Wow, there are a lot of people in this thread arguing whether or not John Carmack has the right skills to help AGI, or about the specifics of his knowledge. Do you all realize you're arguing about nothing? Good for him for doing something he seems excited about. Maybe we should all stop gossiping and go do something we're excited about too.

Yeah, this comments section is a bunch of gossiping hens trying to get it on record that they don't think his retirement hobby will amount to anything. Pretty sad in what's presumably a community of fellow craftspeople and makers.

The human brain really can't handle the crippling adversity of a fellow human announcing an aspiration. Hopefully our AGI replacement can.

Re: John Carmack: I’m going to work on artificial general intelligence

#466

Earlier quoted context omitted.

A dog brain can't design an artificial dog brain, and a human brain probably can't design a human-level AGI. That's ridiculous. A dog can't draw a dog, therefore a human can't draw a human?

It is sorta interesting to wonder about how far we can bootstrap ourselves. We went from trees to moon landings and neural networks, maybe we and our tools can rise to the top of the Kardashev scale (barring any cataclysms.) If so, it implies there's a sort of intelligence-completeness, where species can accomplish any physically possible objective. Or maybe we will peter out before achieving practical fusion, quantu…

We've never hand-designed anything as complex and novel as what bio evolution discovers. We can't even ship error-free word processors. The more bug-free space shuttle code doesn't do much relative to AGI.

"Humans create humans" via what bio evolution found.

Re: John Carmack: I’m going to work on artificial general intelligence

#467
post #233

Progress in AI is due to data and computational power advances. I wonder what kind of advances are needed for AGI. 1. Biological brains are non-differentiable spiking networks much more complicated than backpropagated ANNs. 2. Ion channels may or may not be affected by quantum effects. 3. The search space is huge (but organisms aren't optimal and natural selection is probably local search) 4. If it took ~3.8b years t…

This reminds me of a interesting armchair moral dilemma: Assume we have the tech to replicate/simulate a biological brain. Now say we want to study the effects of extreme pain/torture etc on the brain. Instead of studying living animals or humans we'd just simulate a brain, and simulate sending it pain signals and see what happens. But, if this is a 100% replicated brain, doesn't that mean its suffering is just as re…

Fwiw, after a certain amount of pain, brain "transcends it": everything disappears, there are some curious colors here and there, but there is no pain. Experienced that during an in ear infection.

Re: John Carmack: I’m going to work on artificial general intelligence

#468

Earlier quoted context omitted.

> (edit: I'm not claiming he's a field expert in a week guys, just that he can probably learn the basics pretty fast, especially given ML tech shares many base maths with graphics) This may be his biggest impediment. ML has gotten very far with looking at problems as linear algebraic systems, where optimizing a loss function mathematically yields a good solution to a precisely defined (and well circumscribed) classif…

Humans are not AGI's. We're specialised in human survival, not general intelligence. We're pretty limited in intelligence in many ways, actually, and the environment doesn't support generality. Without a proper challenge an agent would not become super intelligent. The cost of developing such an intelligence would conflict with the need to minimise energy for survival.

It's best to think about AGI as... at what point can you drop out of high school and still do well in life (or do you even need high school). It's true that it's not a survival issue, but sadly, it's not a test of "pure knowledge" either. There is a great deal of social structure, even "fluff" that is only relevant for interaction (like getting an 80's reference).

Re: John Carmack: I’m going to work on artificial general intelligence

#469
post #338
post #327

Earlier quoted context omitted.

How did you rule out other attributes in the voting, such as charisma, political environment, society wellness, etc?

The "voters" are not humans, but environments. A simple example of an environment would be a room with two buttons, one of which rewards you when you press it, and one of which punishes you when you press it. Independently of anything like charisma, society wellness, etc. If X figures this out quicker and pushes the "reward" button more often than Y, then we consider this simple environment to "vote" for X in the int…

This simple environment is a form of the Multi-arm Bandit Problem, which has been researched and productised long ago. It's being used in advertising among other things.

https://en.wikipedia.org/wiki/Multi-armed_bandit

Re: John Carmack: I’m going to work on artificial general intelligence

#470
post #388
post #311

Wow, there are a lot of people in this thread arguing whether or not John Carmack has the right skills to help AGI, or about the specifics of his knowledge. Do you all realize you're arguing about nothing? Good for him for doing something he seems excited about. Maybe we should all stop gossiping and go do something we're excited about too.

What is actually being argued is the cult worship of a particular engineer. I am against cult worship, so find the fact that Carmack is entering this space simply not news worthy. Yet here it is. Do I wish him the best of luck and hope he cracks the problem? Of course, all the same I would wish that of an upstart PhD student. Yet, the announcements of a brilliant PhD student attending a university to work on AGI is s…

That he is leaving oculus is big enough news to be here on its own.
Post reply on HN