Live data from Hacker News

John Carmack: I’m going to work on artificial general intelligence

facebook.com

551–560 of 930 posts

Re: John Carmack: I’m going to work on artificial general intelligence

#551
post #181

Roko's basilisk[0] will remember this. 0. https://rationalwiki.org/wiki/Roko's_basilisk

I wonder what would happen if Carmack teamed up with Yudkowsky and his cult; Carmack's practicality with the imagination of people who non-facetiously talk about acausal deals with mulitiversal AIs could be a match made in heaven.

Re: John Carmack: I’m going to work on artificial general intelligence

#552

Earlier quoted context omitted.

> I am not convinced current AI is the approach to an AGI This is a non-sequitor. I didn't argue that current AI theory, or Kaggle, will lead us to AGI. > Kaggle is almost just an optimization fest Public machine learning competitions have produced a lot of innovative learning techniques. If Kaggle is so easy, and AGI so hard, it would follow that anyone tackling AGI would have some experience applying machine learni…

Ok, I'll take a shot: "it would follow that anyone tackling AGI would have some experience applying machine learning competitively in some public space". No, that would absolutely not follow. (I'm a pretty good devil's advocate, but I can't with this one.) And given AGI would come from some completely new breakthrough not related to the current practice of "machine learning", competitions may be completely moot. They…

Thank you for your reply.

Turning a blind eye to existing knowledge may result in reinventing things that already exist. Nobody expects students to follow the same concepts as their teachers, the point is just to leverage existing knowledge.

> I could even imagine a stumbling AGI being very stupid compared to just about any machine learning solution thrown at it - yet being undeniably AGI. Like a dog not being very good at DOTA, Star Craft or Chess, yet it undeniably possesses some kind of general intelligence.

People have debated whether animals are intelligent for ages. This is another type of problem, how to define intelligence. The most famous attempt in recent times is the Turing test.

Re: John Carmack: I’m going to work on artificial general intelligence

#555

This is encouraging. If you're going to work on artificial general intelligence, a reasonable context in which to work on it is game NPCs. They have to operate in a world, interact with others, survive, and accomplish goals. Simulator technology is now good enough that you can do quite realistic worlds. Imagine The Sims, with a lot more internal smarts and real physics, as a base for work. Robotics has the same issue…

It however has a huge bias towards human-like ai. Maybe it's not smart to narrow down to copying us so quickly.

I mean: maybe it's more efficient to have it read all of wikipedia really well before adding all the other noisy senses.

Re: John Carmack: I’m going to work on artificial general intelligence

#556

Earlier quoted context omitted.

What, pray tell, did Elon do that is "novel"?

He made it cool to drive an electric car.

He shifted a whole industry towards a new paradigm. Look at Germany, they are desperate to catch up with Tesla, finally moving into electric cars. Without Elon they would keep selling their Diesel scam for the next decades.

Re: John Carmack: I’m going to work on artificial general intelligence

#557

Earlier quoted context omitted.

> even rodents can outperform state of the art models at general tasks Rodents can't play Go or a lot of other humanly-meaningful tasks. We don't need to build an artificial cell. A cell is too many components that by blind luck happened to find ways to work together, this is as far from efficient design as can be. The same way we don't build two-legged airplanes, we don't need anything that's close to the wet spiky…

The problem with the analogy is that the car, by far, is not a general transportation device. Practically, most cars are solving a very constrained transportation problem: moving on roads that humans made. We don't have anything remotely close to a wetware-enabled transportation device, something that can move on flat land, climb mountains, swim in bodies of water, crawl in caves, hide in trees. Within the constraine…

It's also interesting in the context of how we build our technology in general: we constraint our environments just as much we develop tools that operate in them. E.g. much as cars were created for roads, we adapted our communities and the terrain around them by building roads and supporting infrastructure. A lot of things around us rely on access to clean water at pressure, which is something we built into our environments, etc.

Re: John Carmack: I’m going to work on artificial general intelligence

#558
post #388
post #311

Wow, there are a lot of people in this thread arguing whether or not John Carmack has the right skills to help AGI, or about the specifics of his knowledge. Do you all realize you're arguing about nothing? Good for him for doing something he seems excited about. Maybe we should all stop gossiping and go do something we're excited about too.

What is actually being argued is the cult worship of a particular engineer. I am against cult worship, so find the fact that Carmack is entering this space simply not news worthy. Yet here it is. Do I wish him the best of luck and hope he cracks the problem? Of course, all the same I would wish that of an upstart PhD student. Yet, the announcements of a brilliant PhD student attending a university to work on AGI is s…

John Carmack is a genius in at least 3 different things and probably more: business, tech and expression (written or oral). He can explain very complicated things in such a graceful way. I personally consider anything he does to be newsworthy.

Re: John Carmack: I’m going to work on artificial general intelligence

#559

This is encouraging. If you're going to work on artificial general intelligence, a reasonable context in which to work on it is game NPCs. They have to operate in a world, interact with others, survive, and accomplish goals. Simulator technology is now good enough that you can do quite realistic worlds. Imagine The Sims, with a lot more internal smarts and real physics, as a base for work. Robotics has the same issue…

I did my msc thesis in AI back then writing a dedicated simulater for a specific robot used in autonomous systems research. You find that especially when trying to faithfully reproduce sensor signals you need to dive deep into not just the physics of e.g. infrared light, but also the specific electronic operation of the sensor itself. But that kind of realism is not needed for all AGI research. I also spent some year…

Modeling everything realistically is super hard - any interaction with the real-world is so full of the weirdest unexpected electric and mechanical issues. Who hasn't tried it first-hand can't imagine the half of ways that will almost certainly go wrong on the first try :) ... but as you've said for developing the AGI as a concept simplified worlds should work just fine.

Re: John Carmack: I’m going to work on artificial general intelligence

#560
post #440

Earlier quoted context omitted.

Yes but it sounds weird to me because Carmack has spent his whole life involved with games but has not been known for an interest in game AI before.

Game AI has nothing to do with AGI (or even regular AI) beyond the surface level description OP provided. The reason game AI hasn't progressed in the last few decades isn't because technology is holding us back - after all we can already achieve impressive machine learning feats using current-gen GPUs - it's because bad NPC AI is by design , so players can learn to overcome them and succeed. Very few people want to p…

If the "game" is survival and selection for attention (to get compute space, so literal survival) from humans, "interestingness" is what will matter and I think what people will end up finding most interesting is NPCs that feel like other identities they can empathize with and interact with -- work with to build things, spend time in a community with, fall in love with and so on. This really is about virtual world construction more than simple competitive games. I think it may not end up looking like any particular sense of "AGI" we can currently imagine (I really think we can only properly imagine it exactly when it exists, and it seems not to yet), but it will probably be "distributed" enough that the interfacing may not feel like anything at any one particular site.

The game may even be played by saying things on Twitter and becoming interesting enough that people DM you and try to build a relationship with you, while you're a bot.

Post reply on HN