Earlier quoted context omitted.
He’s been going on about AI for at least a couple of years now: https://news.ycombinator.com/item?id=21530860 It’s certainly possible that he will have a novel idea, but I haven’t seen anything come out of it yet. I’m sure Carmack’s mathematical ability exceeds that of the average game developer (and certainly my own), but the AI field isn’t short of math whizzes.
He’s been going on about AI for at least a couple of years now: https://news.ycombinator.com/ A whole couple of years, eh? Wow, this AGI thing is taking forever!
John Carmack’s ‘Different Path’ to Artificial General Intelligence
141–150 of 506 posts
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#142Earlier quoted context omitted.
He’s been going on about AI for at least a couple of years now: https://news.ycombinator.com/item?id=21530860 It’s certainly possible that he will have a novel idea, but I haven’t seen anything come out of it yet. I’m sure Carmack’s mathematical ability exceeds that of the average game developer (and certainly my own), but the AI field isn’t short of math whizzes.
I assume Carmack can pick up a lot about a new technical topic in a few years, similarly to how Bill Gates could learn a lot about vaccines and healthcare in a few years. "Hi, I'm (rich and nerd famous person) calling for (expert in field)." Probably spending most of that time being tutored by that experts PhD students.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#143Earlier quoted context omitted.
There are plenty of new scientific results that in both Math and Machine Learning that are essentially 6 months/a few years/a few decades of hard work away from discovery. As a professor once told me: IF you're lucky, after 10 years in academia, you get to be creative and come up with 4-5 ideas once every 5 years or so (when coming up with the suggested list of research for new phd students to do). Then you get to be…
Yeah, so a person like Carmack who takes the risk and spent his career doing technically creative things could maybe make a difference. Probably not, but as long as creativity is so de-incentivized we will never have too many creative individuals around.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#144"So I asked Ilya Sutskever, OpenAI’s chief scientist, for a reading list. He gave me a list of like 40 research papers and said, ‘If you really learn all of these, you’ll know 90% of what matters today.’ And I did. I plowed through all those things and it all started sorting out in my head." Wow, that's going to be one of the more glib things I've read in a while. This is a bit of a Tom Cruise moment. I mean, I get i…
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#145Earlier quoted context omitted.
That depends on whether you believe it is sentient.
I’m not sure this really matters. Mammals are clearly sentient, as a whole, but we don’t treat them as people usually.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#146"So I asked Ilya Sutskever, OpenAI’s chief scientist, for a reading list. He gave me a list of like 40 research papers and said, ‘If you really learn all of these, you’ll know 90% of what matters today.’ And I did. I plowed through all those things and it all started sorting out in my head." Wow, that's going to be one of the more glib things I've read in a while. This is a bit of a Tom Cruise moment. I mean, I get i…
The models aren't particularly hard to implement, so a person who has spent his life and is one of the best game engine programmers in the world I don't think it would take that long to implement the cutting edge of todays machine learning models. Compared to game graphics shaders and the complex interactions you have to work with to get those performant and work correctly and display all the gameplay that happens th…
Indeed. A somewhat sharp schoolchild could build a light bulb or an electric motor/generator, and understand the basic underlying principles, in a pretty short time. But how many decades did it take the first researchers and inventors of those things to get to that same point?
Heck, there was a high school kid who built a primitive semiconductor fab in their garage.[0]
But for novel advancements, even getting to the point where you have an idea of what isn't impossible is half the battle.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#147I don't want to be an utter bore, but 60% chance of AGI by 2030, taken at face value, would have prompted me as an interviewer to more urgently ask deeper questions about safety. For a long time I have tried to comfort myself that brains are complicated, AI is hard, and maybe there's just a complexity barrier that is going to prevent any sort of hard takeoff scenario. Maybe we can have subhuman AGI that can do lots o…
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#148Problems of the form “create a machine that can do X” are tractable. AGI is not because no one can agree on what intelligence is.
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#149Carmack makes four points—some of which I agree with—that are unfortunately disturbing when taken in totality: a) We’ll eventually have universal remote workers that are cloud-deployable. b) That we’ll have something on the level of a toddler first, at which point we can deploy an army of engineers, developmental psychologists, and scientists to study it. c) The source code for AGI will be a few tens of thousands of…
If AGI is really an intelligent agent, our random supervillain would have to do what any real-life villain would need to do: convince his minions of his plan using persuasion or money. I don't think the overall danger would increase at all.
If the AGI is something less than a human, then what are you worried about?
Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence
#150Earlier quoted context omitted.
I assume Carmack can pick up a lot about a new technical topic in a few years, similarly to how Bill Gates could learn a lot about vaccines and healthcare in a few years. "Hi, I'm (rich and nerd famous person) calling for (expert in field)." Probably spending most of that time being tutored by that experts PhD students.
I'm sure he can, but has Bill gates done actual groundbreaking research into vaccines, or just made intelligent decisions about what kind of research to fund? I think the latter.