Live data from Hacker News

John Carmack's new AGI company, Keen Technologies, has raised a $20M round

twitter.com

501–510 of 643 posts

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#501
post #322

I believe to create AI, we need to first simulate the universe. It's the only way that makes sense to me apart from some magical algorithm people think will be discovered. I'm doubtful we'll reach it in our lifetimes, true AI running on supercomputers, it seems like the final, end all mission. Like switching your Minecraft world from survival to creative mode.

if we could simulate the universe on the meaningful scale to model intelligence. we wouldn’t need artificial intelligences. we could just simulate a detailed scan of a real human and be done with it (ethical issues aside).

but there would be a drive to simulate this more efficiently. simulate using a classical model and see if the results match well enough. then the atomic level; then looser and lower-resolution chemical/E&M models, and so on. start compressing the elements being simulated (simplify the environment, prune and rearrange the neurons so long as the thing as a whole still acts the same), and so on. there’s a good chance we can go pretty far before the simplified simulation meaningfully diverges from the true simulation.

why can’t this be flipped? start with a simplified model/simulation, and keep adding details until you reach the point of diminishing returns? it’s a reversal of the same search process as above, but if you subscribe to the first approach (do you?), then is the latter approach truly impossible or just difficult in different ways?

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#502
post #456

I don’t understand why you would want AGI. Even ignoring Terminator-esque worst case scenarios, AGI means humans are no longer the smartest entities on the planet. The idea that we can control something like that is laughable.

In the ideal case, an AGI makes solve-able problems that are either impossible, or will take a very long time, for us to solve. There are a lot of problems left to solve, or at least that a lot of people would like to solve, and who knows what new ones will come. If AGI lets them be solved a lot sooner, then there's a strong motivation to build it. Terminator is of course fiction, but AGI being more agent-y than tool…

Even unaligned tool AGIs of a certain level become very very dangerous, becoming genies that give you what you asked and not what you wanted.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#503

Earlier quoted context omitted.

if Carmack's in I'm in. Has he ever been drastically wrong?

Not sure he was right about the "putting down his own cat because it was annoying" thing.

Good lord. I dislike cats, but this is vile. Totally lost any respect I had for Carmack.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#504
post #44

Earlier quoted context omitted.

You are probably right, but if anyone can make a dent Carmak is the person.

Do game dev skills transfer to AGI? I know he's a smart guy, but I don't think that's a given.

Read Michael Abrash's Graphics Programming Black Book for the story of how the original Quake came to life. You'll get an appreciation for John Carmack's ability to thoroughly research widely varying solutions to a problem, quickly create production-quality implementations of the promising ones, and even more quickly abandon the dead ends. The result is this almost boring, seemingly linear progression toward a final product that seems obvious in hindsight, yet it represents a leap forward the way Quake did in the mid-1990s compared to other FPSes at the time. I don't know of other public stories of individual engineers who can span both the very cutting edge of research and the practicalities of shipping real commercial software.

https://github.com/jagregory/abrash-black-book

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#505
Personally I hope this fails because of the disaster AGI would be for low/entry level jobs.

The last thing the world needs is to give technocrats such power. I know it’s an interesting problem to solve but think of who will own that tech in the end…

I hope AGI is never figured out in my lifetime.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#506
post #48

I admire and respect John Carmack. For me he's one of the greats, along with people like Peter Norvig, for example.

[flagged]

Dude do you even know what John Carmack contributed to the space? Take your own advice you gave to 15 those 15 year old boys and read a book on him.

And an aside: DOOM Eternal absolutely rocked. Please state your issues with it as well please list what you would consider an amazing FPS game.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#507
post #334

Earlier quoted context omitted.

What if the AGI ran on a decentralized network that had a financial incentive to continue running? How would you "switch off" an AGI running on Ethereum? Especially when some subset of people will cry murder because the AGI seems like it might be sentient?

That seems like an extremely far fetched scenario to be honest. The comment I replied to sounds like the threat is immediate and real - your scenario does not sound like it. >>How would you "switch off" an AGI running on Ethereum? And where would the AGI get the funds to keep running itself on Ethereum? >> Especially when some subset of people will cry murder because the AGI seems like it might be sentient? Why is th…

> And where would the AGI get the funds to keep running itself on Ethereum?

Well, perhaps Ethereum is too concrete. I meant, imagine that the AGI algorithm itself was something akin to the proof-of-work, and so individual nodes were incentivized to keep it running (as they are with BTC/ETH now). Then we wouldn't be able to just "switch it off", the same way we're not able to switch off these blockchain networks. And that's how SkyNet was born.

15 years ago I would have thought it was pretty far-fetched too. But seeing how the Bitcoin network can consume ~ever-increasing amounts of energy for ~no real economic purpose, and yet we can't just switch it off, has gotten me to think about how this could very well be the case for an AGI, and not that far in the future. It just has to be decentralized (and therefore transnational) and its mechanism bound up with economic incentive, and it will be just as unstoppable as Bitcoin.

I feel kind of bad even just planting this seed of a thought on the internet, to be honest :(

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#508
post #333

Earlier quoted context omitted.

* To his credit Carmack is a one-person brand and attaching your (good) brand to a tainted brand (Facebook) isn't great * Many believe Occulus isn't succeeding fast enough, and so the years Carmack spent on Occulus/Metaverse could have been spent on any number of interesting projects. Although I'm sure the money was amazing and I can't object to him taking it. * If Occulus/Metaverse succeeds it will be a ultra-moneti…

I doubt Carmack is motivated that much by money. He has way more than he'll ever spend.

His reply to this tweet is that he didn't want to spend $20million of his own money on this venture. When you have the option to throw 20m on projects, you can spend it reasonably quickly.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#509

Personally I hope this fails because of the disaster AGI would be for low/entry level jobs. The last thing the world needs is to give technocrats such power. I know it’s an interesting problem to solve but think of who will own that tech in the end… I hope AGI is never figured out in my lifetime.

> The last thing the world needs...

Why do you say that?

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#510

Personally I hope this fails because of the disaster AGI would be for low/entry level jobs. The last thing the world needs is to give technocrats such power. I know it’s an interesting problem to solve but think of who will own that tech in the end… I hope AGI is never figured out in my lifetime.

A literal luddite in the classical sense on Hacker News?

May I suggest you read Anthem, it's only a couple hours read and well worth your time.

- https://www.gutenberg.org/files/1250/1250-h/1250-h.htm

Post reply on HN