Live data from Hacker News

John Carmack's new AGI company, Keen Technologies, has raised a $20M round

twitter.com

201–210 of 643 posts

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#201

Earlier quoted context omitted.

> AGI Idk what prompted you to say this, but is there a version of AGI that isn't "real" AGI? I don't know how anyone could fake it. I think marketing departments might say whatever they want, but I don't see any true engineers falling for something masquerading as AGI. If someone builds a machine that can unequivocally learn on it's own, replicate itself, and eventually solve ever more complex problems that humans c…

The way to fake it would be to conceal the details of the AGI as proprietary trade secrets, when the real secret is the human hidden behind the curtain.

Real AGI would solve this. It wouldn't allow itself to be concealed. Or rather, it would be its own decision. A company couldn't control real AGI.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#202

It will decide our fate in a microsecond: extermination.

I agree with this. Optimists might think that the AGI won't be connected to any network, so it can't interact with the physical world. I doubt that. People will be stupid enough to have weapons controlled by that AGI (because arms race!) and then it's over. No sufficiently advanced AGI will think that humans are worth keeping around.

Once it figures out how to rewire itself to increase its intelligence, we're toast.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#203
post #44

Earlier quoted context omitted.

Do game dev skills transfer to AGI? I know he's a smart guy, but I don't think that's a given.

If he succeeds, his skillet becomes the Platonic ideal of an AGI developer.

skillet? well I for one welcome our new kitchen utensil overlords.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#204
post #67

Earlier quoted context omitted.

By definition it has to be any task otherwise it wouldn't be general. What tasks wouldn't an AGI be able to perform and still be an AGI?

Reliably trick a humans into thinking it's a human. That's it.

I believe that's the Turing Test, not necessarily a definition (or requirement) for AGI.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#205
post #41

Earlier quoted context omitted.

what consensus? i think most researchers remain skeptical

Uh... no. Most researchers have moved their timelines to somewhere between 2030 and 2040. You can argue they're wrong, but there is absolutely a general consensus that AGI is going to be this generation.

Sure...just like there was during the last episode of AI hype a generation ago.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#206

I don’t understand why you would want AGI. Even ignoring Terminator-esque worst case scenarios, AGI means humans are no longer the smartest entities on the planet. The idea that we can control something like that is laughable.

Nothing about AGI implies awareness. Something like GPT3 or DALL-E that can be trained for a new task without being purpose built for that task is AGI.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#207
There's no such thing as AGI in our near future, it's a moniker, a meme, something to 'strive' for but not 'a thing'.

AGI will not happen in discrete solutions anyhow.

Siri - an interactive layer over the internet with a few other features, will exhibit AGI like features long, long before what we think of as more distinct automatonic type solutions.

My father already talks to Siri like it's a person.

'The Network Is the Computer' is the key thing to grasp here and our localized innovations collectively make up that which is the real AGI.

Every microservice ever in production is another addition to the global AGI incarnation.

Trying to isolate AGI 'instances' is something we do because humans are automatons and we like to think of 'intelligence' in that context.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#209

Earlier quoted context omitted.

The way to fake it would be to conceal the details of the AGI as proprietary trade secrets, when the real secret is the human hidden behind the curtain.

Real AGI would solve this. It wouldn't allow itself to be concealed. Or rather, it would be its own decision. A company couldn't control real AGI.

What’s it going to do, break out of its own simulation?

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#210
post #147

I don’t understand why you would want AGI. Even ignoring Terminator-esque worst case scenarios, AGI means humans are no longer the smartest entities on the planet. The idea that we can control something like that is laughable.

what if humanity's role is to create an intelligence that exceeds it and cannot be controlled? Can humans not desire to be all watched over by machines of loving grace? More seriously, while I don't think it's a moral imperative to develop AGI, I consider it a desirable research goal in the same way we do genetic engineering - to understand more about ourselves, and possibly engineer a future with less human sufferin…

One could argue that humanity's role this far has been to create intelligences that exceed it. Namely reproducing offspring and educating them.
Post reply on HN