Earlier quoted context omitted.
> AGI Idk what prompted you to say this, but is there a version of AGI that isn't "real" AGI? I don't know how anyone could fake it. I think marketing departments might say whatever they want, but I don't see any true engineers falling for something masquerading as AGI. If someone builds a machine that can unequivocally learn on it's own, replicate itself, and eventually solve ever more complex problems that humans c…
The way to fake it would be to conceal the details of the AGI as proprietary trade secrets, when the real secret is the human hidden behind the curtain.
John Carmack's new AGI company, Keen Technologies, has raised a $20M round
201–210 of 643 posts
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#202It will decide our fate in a microsecond: extermination.
I agree with this. Optimists might think that the AGI won't be connected to any network, so it can't interact with the physical world. I doubt that. People will be stupid enough to have weapons controlled by that AGI (because arms race!) and then it's over. No sufficiently advanced AGI will think that humans are worth keeping around.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#203Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#204Earlier quoted context omitted.
By definition it has to be any task otherwise it wouldn't be general. What tasks wouldn't an AGI be able to perform and still be an AGI?
Reliably trick a humans into thinking it's a human. That's it.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#205Earlier quoted context omitted.
what consensus? i think most researchers remain skeptical
Uh... no. Most researchers have moved their timelines to somewhere between 2030 and 2040. You can argue they're wrong, but there is absolutely a general consensus that AGI is going to be this generation.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#206I don’t understand why you would want AGI. Even ignoring Terminator-esque worst case scenarios, AGI means humans are no longer the smartest entities on the planet. The idea that we can control something like that is laughable.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#207AGI will not happen in discrete solutions anyhow.
Siri - an interactive layer over the internet with a few other features, will exhibit AGI like features long, long before what we think of as more distinct automatonic type solutions.
My father already talks to Siri like it's a person.
'The Network Is the Computer' is the key thing to grasp here and our localized innovations collectively make up that which is the real AGI.
Every microservice ever in production is another addition to the global AGI incarnation.
Trying to isolate AGI 'instances' is something we do because humans are automatons and we like to think of 'intelligence' in that context.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#208Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#209Earlier quoted context omitted.
The way to fake it would be to conceal the details of the AGI as proprietary trade secrets, when the real secret is the human hidden behind the curtain.
Real AGI would solve this. It wouldn't allow itself to be concealed. Or rather, it would be its own decision. A company couldn't control real AGI.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#210I don’t understand why you would want AGI. Even ignoring Terminator-esque worst case scenarios, AGI means humans are no longer the smartest entities on the planet. The idea that we can control something like that is laughable.
what if humanity's role is to create an intelligence that exceeds it and cannot be controlled? Can humans not desire to be all watched over by machines of loving grace? More seriously, while I don't think it's a moral imperative to develop AGI, I consider it a desirable research goal in the same way we do genetic engineering - to understand more about ourselves, and possibly engineer a future with less human sufferin…