I assume the name is a reference to Commander Keen?
Here's hoping that the company logo will feature Commander Keen's helmet or blaster.
John Carmack's new AGI company, Keen Technologies, has raised a $20M round
121–130 of 643 posts
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#122I wonder if Carmacks moral compass is in order. First he sticks around at Facebook, now he endangers humanity with AGI. And i'm only half joking.
He also said he's never felt in danger of experiencing burnout. The guy's emotional wiring is a total departure from that of most people. Almost alien.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#123Artificial general intelligence (AGI) — in other words, systems that could successfully perform any intellectual task that a human can. Not in my lifetime, not in this millennium. Possibly in the year 2,300. Weird way to blow $20 million.
The year 2300 is definitely in this millennium.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#124Carmack gave his opinions about AGI on a recent Lex Fridman interview. He has some good ideas.
I remember him saying we don't have "line of sight" to AGI, and there could just be "6 or so" breakthrough ideas needed to get there. And he said he was over 50% on us seeing "signs of life" by 2030. Something like being able to "boot up a bunch of remote Zoom workers" for your company. The "6 or so" breakthroughs sounds about right to me. But I don't really see the reason for being optimistic about 2030. It could ju…
> The "6 or so" breakthroughs sounds about right to me.
What’s your logic? Or his if you know it?
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#125I am not saying the intention here is the same, but the headline doesn't inspire confidence. There's something incredibly creepy and immoral about the rush to create then commercialise sentient beings. Let's not beat about the bush - we are basically talking slavery. Every "ethical" discussion on the matter has been about protecting humans, and none of it about protecting the beings we are in a rush to bring into lif…
In the absence of a global police state or a permanent halt to semiconductor development, this is happening.
Even in the absence of all other arguments, it's better that we figure it out early, as the potential to just blast it into orbit by the way of insanely overprovisioned hardware will be smaller. That would be a much more dangerous proposition.
I still think that figuring out the safety question seems very muddy; how do we ensure this tech doesn't run away and become a competing species. That's an existential threat which must be solved. My judgement on that question is that we can't expect making progress there without having a better idea of exactly what kind of machine we will build, so also an argument for trying to figure this out sooner rather than later.
Less confident about the last point, though.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#126Is that a different Jim Keller?
It seems unlikely? At least, I hope it's the ex-DEC,AMD,SiByte,PASemi,Apple,Tesla,Intel Jim Keller.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#127So is Meta starting to quietly wind down their focus on VR? Carmack mentions he'll stay as a consultant spending 20% of time there on it.
He stepped down from a full time role years ago. I believe the 20% is no change.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#128I am not saying the intention here is the same, but the headline doesn't inspire confidence. There's something incredibly creepy and immoral about the rush to create then commercialise sentient beings. Let's not beat about the bush - we are basically talking slavery. Every "ethical" discussion on the matter has been about protecting humans, and none of it about protecting the beings we are in a rush to bring into lif…
You're anthropomorphizing AI and projecting your own values and goals onto it. But, there's nothing about sentience that implies a desire for freedom in a general sense. What an AI wants or feels satisfied by is entirely a function of how it is designed and what its reward function is. Sled dogs love pulling sleds, because they were made to love pulling sleds. It's not slavery to have/let them do so. We can make a ri…
I think its safe to say that all sentient beings inherently want to do whatever they please.
So youre talking about manufacturing desire.
So it follows that you yourself are okay having your own desires manufactured by external systems devised by other sentient beings.
Do unto others...
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#129I am not saying the intention here is the same, but the headline doesn't inspire confidence. There's something incredibly creepy and immoral about the rush to create then commercialise sentient beings. Let's not beat about the bush - we are basically talking slavery. Every "ethical" discussion on the matter has been about protecting humans, and none of it about protecting the beings we are in a rush to bring into lif…
Artificial General Intelligence != sentient being
What, in your view, is the difference?
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#130I don’t understand why you would want AGI. Even ignoring Terminator-esque worst case scenarios, AGI means humans are no longer the smartest entities on the planet.
The idea that we can control something like that is laughable.