I think its a silly idea that consciousness can be produced by computation.
[deleted]
John Carmack's new AGI company, Keen Technologies, has raised a $20M round
231–240 of 643 posts
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#232That’s crazy money for a vaporware seed round, isn’t it?
$20 million for a legit (if small) chance at the most powerful technology in the history of mankind seems like a reasonable investment.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#233AGI - Artificial General Intelligence
(also Adjusted Gross Income)
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#234Earlier quoted context omitted.
We will have something that we ourselves define to be AGI, sure, but then it's easy to hit any goal that way. Is that machine really intelligent? What does that word even mean? Can it think for itself? Is it sentient? Similar to AI, AGI is going to be a new industry buzzword that you can throw at anything and mean nothing.
From the point when an AGI is capable of constructing a slightly better version of itself and has the urge to do so, everything can happen very fast.
? What does 'replication' and 'urge' have to do with anything?
That's arbitrary anthropomorphizing the concept of intelligence.
And FYI we can already write software that can 'replicate' and has the 'urge' to do so very trivially.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#235I don’t understand why you would want AGI. Even ignoring Terminator-esque worst case scenarios, AGI means humans are no longer the smartest entities on the planet. The idea that we can control something like that is laughable.
Why is it so important to you that humans be the smartest beings on the planet?
Because the history of the species on this planet clearly indicates that the smartest one will brutalize and exploit all the rest. There are good economic (and just plainly logical) reasons why adding "artificial" to the equation will not change that.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#236Earlier quoted context omitted.
What, in your view, is the difference?
An AGI is something you give tasks to and it can complete them, for some collection of tasks that would be non-trivial for a human to figure out how to do. It's unclear at this point whether you could engineer an AGI, and even more unclear whether the AGI, by its nature, would be "sentient" (AKA, self-aware, conscious, having agency). Many of us believe that sentience is an emergent property of intelligence but is no…
Let's say I give your AGI (which is not self aware and does not have a conscience) a task.
The task is to go and jump off the bridge. Your AGI would complete this task with no questions asked, but self-aware AGI would at least ask the question "Why?"
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#237Earlier quoted context omitted.
> AGI Idk what prompted you to say this, but is there a version of AGI that isn't "real" AGI? I don't know how anyone could fake it. I think marketing departments might say whatever they want, but I don't see any true engineers falling for something masquerading as AGI. If someone builds a machine that can unequivocally learn on it's own, replicate itself, and eventually solve ever more complex problems that humans c…
This is upside down. First - we already have software that can unequivocally do the things you just highlighted. Learn? Check. Replicate? Trival. But what does that have to do with AGI? Solve Problems Humans Cannot. Check. So we already have 'AGI' and it's a simple computer program. Thinking about 'AGI' as a discrete, autonomous system makes no sense. We will achieve highly intelligent systems with distributed system…
> Learn? Check.
What software can learn on its own without any assistance from a huamn? I've not heard of anything like this.
> Replicate? Trival. But what does that have to do with AGI?
Like humans, an AGI should be able to replicate. Similar to a von neumann probe.
> Solve Problems Humans Cannot. Check.
What unthinkable problem has an AI solved? Is something capable of solving something so grandiose we almost can't even define the problem yet?
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#238I'm very optimistic for near-term AGI (10 years or less). Even just a few years ago most in the field would have said that it's an "unknown unknown", we didn't have the theory or the models, there was no path forward and so it was impossible to predict. Now we have a fairly concrete idea of what a potential AGI might look like - an RL agent that uses a large transformer. The issue is that unlike supervised training y…
> Now we have a fairly concrete idea of what a potential AGI might look like - an RL agent that uses a large transformer. People have thought Deep RL would lead to AGI since practically the beginning of the deep learning revolution, and likely significantly before. It's the most intuitive approach by a longshot (even depicted in movies as agents receiving positive/negative reinforcement from their environment), but t…
They have? That's the approach they are using? Because that doesn't mesh well with practical reality. Where AGI use Deep RL, it's to improve on vision tasks like object classification, none of them are making any driving decisions - that seems to remain the domain of I guess you could call it discrete logic.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#239Does anyone else subscribe to the idea that AGI is impossible/unlikely without 'embodied cognition', i.e. we cannot create a human-like 'intelligence' unless it has a similar embodiment to us, able to move around a physical environment with it's own limbs, sense of touch, sight, etc. ? Any arguments against the necessity of this? I feel like any AGI developed in silico without freedom of movement will be fundamentally incomprehensible to us as embodied humans.
Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round
#240I'm very optimistic for near-term AGI (10 years or less). Even just a few years ago most in the field would have said that it's an "unknown unknown", we didn't have the theory or the models, there was no path forward and so it was impossible to predict. Now we have a fairly concrete idea of what a potential AGI might look like - an RL agent that uses a large transformer. The issue is that unlike supervised training y…
There's a hardware component here too though.
I think hybrid photonic AI chips handling some of the workload are supposed to hit in 2025 at the latest, and some of the research on gains is very promising.
So we may see timelines continue to accelerate as broader market shifts occur outside just software and models.