Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

John Carmack's new AGI company, Keen Technologies, has raised a $20M round

twitter.com

Post reply on HN
Print view View original

611–620 of 643 posts

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#611

Post by naveen99 »

saulpw wrote: post #507
gambiting wrote: post #370

Earlier quoted context omitted.

That seems like an extremely far fetched scenario to be honest. The comment I replied to sounds like the threat is immediate and real - your scenario does not sound like it. >>How would you "switch off" an AGI running on Ethereum? And where would the AGI get the funds to keep running itself on Ethereum? >> Especially when some subset of people will cry murder because the AGI seems like it might be sentient? Why is th…

> And where would the AGI get the funds to keep running itself on Ethereum? Well, perhaps Ethereum is too concrete. I meant, imagine that the AGI algorithm itself was something akin to the proof-of-work, and so individual nodes were incentivized to keep it running (as they are with BTC/ETH now). Then we wouldn't be able to just "switch it off", the same way we're not able to switch off these blockchain networks. And…

But how would it or it’s nodes even arrive on a consensus ? Suppose it was a self modifying code that took input from the world. How would you decide which node got to provide it input, and to verify that it ran the agi code faithfully ? How would forks be chosen to continue the chain ?

I would think AGI would first be born as a child of a human. Someone who thought they could train software to be more like them then their own biological children.

Or a new Bert-religion…

I mean there are lots of applications of ai. Probably the best is for future programmers to learn how to train it and use it.

deep learning is quite general and it’s ai. Consciousness and independence are irrelevant and not really needed.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#612

Post by Daniel_sk »

dqpb wrote: post #533
smnplk wrote: post #208

I think its a silly idea that consciousness can be produced by computation.

I think its a silly idea that consciousness cannot be produced by computation.

It may have some physical aspect to it - some property of matter (panpsychism?) or quantum effects.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#613

Post by gushogg-blake »

wcerfgba wrote: post #239

Does anyone else subscribe to the idea that AGI is impossible/unlikely without 'embodied cognition', i.e. we cannot create a human-like 'intelligence' unless it has a similar embodiment to us, able to move around a physical environment with it's own limbs, sense of touch, sight, etc. ? Any arguments against the necessity of this? I feel like any AGI developed in silico without freedom of movement will be fundamentall…

Yes! I have a feeling that as you define the goal of "something that has human-like intelligence but isn't human" more clearly, the less sense it will make because it will become clear that our idea of intelligence depends heavily on the specific ways that humans relate to the world. I wrote a blog post on this - https://gushogg-blake.com/posts/agi

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#614

Post by wibblewobble124 »

imposter wrote: post #610
wcerfgba wrote: post #239

Does anyone else subscribe to the idea that AGI is impossible/unlikely without 'embodied cognition', i.e. we cannot create a human-like 'intelligence' unless it has a similar embodiment to us, able to move around a physical environment with it's own limbs, sense of touch, sight, etc. ? Any arguments against the necessity of this? I feel like any AGI developed in silico without freedom of movement will be fundamentall…

What's the difference between moving around and picking up a document, to say hitting an API endpoint to fetch the content of the same document?

Human and animals interaction is all physical. Babies and early children spend most of their brain development on physicality. By depriving a mind of having a body, that mind cannot have empathy for the human condition or animals, the idea of living in a body will only be abstract. Have you seen the movie Johnny Got His Gun? It’s one big statement that being disembodied is hell.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#616

Post by WastingMyTime89 »

wruza wrote: post #380
version_five wrote: post #267

Earlier quoted context omitted.

> Who is we exactly? When I read these kind of threads, I believe it's "enthusiast" laypeople who follow the headlines but don't actually have a deep understanding of the tech. Of course there are the promoters who are raising money and need to frame each advance in the most optimistic light. I don't see anything wrong with that, it just means that there will be a group of techie but not research literate folks who a…

Can someone please explain like we are fifteen why AGI is impossible, at least right now? Or if not AGI, then something similar to a cat/etc mind? As far as I am imagining it, current models are pipelines of various trained networks (and more traditional filters in the mix) that operate like request-reply. Why can’t you just connect few different pipelines in a loop/graph and make an autonomous self-feeding entity? B…

You will be hard pressed to have an interesting discussion about AGI because the way the term is defined makes it uninteresting. It’s like trying to have a discussion about aviation by asking how close we are to fly exactly like birds. It’s not really relevant to our ability to design good planes.

Then any discussions will be highly handicapped by the fact most still view human intelligence as something special. The field is still very much awaiting its urea synthesis moment.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#617

Post by Liskni_si »

jedberg wrote: post #98

I hope he gets a good domain name and some good SEO, because there are a bunch of consulting companies with the name Keen Technologies, and some of them don't look super reputable.

And there's also Keen Software House (maker of the Space Engineers and Medieval Engineers games) whose founder (https://blog.marekrosa.org/) has an AGI company as well (called GoodAI). Funny coincidence.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#618

Post by est31 »

dinosaurdynasty wrote: post #486
est31 wrote: post #249

Earlier quoted context omitted.

> Replicate? Trival. But what does that have to do with AGI? If you see it as copying an existing model to another computer, yes it is trivial. But an AGI trying to replicate itself in the real world has to also make those computers. Making modern computer chips is one of the most non-trivial things that humans do. They require fabs that cost billions, with all sorts of chemicals inside, and extreme requirements on t…

Buy compute with stolen cryptocurrency. Convince a couple rich people that it can cure aging with _just_ enough compute. Hack datacenters (an AGI would likely be much much much better at finding security holes than humans). Make _really really funny videos_ and create the most popular Patreon of all time. If you're 500 IQ or above there are a _lot_ of things you can do, and probably simultaneously, since an AGI proba…

Sure, this will help with some initial growth in computing resources, if this is seen as a required goal by an "evil" AGI agent before the destruction of humans. And it will have an easy time to hide in the growing computing industry. But if it e.g. kills all humans, it's suddenly left with a limited number of chips and can't grow beyond that number, without being able to manufacture new chips. It can't survive for really long times due to degradation of its own hardware. It might try to monitor humans first as they build and run chip fabs, debug issues, etc. Those fabs themselves need tools that have complex manufacturing processes of their own. It's extremely complicated. The AGI might be able to pull it off because it's so smart, but I wouldn't call it a trivial task. Unless you say that practically anything is trivial for AGI because of its capabilities, but then the sentence "x is trivial" loses meaning :).

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#619

Post by pjfin123 »

sailingparrot wrote: post #227
Jack000 wrote: post #116

I'm very optimistic for near-term AGI (10 years or less). Even just a few years ago most in the field would have said that it's an "unknown unknown", we didn't have the theory or the models, there was no path forward and so it was impossible to predict. Now we have a fairly concrete idea of what a potential AGI might look like - an RL agent that uses a large transformer. The issue is that unlike supervised training y…

> we didn't have the theory or the models, there was no path forward and so it was impossible to predict. Now we have a fairly concrete idea of what a potential AGI might look like - an RL agent that uses a large transformer. Who is we exactly? As someone working in AI research I know no one that would agree with this statement, so im quite puzzled by that statement.

A RL agent with a large Transformer seems to me like a design that would build an AGI.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#620

Post by p1esk »

chubot wrote: post #345
nuclearnice1 wrote: post #124

Earlier quoted context omitted.

> The "6 or so" breakthroughs sounds about right to me. What’s your logic? Or his if you know it?

Yeah he didn't elaborate on this in the interview, which I would have liked. I should amend my comment to say that "6 or so breakthroughs" sounds a lot more plausible to me than "1 breakthrough" or "just scaling", which you will see some people advocate, including in this thread. That's what I meant. I believe the latter is fundamentally mistaken and those people simply don't understand what they don't understand (in…

What do you mean exactly when you say “deep learning”?
Post reply on HN