I don't understand how anyone can believe that we're near even a whiff of AGI when we barely understand what dreaming is, or how the human brain interacts with the quantum world. There are so many elements of human creativity that are still utterly hidden behind a wall that it makes me feel insane when an entire industry is convinced we're just magically going to have the answer soon. The people heralding the emergen…
Andrej Karpathy – It will take a decade to work through the issues with agents
141–150 of 1001 posts
Re: Andrej Karpathy – It will take a decade to work through the issues with agents
#142Earlier quoted context omitted.
Arguing about the definitions of words is rarely useful.
Except AI already had a clear definition well before it started being used as a way to inflate valuations and push marketing narratives. If nothing else it's been a sci-fi topic for more than a century. There's connotations, cultural baggage, and expectations from the general population about what AI is and what it's capable of, most of which isn't possible or applicable to the current crop of "AI" tools. You can't j…
Re: Andrej Karpathy – It will take a decade to work through the issues with agents
#143I think it's a shame that a 146 minute podcast released ~55 minutes ago has so much discussion. Everybody here is clearly just reacting to the title with their own biases. I know it's against the guidelines to discuss the state of a thread, but I really wish we could have thoughtful conversations about the content of links instead of title reactions.
Re: Andrej Karpathy – It will take a decade to work through the issues with agents
#144>What takes the long amount of time and the way to think about it is that it’s a march of nines. Every single nine is a constant amount of work. Every single nine is the same amount of work. When you get a demo and something works 90% of the time, that’s just the first nine. Then you need the second nine, a third nine, a fourth nine, a fifth nine. While I was at Tesla for five years or so, we went through maybe three…
like leveling to 99 in old school runescape
Re: Andrej Karpathy – It will take a decade to work through the issues with agents
#145Earlier quoted context omitted.
Machine learning is only part of how an LLM agent works though. An essential part, but only a part.
I see a fair amount of bullshit in the LLM space though, where even cursory consideration would connect the methods back to well-known principles in ML (and even statistics!) to measure model quality and progress. There's a lot of 'woo, it's new! we don't know how to measure it exactly but we think it's groundbreaking!' which is simply wrong. From where I sit, the generative models provide more flexibility but tend t…
You appear to be comparing apples to oranges. A generation task is not a categorization task. Machine learning solves categorization problems. Generative AI uses model trained by machine learning methods, but in a very different architecture to solve generative problems. Completely different and incomparable application domain.
Re: Andrej Karpathy – It will take a decade to work through the issues with agents
#146>What takes the long amount of time and the way to think about it is that it’s a march of nines. Every single nine is a constant amount of work. Every single nine is the same amount of work. When you get a demo and something works 90% of the time, that’s just the first nine. Then you need the second nine, a third nine, a fourth nine, a fifth nine. While I was at Tesla for five years or so, we went through maybe three…
Re: Andrej Karpathy – It will take a decade to work through the issues with agents
#147Earlier quoted context omitted.
Where are you because it’s sure not where I am…
5 years ago, everyone would agree that what we have today is AGI.
Re: Andrej Karpathy – It will take a decade to work through the issues with agents
#148Re: Andrej Karpathy – It will take a decade to work through the issues with agents
#149Re: Andrej Karpathy – It will take a decade to work through the issues with agents
#150Earlier quoted context omitted.
Most humans do not even have a general intelligence! Many students are practically illiterate, and can not even read and understand book or manual! We are approaching situation, where AI will make most decisions, and people will wear it as a skin suit, to fake competency!
I wouldn’t say that any specific skill (like literacy) is required to have intelligence. It’s more the capability to learn skills and build a model of the world and the people in it using abstract reasoning. Otherwise we would have to say that pre-literacy societies lacked intelligence, which would be silly since they are the ones that invented writing in the first place!