Live data from Hacker News

Andrej Karpathy – It will take a decade to work through the issues with agents

dwarkesh.com

51–60 of 1001 posts

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#51

Good because we have no framework whatsoever enabled for if it is legal or ethical to turn it off. Is that murder? I think so.

We don't even have any intention to do anything about millions of people loosing their jobs and driven into poverty by it, in fact the investments right now gamble/depend on that wealth transfer to happen in the future. We don't even give a shit about other humans, there is absolutely no way we will care about a (hypothetical) different life form entirely.

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#52

Earlier quoted context omitted.

> AGI is already here. cause elon musk says FSD is coming in 2017?

Because we already have artificial (man-made) general (contrast with domain specific) intelligence (algorithmic problem solvers). A.G.I. If ChatGPT is not AGI, somebody has moved goalposts.

[deleted]

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#53

And self sustained nuclear fusion is 20 years away, perpetually. On which evidence can he affirm a timeline for AGI when we can barely define intelligence?

stop repeating that. first, it isn't true that intelligence is barely defined. https://arxiv.org/abs/0706.3639 second a definition is obviously not a prerequisite as evidenced by natural selection

An Arxiv paper listing 70 different definitions of intelligence is not the evidence that you seem to think it is.

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#54

And self sustained nuclear fusion is 20 years away, perpetually. On which evidence can he affirm a timeline for AGI when we can barely define intelligence?

And a program that can write, sound and paint like a human was 20 years away perpetually as well, until it wasn't.

> like a human

Humans have since adapted to identify content differences and assign lower economic value to content created by programs, i.e. the humans being "impersonated" and "fooled" are themselves evolving in response to imitation.

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#55

Am I dating myself by thinking Kurzweil is still relevant? 2029: Human-level AI 2045: The Singularity - machine intelligence 1 billion times more powerful than all human intelligence Based on exponential growth in computing. He predicts we'll merge with AI to transcend biological limits. His track record is mixed, but 2029 looks more credible post-GPT-5. The 2045 claim remains highly speculative.

It's curious that Kurzweil's predictions about transcending biology align so closely with his expected lifespan. Reminds me of someone saying, if you ask a researcher for a timeline of a breakthrough they'll give you the expected span of their career.

Hegel thought history ended with the Prussian state, Fukuyama thought it ended in liberal America, Paul thought judgement day was so close you need not bother to marry, the singularity always comes around when the singularians get old. Funny how that works

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#56

Earlier quoted context omitted.

> AGI is already here. cause elon musk says FSD is coming in 2017?

Because we already have artificial (man-made) general (contrast with domain specific) intelligence (algorithmic problem solvers). A.G.I. If ChatGPT is not AGI, somebody has moved goalposts.

I think a baseline requirement would be that it… thinks. That’s not a thing LLMs do.

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#57
post #9

Are researchers scared to just come out and say it because they'll be labeled as wrong if the extreme tail case happens?

No, it’s because of money and the hype cycle.

I mean you say this, but I havent touched a line of code as a programmer in months, having been totally replaced by AI.

I mean sure I now "control" the AI, but I still think these no AGI for 2 decades claims are a bit rough.

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#58
I would bet all of my assets of my life that AGI will not be seen in the lifetime of anyone reading this message right now.

That includes anyone reading this message long after the lives of those reading it on its post date have ended.

Which of course raises the interesting question of how I can make good on this bet.

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#59

"The question of whether a computer can think is no more interesting than the question of whether a submarine can swim." - Edsger Dijkstra The debate about AGI is interesting from a philosophical perspective, but from a practical perspective AI doesn't need to get anywhere close to AGI to turn the world upside down.

I don’t even know what AGI is, and neither does anyone else as far as I can tell. In the parts of the video I watched, he cites several things missing which all have to do with autonomy: continual automated updates of internal state, fully autonomous agentic behavior, etc.

I feel like GPT 3 was AGI, personally. It crossed some threshold that was both real and magical, and future improvements are relying on that basic set of features at their core. Can we confidently say this is not a form of general intelligence? Just because it’s more a Chinese Room than a fully autonomous robot? We can keep moving the goalposts indefinitely, but machine intelligence will never exactly match that of humans.

Re: Andrej Karpathy – It will take a decade to work through the issues with agents

#60

Whenever someone brings up "AI", I tell them AI is not real AI. Machine learning is a more apt buzzword. And real AI is probably like fusion. Its always 10 years away.

Machine learning as a descriptive phrase has stopped being relevant. It implies the discovery of information in a training set. The pre-training of an LLM is most definitely machine learning. But what people are excited and interested in is the use of this learned data in generative AI. “Machine learning” doesn’t capture that aspect.

But the things we try to make LLMs do post-pre-training are primarily achieved via reinforcement learning. Isn't reinforcement learning machine learning? Correct me if I'm misconstruing what you're trying to say here
Post reply on HN