Love his analogies and clear eyed picture
"We're not building Iron Man robots. We're building Iron Man suits"
[flagged]
Andrej Karpathy: Software in the era of AI [video]
11–20 of 827 posts
Re: Andrej Karpathy: Software in the era of AI [video]
#12[deleted]
Re: Andrej Karpathy: Software in the era of AI [video]
#13Thank you YC for posting this before the talk became deprecated[1] 1: https://x.com/karpathy/status/1935077692258558443
We couldn't let that happen!
Re: Andrej Karpathy: Software in the era of AI [video]
#14loved the analogies! Karpathy is consistently one of the clearest thinkers out there. interesting that Waymo could do uninterrupted trips back in 2013, wonder what took them so long to expand? regulation? tailend of driving optimization issues? noticed one of the slides had a cross over 'AGI 2027'... ai-2027.com :)
You don't "solve" autonomous driving as such. There's a long, slow grind of gradually improving things until failures become rare enough.
I wonder at what point all the self-driving code becomes replaceable with a multimodal generalist model with the prompt “drive safely”
Re: Andrej Karpathy: Software in the era of AI [video]
#15Love his analogies and clear eyed picture
"We're not building Iron Man robots. We're building Iron Man suits"
Funny thing is that in more than one of the iron man movies the suits end up being bad robots. Even the ai iron man made shows up to ruin the day in the avengers movie. So it’s a little in the nose that they’d try to pitch it this way.
Re: Andrej Karpathy: Software in the era of AI [video]
#16Earlier quoted context omitted.
"We're not building Iron Man robots. We're building Iron Man suits"
[flagged]
I'm old enough to remember when Twitter was new, and for a moment it felt like the old utopian promise of the Internet finally fulfilled: ordinary people would be able to talk, one-on-one and unmediated, with other ordinary people across the world, and in the process we'd find out that we're all more similar than different and mainly want the same things out of life, leading to a new era of peace and empathy.
It was a nice feeling while it lasted.
Re: Andrej Karpathy: Software in the era of AI [video]
#17It's an interesting presentation, no doubt. The analogies eventually fail as analogies usually do.
A recurring theme presented, however, is that LLM's are somehow not controlled by the corporations which expose them as a service. The presenter made certain to identify three interested actors (governments, corporations, "regular people") and how LLM offerings are not controlled by governments. This is a bit disingenuous.
Also, the OS analogy doesn't make sense to me. Perhaps this is because I do not subscribe to LLM's having reasoning capabilities nor able to reliably provide services an OS-like system can be shown to provide.
A minor critique regarding the analogy equating LLM's to mainframes:
Mainframes in the 1960's never "ran in the cloud" as it did
not exist. They still do not "run in the cloud" unless one
includes simulators.
Terminals in the 1960's - 1980's did not use networks. They
used dedicated serial cables or dial-up modems to connect
either directly or through stat-mux concentrators.
"Compute" was not "batched over users." Mainframes either
had jobs submitted and ran via operators (indirect execution)
or supported multi-user time slicing (such as found in Unix).Re: Andrej Karpathy: Software in the era of AI [video]
#18Earlier quoted context omitted.
You don't "solve" autonomous driving as such. There's a long, slow grind of gradually improving things until failures become rare enough.
I wonder at what point all the self-driving code becomes replaceable with a multimodal generalist model with the prompt “drive safely”
One of the issues with deploying models like that is the lack of clear, widely accepted ways to validate comprehensive safety and absence of unreasonable risk. If that can be solved, or regulators start accepting answers like "our software doesn't speed in over 95% of situations", then they'll become more common.
Re: Andrej Karpathy: Software in the era of AI [video]
#19The comparison of our current methods of interacting with LLMs (back and forth text) to old-school terminals is pretty interesting.
I think there's still a lot work to be done to optimize how we interact with these models, especially for non-dev consumers.
Re: Andrej Karpathy: Software in the era of AI [video]
#20Well that showed up significantly faster than they said it would.
Classic under promise and over deliver.
I'm glad they got it out quickly.