Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy: Software in the era of AI [video]

youtube.com

Post reply on HN
Print view View original

41–50 of 827 posts

Re: Andrej Karpathy: Software in the era of AI [video]

#41

Post by tshaddox »

anon7000 wrote: post #31
petesergeant wrote: post #14

Earlier quoted context omitted.

I wonder at what point all the self-driving code becomes replaceable with a multimodal generalist model with the prompt “drive safely”

Very advanced machine learning models are used in current self driving cars. It all depends what the model is trying to accomplish. I have a hard time seeing a generalist prompt-based generative model ever beating a model specifically designed to drive cars. The models are just designed for different, specific purposes

I could see it being the case that driving is a fairly general problem, and this models intentionally designed to be general end up doing better than models designed with the misconception that you need a very particular set of driving-specific capabilities.

Re: Andrej Karpathy: Software in the era of AI [video]

#42

Post by practal »

nodesocket wrote: post #24

llms.txt makes a lot of sense, especially for LLMs to interact with http APIs autonomously. Seems like you could set a LLM loose and like the Google Bot have it start converting all html pages into llms.txt. Man, the future is crazy.

If you have different representations of the same thing (llms.txt / HTML), how do you know it is actually equivalent to each other? I am wondering if there are scenarios where webpage publishers would be interested in gaming this.

Re: Andrej Karpathy: Software in the era of AI [video]

#43

Post by ActorNightly »

anythingworks wrote: post #5

loved the analogies! Karpathy is consistently one of the clearest thinkers out there. interesting that Waymo could do uninterrupted trips back in 2013, wonder what took them so long to expand? regulation? tailend of driving optimization issues? noticed one of the slides had a cross over 'AGI 2027'... ai-2027.com :)

> Karpathy is consistently one of the clearest thinkers out there.

Eh, he ran Teslas self driving division and put them into a direction that is never going to fully work.

What they should have done is a) trained a neural net to represent sequence of frames into a physical environment, and b)leveraged Mu Zero, so that self driving system basically builds out parallel simulations into the future, and does a search on the best course of action to take.

Because thats pretty much what makes humans great drivers. We don't need to know what a cone is - we internally compute that something that is an object on the road that we are driving towards is going to result in a negative outcome when we collide with it.

Re: Andrej Karpathy: Software in the era of AI [video]

#44

Post by mikewarot »

A few days ago, I was introduced to the idea that when you're vibe coding, you're consulting a "genie", much like in the fables, you almost never get what you asked for, but if your wishes are small, you might just get what you want.

The primagen reviewed this article[1] a few days ago, and (I think) that's where I heard about it. (Can't re-watch it now, it's members only) 8(

[1] https://medium.com/@drewwww/the-gambler-and-the-genie-08491d...

Re: Andrej Karpathy: Software in the era of AI [video]

#45

Post by anythingworks »

tshaddox wrote: post #41
anon7000 wrote: post #31

Earlier quoted context omitted.

Very advanced machine learning models are used in current self driving cars. It all depends what the model is trying to accomplish. I have a hard time seeing a generalist prompt-based generative model ever beating a model specifically designed to drive cars. The models are just designed for different, specific purposes

I could see it being the case that driving is a fairly general problem, and this models intentionally designed to be general end up doing better than models designed with the misconception that you need a very particular set of driving-specific capabilities.

exactly! I think that was tesla's vision with self-driving to begin with... so they tried to frame it as problem general enough, that trying to solve it would also solve questions of more general intelligence ('agi') i.e. cars should use vision just like humans would

but in hindsight looks like this slowed them down quite a bit despite being early to the space...

Re: Andrej Karpathy: Software in the era of AI [video]

#46

Post by fudged71 »

mikewarot wrote: post #44

A few days ago, I was introduced to the idea that when you're vibe coding, you're consulting a "genie", much like in the fables, you almost never get what you asked for, but if your wishes are small, you might just get what you want. The primagen reviewed this article[1] a few days ago, and (I think) that's where I heard about it. (Can't re-watch it now, it's members only) 8( [1] https://medium.com/@drewwww/the-gambl…

“You are an expert 10x software developer. Make me a billion dollar app.” Yeah this checks out

Re: Andrej Karpathy: Software in the era of AI [video]

#48

Post by visarga »

ActorNightly wrote: post #43
anythingworks wrote: post #5

loved the analogies! Karpathy is consistently one of the clearest thinkers out there. interesting that Waymo could do uninterrupted trips back in 2013, wonder what took them so long to expand? regulation? tailend of driving optimization issues? noticed one of the slides had a cross over 'AGI 2027'... ai-2027.com :)

> Karpathy is consistently one of the clearest thinkers out there. Eh, he ran Teslas self driving division and put them into a direction that is never going to fully work. What they should have done is a) trained a neural net to represent sequence of frames into a physical environment, and b)leveraged Mu Zero, so that self driving system basically builds out parallel simulations into the future, and does a search on…

> We don't need to know what a cone is

The counter argument is that you can't zoom in and fix a specific bug in this mode of operation. Everything is mashed together in the same neural net process. They needed to ensure safety, so testing was crucial. It is harder to test an end-to-end system than its individual parts.

Re: Andrej Karpathy: Software in the era of AI [video]

#49

Post by anythingworks »

mikewarot wrote: post #44

A few days ago, I was introduced to the idea that when you're vibe coding, you're consulting a "genie", much like in the fables, you almost never get what you asked for, but if your wishes are small, you might just get what you want. The primagen reviewed this article[1] a few days ago, and (I think) that's where I heard about it. (Can't re-watch it now, it's members only) 8( [1] https://medium.com/@drewwww/the-gambl…

that's a really good analogy! It feels like wicked joke that llms behave in such a way that they're both intelligent and stupid at the same time

Re: Andrej Karpathy: Software in the era of AI [video]

#50

Post by practal »

Great talk, thanks for putting it online so quickly. I liked the idea of making the generation / verification loop go brrr, and one way to do this is to make verification not just a human task, but a machine task, where possible.

Yes, I am talking about formal verification, of course!

That also goes nicely together with "keeping the AI on a tight leash". It seems to clash though with "English is the new programming language". So the question is, can you hide the formal stuff under the hood, just like you can hide a calculator tool for arithmetic? Use informal English on the surface, while some of it is interpreted as a formal expression, put to work, and then reflected back in English? I think that is possible, if you have a formal language and logic that is flexible enough, and close enough to informal English.

Yes, I am talking about abstraction logic [1], of course :-)

So the goal would be to have English (German, ...) as the ONLY programming language, invisibly backed underneath by abstraction logic.

[1] http://abstractionlogic.com

Post reply on HN