Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy: Software in the era of AI [video]

youtube.com

Post reply on HN
Print view View original

61–70 of 827 posts

Re: Andrej Karpathy: Software in the era of AI [video]

#61

Post by andrethegiant »

practal wrote: post #42
nodesocket wrote: post #24

llms.txt makes a lot of sense, especially for LLMs to interact with http APIs autonomously. Seems like you could set a LLM loose and like the Google Bot have it start converting all html pages into llms.txt. Man, the future is crazy.

If you have different representations of the same thing (llms.txt / HTML), how do you know it is actually equivalent to each other? I am wondering if there are scenarios where webpage publishers would be interested in gaming this.

is a standards-friendly way to semantically represent the same content in a different format

Re: Andrej Karpathy: Software in the era of AI [video]

#62

Post by rudedogg »

nilirl wrote: post #54

Where do these analogies break down? 1. Similar cost structure to electricity, but non-essential utility (currently)? 2. Like an operating system, but with non-determinism? 3. Like programming, but ...? Where does the programming analogy break down?

> programming

The programming analogy is convenient but off. The joke has always been “the computer only does exactly what you tell it to do!” regarding logic bugs. Prompts and LLMs most certainly do not work like that.

I loved the parallels with modern LLMs and time sharing he presented though.

Re: Andrej Karpathy: Software in the era of AI [video]

#65

Post by dmitrijbelikov »

I think that Andrej presents “Software 3.0” as a revolution, but in essence it is a natural evolution of abstractions.

Abstractions don't eliminate the need to understand the underlying layers - they just hide them until something goes wrong.

Software 3.0 is a step forward in convenience. But it is not a replacement for developers with a foundation, but a tool for acceleration, amplification and scaling.

If you know what is under the hood — you are irreplaceable. If you do not know — you become dependent on a tool that you do not always understand.

Re: Andrej Karpathy: Software in the era of AI [video]

#66

Post by AlotOfReading »

ActorNightly wrote: post #43
anythingworks wrote: post #5

loved the analogies! Karpathy is consistently one of the clearest thinkers out there. interesting that Waymo could do uninterrupted trips back in 2013, wonder what took them so long to expand? regulation? tailend of driving optimization issues? noticed one of the slides had a cross over 'AGI 2027'... ai-2027.com :)

> Karpathy is consistently one of the clearest thinkers out there. Eh, he ran Teslas self driving division and put them into a direction that is never going to fully work. What they should have done is a) trained a neural net to represent sequence of frames into a physical environment, and b)leveraged Mu Zero, so that self driving system basically builds out parallel simulations into the future, and does a search on…

Aren't continuous, stochastic, partial knowledge environments where you need long horizon planning with strict deadlines and limited compute exactly the sort of environments muzero variants struggle with? Because that's driving.

It's also worth mentioning that humans intentionally (and safely) drive into "solid" objects all the time. Bags, steam, shadows, small animals, etc. We also break rules (e.g. drive on the wrong side of the road), and anticipate things we can't even see based on a theory of mind of other agents. Human driving is extremely sophisticated, not reducible to rules that are easily expressed in "simple" language.

Re: Andrej Karpathy: Software in the era of AI [video]

#67

Post by AdieuToLogic »

practal wrote: post #50

Great talk, thanks for putting it online so quickly. I liked the idea of making the generation / verification loop go brrr, and one way to do this is to make verification not just a human task, but a machine task, where possible. Yes, I am talking about formal verification, of course! That also goes nicely together with "keeping the AI on a tight leash". It seems to clash though with "English is the new programming l…

> So the question is, can you hide the formal stuff under the hood, just like you can hide a calculator tool for arithmetic? Use informal English on the surface, while some of it is interpreted as a formal expression, put to work, and then reflected back in English?

The problem with trying to make "English -> formal language -> (anything else)" work is that informality is, by definition, not a formal specification and therefore subject to ambiguity. The inverse is not nearly as difficult to support.

Much like how a property in an API initially defined as being optional cannot be made mandatory without potentially breaking clients, whereas making a mandatory property optional can be backward compatible. IOW, the cardinality of "0 .. 1" is a strict superset of "1".

Re: Andrej Karpathy: Software in the era of AI [video]

#68

Post by necrodome »

dpkirchner wrote: post #56
hgl wrote: post #51

It’s fascinating to think about what true GUI for LLM could be like. It immediately makes me think a LLM that can generate a customized GUI for the topic at hand where you can interact with in a non-linear way.

Like a HyperCard application?

We (https://vibes.diy/) are betting on this

Re: Andrej Karpathy: Software in the era of AI [video]

#69

Post by tayo42 »

ActorNightly wrote: post #43
anythingworks wrote: post #5

loved the analogies! Karpathy is consistently one of the clearest thinkers out there. interesting that Waymo could do uninterrupted trips back in 2013, wonder what took them so long to expand? regulation? tailend of driving optimization issues? noticed one of the slides had a cross over 'AGI 2027'... ai-2027.com :)

> Karpathy is consistently one of the clearest thinkers out there. Eh, he ran Teslas self driving division and put them into a direction that is never going to fully work. What they should have done is a) trained a neural net to represent sequence of frames into a physical environment, and b)leveraged Mu Zero, so that self driving system basically builds out parallel simulations into the future, and does a search on…

Is that the approach that waymo uses?

Re: Andrej Karpathy: Software in the era of AI [video]

#70

Post by geeunits »

sothatsit wrote: post #59

I find Karpathy's focus on tightening the feedback loop between LLMs and humans interesting, because I've found I am the happiest when I extend the loop instead. When I have tried to "pair program" with an LLM, I have found it incredibly tedious, and not that useful. The insights it gives me are not that great if I'm optimising for response speed, and it just frustrates me rather than letting me go faster. Worse, oft…

I would venture that 'tightening the feedback loop' isn't necessarily 'increasing the number of back and forth prompts'- and what you're saying you want is ultimately his argument. i.e. if integral enough it can almost guess what you're going to say next...
Post reply on HN