Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy: Software in the era of AI [video]

youtube.com

Post reply on HN
Print view View original

101–110 of 827 posts

Re: Andrej Karpathy: Software in the era of AI [video]

#101

Post by abdullin »

miki123211 wrote: post #38
karpathy wrote: post #22

Earlier quoted context omitted.

I kind of say it in words (agreeing with you) but I agree the versioning is a bit confusing analogy because it usually additionally implies some kind of improvement. When I’m just trying to distinguish them as very different software categories.

What do you think about structured outputs / JSON mode / constrained decoding / whatever you wish to call it? To me, it's a criminally underused tool. While "raw" LLMs are cool, they're annoying to use as anything but chatbots, as their output is unpredictable and basically impossible to parse programmatically. Structured outputs solve that problem neatly. In a way, they're "neural networks without the training". The…

Even more than that. With Structured Outputs we essentially control layout of the response, so we can force LLM to go through different parts of the completion in a predefined order.

One way teams exploit that - force LLM to go through a predefined task-specific checklist before answering. This custom hard-coded chain of thought boosts the accuracy and makes reasoning more auditable.

Re: Andrej Karpathy: Software in the era of AI [video]

#102

Post by abdullin »

Tight feedback loops are the key in working productively with software. I see that in codebases up to 700k lines of code (legacy 30yo 4GL ERP systems).

The best part is that AI-driven systems are fine with running even more tight loops than what a sane human would tolerate.

Eg. running full linting, testing and E2E/simulation suite after any minor change. Or generating 4 versions of PR for the same task so that the human could just pick the best one.

Re: Andrej Karpathy: Software in the era of AI [video]

#103

Post by alightsoul »

nothrabannosir wrote: post #39
nodesocket wrote: post #24

llms.txt makes a lot of sense, especially for LLMs to interact with http APIs autonomously. Seems like you could set a LLM loose and like the Google Bot have it start converting all html pages into llms.txt. Man, the future is crazy.

Couldn’t believe my eyes. The www is truly bankrupt. If anyone has a browser plugin which automatically redirects to llms.txt sign me up. Website too confusing for humans? Add more design, modals, newsletter pop ups, cookie banners, ads, … Website too confusing for LLMs? Add an accessible, clean, ad-free, concise, high entropy, plain text summary of your website. Make sure to hide it from the humans! PS: it should be…

The web started dying with mobile social media apps, in which hyperlinks are a poor UX choice. Then again with SEO banning outlinks. Now this. The web of interconnected pages that was the World Wide Web is dead. Not on social media? No one sees you. Run a website? more bots than humans. Unless you sell something on the side with the website it's not profitable. Hyperlinking to other websites is dead.

Gen Alpha doesn't know what a web page is and if they do, it's for stuff like neocities aka as a curiosity or art form only. Not as a source of information anymore. I don't blame them. Apps (social media apps) have less friction than web sites but have a higher barrier for people to create. We are going back to pre World Wide Web days in a way, kind of like Bulletin Board Systems on dial up without hyperlinking, and centralized (social media) Some countries mostly ones with few technical people llike the ones in Central America have moved away from the web almost entirely and into social media like Instagram.

Due to the death of the web, google search and friends now rely mostly on matching queries with titles now so just like before the internet you have to know people to learn new stuff or wait for an algorithm to show it to you or someone to comment it online or forcefully enroll in a university. Maybe that's why search results have declined and poeple search using ChatGPT or maybe perplexity. Scholarly search engines are a bit better but frankly irrelevant for most poeple.

Now I understand why Google established their own DNS server at 8.8.8.8. If you have a directory of all domains on DNS, you can still index sites without hyperlinks between them, even if the web dies. They saw it coming.

Re: Andrej Karpathy: Software in the era of AI [video]

#104

Post by melvinmelih »

shakna wrote: post #92
tshaddox wrote: post #41

Earlier quoted context omitted.

I could see it being the case that driving is a fairly general problem, and this models intentionally designed to be general end up doing better than models designed with the misconception that you need a very particular set of driving-specific capabilities.

Driving is not a general problem, though. Its a contextual landscape of fast-based reactions and predictions. Both are required, and done regularly by the human element. The exact nature of every reaction, and every prediction, change vastly within the context window. You need image processing just as much as you need scenario management, and they're orthoganol to each other, as one example. If you want a general tra…

> Driving is not a general problem, though.

But what's driving a car? A generalist human brain that has been trained for ~30 hours to drive a car.

Re: Andrej Karpathy: Software in the era of AI [video]

#105

Post by suddenlybananas »

karpathy wrote: post #57
hgl wrote: post #51

It’s fascinating to think about what true GUI for LLM could be like. It immediately makes me think a LLM that can generate a customized GUI for the topic at hand where you can interact with in a non-linear way.

Fun demo of an early idea was posted by Oriol just yesterday :) https://x.com/OriolVinyalsML/status/1935005985070084197

Having different documents come up every time you go into the documents directory seems hellishly terrible.

Re: Andrej Karpathy: Software in the era of AI [video]

#106

Post by suddenlybananas »

ActorNightly wrote: post #43
anythingworks wrote: post #5

loved the analogies! Karpathy is consistently one of the clearest thinkers out there. interesting that Waymo could do uninterrupted trips back in 2013, wonder what took them so long to expand? regulation? tailend of driving optimization issues? noticed one of the slides had a cross over 'AGI 2027'... ai-2027.com :)

> Karpathy is consistently one of the clearest thinkers out there. Eh, he ran Teslas self driving division and put them into a direction that is never going to fully work. What they should have done is a) trained a neural net to represent sequence of frames into a physical environment, and b)leveraged Mu Zero, so that self driving system basically builds out parallel simulations into the future, and does a search on…

That's absolutely not what makes humans great drivers?

Re: Andrej Karpathy: Software in the era of AI [video]

#108

Post by politelemon »

jph00 wrote: post #74
sneak wrote: post #32

Can we please stop standardizing on putting things in the root? /.well-known/ exists for this purpose. example.com/.well-known/llms.txt https://en.m.wikipedia.org/wiki/Well-known_URI

You can't just put things there any time you want - the RFC requires that they go through a registration process. Having said that, this won't work for llms.txt, since in the next version of the proposal they'll be allowed at any level of the path, not only the root.

> You can't just put things there any time you want - the RFC requires that they go through a registration process.

Actually, I can for two reasons. First is of course the RFC mentions that items can be registered after the fact, if it's found that a particular well-known suffix is being widely used. But the second is a bit more chaotic - website owners are under no obligation to consult a registry, much like port registrations; in many cases they won't even know it exists and may think of it as a place that should reflect their mental model.

It can make things awkward and difficult though, that is true, but that comes with the free text nature of the well-known space. That's made evident in the Github issue linked, a large group of very smart people didn't know that there was a registry for it.

https://github.com/AnswerDotAI/llms-txt/issues/2#issuecommen...

Re: Andrej Karpathy: Software in the era of AI [video]

#109

Post by OtherShrezzing »

jonny_eh wrote: post #82
hgl wrote: post #51

It’s fascinating to think about what true GUI for LLM could be like. It immediately makes me think a LLM that can generate a customized GUI for the topic at hand where you can interact with in a non-linear way.

An ever-shifting UI sounds unlearnable, and therefore unusable.

A mixed ever-shifting UI can be excellent though. So you've got some tools which consistently interact with UI components, but the UI itself is altered frequently.

Take for example world-building video games like Cities Skylines / Sim City or procedural sandboxes like Minecraft. There are 20-30 consistent buttons (tools) in the game's UX, while the rest of the game is an unbounded ever-shifting UI.

Re: Andrej Karpathy: Software in the era of AI [video]

#110

Post by [deleted] »

abdullin wrote: post #102

Tight feedback loops are the key in working productively with software. I see that in codebases up to 700k lines of code (legacy 30yo 4GL ERP systems). The best part is that AI-driven systems are fine with running even more tight loops than what a sane human would tolerate. Eg. running full linting, testing and E2E/simulation suite after any minor change. Or generating 4 versions of PR for the same task so that the h…

[deleted]
Post reply on HN