Live data from Hacker News

Andrej Karpathy: Software in the era of AI [video]

youtube.com

781–790 of 827 posts

Re: Andrej Karpathy: Software in the era of AI [video]

#781
post #707
post #25

Earlier quoted context omitted.

Me too. It was my favorite talk of the ones I saw.

I did like it to, but haven't seen any of the others, and usually don't like sitting through talks rather than reading transcripts. But you got me curious, what other talks from the day/event would be worth watching in your mind?

I also liked Chelsea Finn's robot talk.

(I didn't see all the talks, so please don't take absence of recommendation as recommendation of absence!)

Re: Andrej Karpathy: Software in the era of AI [video]

#782
post #535

Earlier quoted context omitted.

Behavioral patterns are not unpredictable. Who knows how far an LLM could get by pattern-matching what a user is doing and generating a UI to make it easier. Since the user could immediately say whether they liked it or not, this could turn into a rapid and creative feedback loop.

So, if the user likes UI’s that don’t change, the LLM will figure out that it should do nothing? One problem LLM’s don’t fix is the misalignment between app developers’ incentives and users’ incentives. Since the developer controls the LLM, I imagine that a “smart” shifting UI would quickly devolve into automated dark patterns.

A user who doesn't want such changes shouldn't be subjected to them in the first place, so there should be nothing for an LLM to figure out.

I'm with you on disliking dark patterns but it seems to me a separate issue.

Re: Andrej Karpathy: Software in the era of AI [video]

#783

I think this is a brilliant talk and truly captures the "zeitgeist" of our times. He sees the emergent patterns arising as software creation is changing. I am writing a hobby app at the moment and I am thinking about its architecture in a new way now. I am making all my model structures comprehensible so that LLMs can see the inside semantics of my app. I merely provide a human friendly GUI over the top to avoid the…

I am actually working on building a semantic TypeScript server right now. It's going really good, check it out. https://github.com/screencam/typescript-mcp-server

With your tool can I hook it up to Cursor and just have it use it?

Re: Andrej Karpathy: Software in the era of AI [video]

#784
post #69

Earlier quoted context omitted.

> Karpathy is consistently one of the clearest thinkers out there. Eh, he ran Teslas self driving division and put them into a direction that is never going to fully work. What they should have done is a) trained a neural net to represent sequence of frames into a physical environment, and b)leveraged Mu Zero, so that self driving system basically builds out parallel simulations into the future, and does a search on…

Is that the approach that waymo uses?

Dunno what Waymo uses, but they definitely work in 3d space as a start, rather than trying to map sequences of pictures to action. They also need training on specific areas.

Re: Andrej Karpathy: Software in the era of AI [video]

#785

Earlier quoted context omitted.

> Karpathy is consistently one of the clearest thinkers out there. Eh, he ran Teslas self driving division and put them into a direction that is never going to fully work. What they should have done is a) trained a neural net to represent sequence of frames into a physical environment, and b)leveraged Mu Zero, so that self driving system basically builds out parallel simulations into the future, and does a search on…

That's absolutely not what makes humans great drivers?

Enlighten me please.

Re: Andrej Karpathy: Software in the era of AI [video]

#786

Earlier quoted context omitted.

Why bother using higher-level programming languages to communicate with a computer? You interact with a computer using assembly - raw bit shifting and memory addresses - which is more precise and effective.

Using assembly is not really more precise in terms of solving the problem. You can definitely make an argument that using a higher level language is equally if not more precise. Especially since your low level assembly will be limited to which architectures it can run on, you can state that the c++ that generates that assembly is "more precisely defining a calculator program".

I agree with your general point, but C++ isn't a great example, as it is so underspecified. Imagine as part of our calculator we wrote the function:

    int add(int a, int b) {
      return a + b;
    }
What is the result of add(32767, 1)? C++ does not presume to define just one meaning for such an expression. Or even any meaning at all. What to do when the program tries to add ints that large is left to the personal conscience of compiler authors.

Re: Andrej Karpathy: Software in the era of AI [video]

#787
post #718

https://github.com/screencam/typescript-mcp-server I've been working on this project. I built this in about two days, using it to build itself at the tail end of the effort. It's not perfect, but I see the promise in it. It stops the thrashing the LLMs can do when they're looking for types or trying to resolve anything like that.

> Traditional: Read 5000 lines → Find method → Replace → Write 5000 lines What of today's agents work like this? None of the ones I've tried would do something like that, but instead would grep/search the file, then do a smaller edit (different tools do those in different ways). Overall, it does feel like a strawman argument against "Traditional" when almost none of the tooling actually works like that.

Apologies - I had the LLM generate the readme and it looks like it got a bit overzealous. I'll get some actual benchmarks and cost usage analysis going. I've tamed the README somewhat. Please check it out!

Re: Andrej Karpathy: Software in the era of AI [video]

#788
post #93

Earlier quoted context omitted.

That's called a JIT compiler. And ignoring how bad an idea blending those two... It wouldn't be that difficult a task. The hardest parts of a jit is the safety aspect. And AI already violates most of that.

It's not a JIT. A JIT produces assembly. You can't "set registers" or do anything useful without assembly code running on the processor.

Riiight... Which was my point? If you want an AI able to set registers, you want to hook it to a JIT. Which avoids assembly by setting machine code directly into memory and executing said memory.

Re: Andrej Karpathy: Software in the era of AI [video]

#789

What is this "clerk" library he used at this timestamp to tell him what to do? https://youtu.be/LCEmiRjPEtQ?si=XaC-oOMUxXp0DRU0&t=1991 Gemini found it via screenshot or context: https://clerk.com/ This is what he used for login on MenuGen: https://karpathy.bearblog.dev/vibe-coding-menugen/

clerk is an auth library - and finally one that doesnt require dozens of lines to do things like, i dont know, check if the user is logged in and wild... you used gemini to process a screenshot to find the website for a 5 letter word library?

Not gemini but google lens. Maybe gemini already has some agentic capabilities

Re: Andrej Karpathy: Software in the era of AI [video]

#790

Earlier quoted context omitted.

The web started dying with mobile social media apps, in which hyperlinks are a poor UX choice. Then again with SEO banning outlinks. Now this. The web of interconnected pages that was the World Wide Web is dead. Not on social media? No one sees you. Run a website? more bots than humans. Unless you sell something on the side with the website it's not profitable. Hyperlinking to other websites is dead. Gen Alpha doesn'…

This. Only recently I realized, that in China for example many young people do not have a browser on their phone. Everything they do is via messenger "mini apps", which I can't imagine to be easier to create than a website. At every restaurant you get a QR code to scan, to download a so called mini app, which is a website in disguise. They run (un)social media apps like Tiktok or Xiaohongshu as their information inpu…

Speaking of app development, people often use the same 25 apps (dependent on region) so this situation monopolizes hosting of information within a few apps. It might seem paranoid but what if they went down like Vine or decided to delete or downrank content to please advertisers? Or in other words uprank content to drive advertising revenue via engagement? Their UI makes it so that downranked content is inaccessible and invisible by almost any means. The chances of finding that content are very near zero.

Tiktok and Instagram already do it. The algorithm reinforces biases which might seem like a personal problem, but there's no real way to escape them because the app doesn't have any UI to do it. Bluesky is an improvement but it hasn't really taken off and that feature is kind of buried. It also doesn't really let you browse through everything posted to the site. This situation reduces discoverability of information. Like in the old days before the internet except everything is online now.

Maybe Bluesky indicates, that people don't really care. Web surfing is dead. Or is it just a consequence of not allowing hyperlinks anymore? Like in the old days when hyperlinks didn't exist? I hope to use AI to facilitate hyperlinking, based on how common a word is. What if you had to tap and hold to access a hyperlink on mobile, hopefully solving the UX problem? What if all hyperlinks were buttons on a side of the screen? There has to be a way to keep an area clear for scrolling with fingers without banning hyperlinks..

But then how would they be presented to the user without making them think that you want to keep them hooked? TT and IG give the illusion of being able to quit anytime, in an uncluttered UI. Then you have social media banning outlinks too in order to keep you on their app and drive up ad revenue. This again kills the web because it reduces linking. When they do show links like hashtags, they are hard to press since they are close together and look cluttered. How can we bring hyperlinks to a mobile-friendly, user-friendly UI? E-commerce apps do it well, are highly discoverable, but why not social media? The algorithm has been proven to drive ad revenue instead of hyperlinks and discoverability, and they still ban outlinks.

Apps are a single point of failure. It reduces information diversity in several ways: sources, hosting and contents. It's as if all books were published by the same or a few publishers (apps) which might not seem like a big deal, but it's very very hard to move to another publisher. And its very very hard to make new publishers available to people, because they don't know any better. The migration costs are very high. Everyone only knows how to read from that particular publisher and maybe 2 others.

If the publisher thinks something won't sell or will harm it, it's not revealed even if it would be very helpful and drive sales. AKA the algorithm. I've had to create and painstakingly curate new accounts because of this, and people don't even know it's possible. Since they can't read stuff published by another publisher they don't learn about it. It's very hard to find out about other publishers and migrate to them due to familiarity, muscle memory and frankly the algorithm. Existing publishers can prevent people from moving to other publishers by preventing people from learning about them. For example Instagram banned links or even mentions of pixelfed and 404 media.

Hyperlinks are probably the most underrated, revolutionary invention of the last century. They are being eliminated for the sake of UI cleanliness. But at the cost of going back to darker times.

Post reply on HN