Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy: Software in the era of AI [video]

youtube.com

Post reply on HN
Print view View original

681–690 of 827 posts

Re: Andrej Karpathy: Software in the era of AI [video]

#681

Post by otabdeveloper4 »

simplify wrote: post #595
otabdeveloper4 wrote: post #545

Earlier quoted context omitted.

> We're witnessing a fundamental shift where the interface to computing is changing from formal syntax to natural language. People have said this every year since the 1950's. No, it is not happening. LLMs won't help. Writing code is easy, it's understanding the problem domain is hard. LLMs won't help you understand the problem domain in a formal manner. (In fact they might make it even more difficult.)

Let's be real, people have said similar things about AI too. It was all fluff, until it wasn't.

AI still doesn't have a valid and sustainable business use case.

People are just assuming that the hallucination and bullshitting issues will just go away with future magic releases, but they won't.

Re: Andrej Karpathy: Software in the era of AI [video]

#682

Post by beambot »

dheera wrote: post #680
OJFord wrote: post #661

I'm not sure about the 1.0/2.0/3.0 classification, but it did lead me to think about LLMs as a programming paradigm: we've had imperative & declarative, procedural & functional languages, maybe we'll come to view deterministic vs. probabilistic (LLMs) similarly. def __main__: You are a calculator. Given an input expression, you compute the result and print it to stdout, exiting 0. Should you be unable to do this, you…

def __main__: You run main(). If there are issues, you edit __file__ to try to fix the errors and re-run it. You are determined, persistent, and never give up.

Output "1" if the program halts; "0" if it doesn't.

Re: Andrej Karpathy: Software in the era of AI [video]

#683

Post by asterisk_ »

karpathy wrote: post #57
hgl wrote: post #51

It’s fascinating to think about what true GUI for LLM could be like. It immediately makes me think a LLM that can generate a customized GUI for the topic at hand where you can interact with in a non-linear way.

Fun demo of an early idea was posted by Oriol just yesterday :) https://x.com/OriolVinyalsML/status/1935005985070084197

I feel like one quickly hits a similar partial observability problem as with e.g. light sensors. How often do you wave around annoyed because the light turned off.

To get _truly_ self driving UIs you need to read the mind of your users. It's some heavy tailed distribution all the way down. Interesting research problem on its own.

We already have adaptive UIs (profiles in VSC anyone? Vim, Emacs?) they're mostly under-utilized because takes time to setup + most people are not better at designing their own workflow relative to the sane default.

Re: Andrej Karpathy: Software in the era of AI [video]

#684

Post by teekert »

hollowturtle wrote: post #300
teekert wrote: post #159

Earlier quoted context omitted.

He says that now we are in the mainframe phase. We will hit the personal computing phase hopefully soon. He says llama (and DeepSeek?) are like Linux in a way, OpenAI and Claude are like Windows and MacOS. So, No, he’s actually saying it may be everywhere for cheap soon. I find the talk to be refreshingly intellectually honest and unbiased. Like the opposite of a cringey LinkedIn post on AI.

Being Linux is not a good thing imo, it took decades for tech like proton to run Windows games reliably, if not better as now, than Windows does. Software is still mostly develop for Windows and macOS. Not to mention the Linux Desktop that never took off, I mean one could mention Android but there is a large corporation behind it. Sure Linux is successfull in many ways, it's embedded everywhere but nowhere near being…

You mention consumer stuff, but Linux runs the world. In numbers it's more like insects vs human than any "fair balance". You probably have more Linux machines serving you than Windows or MacOS/iOS machine at any given time.

Re: Andrej Karpathy: Software in the era of AI [video]

#685

Post by kevinventullo »

dang wrote: post #535
guappa wrote: post #152

Earlier quoted context omitted.

AI is not mind reading.

Behavioral patterns are not unpredictable. Who knows how far an LLM could get by pattern-matching what a user is doing and generating a UI to make it easier. Since the user could immediately say whether they liked it or not, this could turn into a rapid and creative feedback loop.

So, if the user likes UI’s that don’t change, the LLM will figure out that it should do nothing?

One problem LLM’s don’t fix is the misalignment between app developers’ incentives and users’ incentives. Since the developer controls the LLM, I imagine that a “smart” shifting UI would quickly devolve into automated dark patterns.

Re: Andrej Karpathy: Software in the era of AI [video]

#686

Post by aaron695 »

OJFord wrote: post #661

I'm not sure about the 1.0/2.0/3.0 classification, but it did lead me to think about LLMs as a programming paradigm: we've had imperative & declarative, procedural & functional languages, maybe we'll come to view deterministic vs. probabilistic (LLMs) similarly. def __main__: You are a calculator. Given an input expression, you compute the result and print it to stdout, exiting 0. Should you be unable to do this, you…

[flagged]

Re: Andrej Karpathy: Software in the era of AI [video]

#687

Post by mirsadm »

old_man_cato wrote: post #643

The image of a bunch of children in a room gleefully playing with their computers is horror movie type stuff, but because it's in a white room with plants and not their parent's basement with the lights off, it's somehow a wonderful future. Karpathy and his peer group are some of the most elitist and anti social people who have ever lived. I wonder how history will remember them.

I thought that video was generated. Everything about it seemed off

Re: Andrej Karpathy: Software in the era of AI [video]

#688

Post by fullstackchris »

beacon294 wrote: post #315

What is this "clerk" library he used at this timestamp to tell him what to do? https://youtu.be/LCEmiRjPEtQ?si=XaC-oOMUxXp0DRU0&t=1991 Gemini found it via screenshot or context: https://clerk.com/ This is what he used for login on MenuGen: https://karpathy.bearblog.dev/vibe-coding-menugen/

clerk is an auth library - and finally one that doesnt require dozens of lines to do things like, i dont know, check if the user is logged in

and wild... you used gemini to process a screenshot to find the website for a 5 letter word library?

Re: Andrej Karpathy: Software in the era of AI [video]

#690

Post by LZ_Khan »

Waterluvian wrote: post #625

This got me thinking about something… Isn’t an LLM basically a program that is impossible to virus scan and therefore can never be safely given access to any capable APIs? For example: I’m a nice guy and spend billions on training LLMs. They’re amazing and free and I hand out the actual models for you all to use however you want. But I’ve trained it very heavily on a specific phrase or UUID or some other activation k…

I do feel like large scale LLM vulnerabilities will be the real Y2K
Post reply on HN