Andrej Karpathy: Software in the era of AI [video]

Post by jamessinghal » Thu, Jun 19, 2025, 9:48 PM UTC

dist-epoch wrote: post #544

jamessinghal wrote: post #431

Earlier quoted context omitted.

This is changing; OpenAI's newer API (Responses) is required to include reasoning tokens in the context while using the API, to get the reasoning summaries, and to use some of the OpenAI provided tools. Google's OpenAI compatibility supports Chat Completions, not Responses. As the LLM developers continue to add unique features to their APIs, the shared API which is now OpenAI will only support the minimal common subs…

It's still trivial to map to a somewhat different API. Google has it's Vertex/GenAI API flavors. At least for now, LLM APIs are just JSONs with a bunch of prompts/responses in them and maybe some file URLs/IDs.

Post by khalic » Thu, Jun 19, 2025, 9:55 PM UTC

vikramkr wrote: post #256

khalic wrote: post #244

Earlier quoted context omitted.

He understands the technical part, of course, I was referring to his prediction that large models will be always be necessary. There is a point where an LLM is good enough for most tasks, I don’t need a megamind AI in order to greet clients, and both large and small/medium model size are getting there, with the large models hitting a computing/energy demand barrier. The small models won’t hit that barrier anytime soo…

Did he predict they'd always be necessary? He mostly seemed to predict the opposite, that we're at the early stage of a trajectory that has yet to have it's Linux moment

Post by diggan » Thu, Jun 19, 2025, 10:09 PM UTC

zelphirkalt wrote: post #584

diggan wrote: post #374

Earlier quoted context omitted.

> If "AI" worked (which fortunately isn't the case), humans would be degraded to passive consumers in the last domain in which they were active creators: thinking. "AI" (depending on what you understand that to be) is already "working" for many, including myself. I've basically stopped using Google because of it. > humans would be degraded to passive consumers in the last domain in which they were active creators: th…

The AI as it is currently, will not come up with that new app idea or that clever innovative way of implementing an application. It will endlessly rehash the training data it has ingested. Sure, you can tell an AI to spit out a CRUD, and maybe it will even eventually work in some sane way, but that's not innovative and not necessarily a good software. It is blindly copying existing approaches to implement something.…

Post by poorcedural » Thu, Jun 19, 2025, 10:10 PM UTC

dmitrijbelikov wrote: post #65

I think that Andrej presents “Software 3.0” as a revolution, but in essence it is a natural evolution of abstractions. Abstractions don't eliminate the need to understand the underlying layers - they just hide them until something goes wrong. Software 3.0 is a step forward in convenience. But it is not a replacement for developers with a foundation, but a tool for acceleration, amplification and scaling. If you know…

Post by [deleted] » Thu, Jun 19, 2025, 10:21 PM UTC

sponnath wrote: post #539

alightsoul wrote: post #471

It's interesting to see people here and on Blind are more wary? of AI than people in say, Reddit or Youtube comments

Reddit and YouTube are such huge social media platforms that it really depends on which bubble (read: subreddits/yt channels) you're looking at. There's the "AGI is here" people over at r/singularity and then the "AI is useless" people at r/programming. I'm simplifying arguments from both sides here but you get my point.