Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy: Software in the era of AI [video]

youtube.com

Post reply on HN
Print view View original

141–150 of 827 posts

Re: Andrej Karpathy: Software in the era of AI [video]

#141

Post by guappa »

fergie wrote: post #133

There were some cool ideas- I particularly liked "psychology of AI" Overall though I really feel like he is selling the idea that we are going to have to pay large corporations to be able to write code. Which is... terrifying. Also, as a lazy developer who is always trying to make AI do my job for me, it still kind of sucks, and its not clear that it will make my life easier any time soon.

I think it used to be like that before the GNU people made gcc, completely destroying the market of compilers.

> Also, as a lazy developer who is always trying to make AI do my job for me, it still kind of sucks, and its not clear that it will make my life easier any time soon.

Every time I have to write a simple self contained couple of functions I try… and it gets it completely wrong.

It's easier to just write it myself rather than to iterate 50 times and hope it will work, considering iterations are also very slow.

Re: Andrej Karpathy: Software in the era of AI [video]

#142

Post by practal »

gylterud wrote: post #128
practal wrote: post #124

Earlier quoted context omitted.

You would definitely think so, Lean is in a great position here! I am betting though that type theory is not the right logic for this, and that Lean can be leapfrogged.

I think type theory is exactly right for this! Being so similar to programming languages, it can piggy back on the huge amount of training the LLMs have on source code. I am not sure lean in part is the right language, there might be challengers rising (or old incumbents like Agda or Roq can find a boost). But type theory definitely has the most robust formal systems at the moment.

> Being so similar to programming languages

I think it is more important to be close to English than to programming languages, because that is the critical part:

"As close to a programming language as necessary, as close to English as possible"

is the goal, in my opinion, without sacrificing constraints such as simplicity.

Re: Andrej Karpathy: Software in the era of AI [video]

#143

Post by shakna »

melvinmelih wrote: post #104
shakna wrote: post #92

Earlier quoted context omitted.

Driving is not a general problem, though. Its a contextual landscape of fast-based reactions and predictions. Both are required, and done regularly by the human element. The exact nature of every reaction, and every prediction, change vastly within the context window. You need image processing just as much as you need scenario management, and they're orthoganol to each other, as one example. If you want a general tra…

> Driving is not a general problem, though. But what's driving a car? A generalist human brain that has been trained for ~30 hours to drive a car.

Human brain's aren't generalist!

We have multiple parts of the brain that interact in vastly different ways! Your cerebellum won't be running the role of the pons.

Most parts of the brain cannot take over for others. Self-healing is the exception, not the rule. Yes, we have a degree of neuroplasticity, but there are many limits.

(Sidenote: Driver's license here is 240 hours.)

Re: Andrej Karpathy: Software in the era of AI [video]

#145

Post by shakna »

alightsoul wrote: post #95
shakna wrote: post #93

Earlier quoted context omitted.

That's called a JIT compiler. And ignoring how bad an idea blending those two... It wouldn't be that difficult a task. The hardest parts of a jit is the safety aspect. And AI already violates most of that.

The safety part will probably be either solved or a non-issue or ignored. Similarly to how GPT3 was often seen as dangerous before ChatGPT was released. Some people who have only ever vibe coded are finding jobs today, ignoring safety entirely and lacking a notion of it or what it means. They just copy paste output from ChatGPT or an agentic IDE. To me it's JIT already with extra steps. Or they have pivoted their sof…

As "jit" to you means running code, and not "building and executing machine code", maybe you could vibe code this. And enjoy the segfaults.

Re: Andrej Karpathy: Software in the era of AI [video]

#146

Post by floppyd »

yusina wrote: post #139
ramraj07 wrote: post #137

Earlier quoted context omitted.

[flagged]

Brutal counter take: If AI tooling makes you so much better, then you started very low. In contrast, if you are already insanely productive in creative ways others can hardly achieve then chances are, AI tools don't make much of a difference.

As someone who is starting very low — I very much agree. I'm basically a hobbyist who can navigate around Python code, and LLMs have been a godsend to me, they increased my hobby output tenfold. But as soon as I get into coding something I'm more familiar with, the LLMs usefulness plummets, because it's easier and faster to directly write code than to "translate" from English to code using an LLM (maybe only apart from using basically a smarter one-line tab completion)

Re: Andrej Karpathy: Software in the era of AI [video]

#148

Post by sneak »

jph00 wrote: post #74
sneak wrote: post #32

Can we please stop standardizing on putting things in the root? /.well-known/ exists for this purpose. example.com/.well-known/llms.txt https://en.m.wikipedia.org/wiki/Well-known_URI

You can't just put things there any time you want - the RFC requires that they go through a registration process. Having said that, this won't work for llms.txt, since in the next version of the proposal they'll be allowed at any level of the path, not only the root.

I put stuff in /.well-known/ all the time whenever I want. They’re my servers.

Re: Andrej Karpathy: Software in the era of AI [video]

#149

Post by amelius »

politelemon wrote: post #120

The beginning was painful to watch as is the cheering in this comment section. The 1.0, 2.0, and 3.0 simply aren't making sense. They imply a kind of a succession and replacement and demonstrate a lack of how programming works. It sounds as marketing oriented as "Web 3.0" that has been born inside an echo chamber. And yet halfway through, the need for determinism/validation is now being reinvented. The analogies make…

The version numbers mean abrupt changes.

Analogy: how we "moved" from using Google to ChatGPT is an abrupt change, and we still use Google.

Re: Andrej Karpathy: Software in the era of AI [video]

#150

Post by semi-extrinsic »

hgl wrote: post #51

It’s fascinating to think about what true GUI for LLM could be like. It immediately makes me think a LLM that can generate a customized GUI for the topic at hand where you can interact with in a non-linear way.

Humans are shit at interacting with systems in a non-linear way. Just look at Jupyter notebooks and the absolute mess that arises when you execute code blocks in arbitrary order.
Post reply on HN