Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy's talk on the future of the industry

donnamagi.com

Post reply on HN
Print view View original

41–50 of 193 posts

Re: Andrej Karpathy's talk on the future of the industry

#41

Post by theturtletalks »

theyinwhy wrote: post #28
pudiklubi wrote: post #2

For context - I was in the audience when Karpathy gave this amazing talk on software 3.0. YC has said the official video will take a few weeks to release, by which Karpathy himself said the talk will be deprecated. https://x.com/karpathy/status/1935077692258558443

What a poor judgement he must have if his outlook becomes irrelevant in a few weeks' time. Edit: the emoji at the end of the original sentence has not been quoted. How a smile makes the difference. Original tweet: https://x.com/karpathy/status/1935077692258558443

It was in jest, more a take of how quickly things move in AI

Re: Andrej Karpathy's talk on the future of the industry

#42

Post by alganet »

> imagine changing it and programming the computer's life

> imagine that the inputs for the car are on the bottom, and they're going through the software stack to produce the steering and acceleration

> imagine inspecting them, and it's got an autonomy slider

> imagine works as like this binary array of a different situation, of like what works and doesn't work

--

Software 3.0 is imaginary. All in your head.

I'm kidding, of course. He's hyping because he needs to.

Let's imagine together:

Imagine it can be proven to be safe.

Imagine it being reliable.

Imagine I can pre-train on my own cheap commodity hardware.

Imagine no one using it for war.

Re: Andrej Karpathy's talk on the future of the industry

#44

Post by qwertox »

theyinwhy wrote: post #28
pudiklubi wrote: post #2

For context - I was in the audience when Karpathy gave this amazing talk on software 3.0. YC has said the official video will take a few weeks to release, by which Karpathy himself said the talk will be deprecated. https://x.com/karpathy/status/1935077692258558443

What a poor judgement he must have if his outlook becomes irrelevant in a few weeks' time. Edit: the emoji at the end of the original sentence has not been quoted. How a smile makes the difference. Original tweet: https://x.com/karpathy/status/1935077692258558443

We better stop talking about the future then.

Re: Andrej Karpathy's talk on the future of the industry

#45

Post by QRY »

msgodel wrote: post #26
umeshunni wrote: post #18

Earlier quoted context omitted.

> I do think that open source models will eventually catch up to closed source ones It felt like that was the direction for a while, but in the last year or so, the gap seems to have widened. I'm curious whether this is my perception or validated by some metric.

Already today I can use aider with qwen3 for free but have to pay per token to use it with any of the commercial models. The flexibility is worth the lower performance.

Do you have anything to share on that workflow? I've been trying to get a local-first AI thing going, could use your insights!

Re: Andrej Karpathy's talk on the future of the industry

#46

Post by steveBK123 »

jolan wrote: post #39
jckahn wrote: post #29

Earlier quoted context omitted.

How so? That sounds a completely realistic use of NotebookLM.

I think he meant the audio output itself sounds like an infomercial. https://www.youtube.com/watch?v=gfr4BP4V1R8

Correct, yes.

That NotebookLM podcast was like the most unpleasant way I can imagine to consume content. Reading transcripts of live talks is already pretty annoying because it's less concise than the written word. Having it re-expanded by robot-voice back to audio to be read to me just makes it even more unpleasant.

Also sort of perverse we are going audio->transcript->fake audio. "YC has said the official video will take a few weeks to release," - I mean shouldn't one of the 100 AI startups solve this for them?

Anyway, maybe it's just me.. I'm the kind of guy that got a cynical chuckle at the airport the other week when I saw a "magazine of audio books".

Re: Andrej Karpathy's talk on the future of the industry

#47

Post by swyx »

pudiklubi wrote: post #34
swyx wrote: post #20

Earlier quoted context omitted.

i synced the slides with the talk transcript here : https://latent.space/s3

so you took my transcript and put it behind a newsletter sub? haha. just share them!

btw i think your transcript is missing most of the Perplexity slide discussion, right after the Cursor example

Re: Andrej Karpathy's talk on the future of the industry

#48

Post by msgodel »

QRY wrote: post #45
msgodel wrote: post #26

Earlier quoted context omitted.

Already today I can use aider with qwen3 for free but have to pay per token to use it with any of the commercial models. The flexibility is worth the lower performance.

Do you have anything to share on that workflow? I've been trying to get a local-first AI thing going, could use your insights!

It's super easy. I already had llama.cpp/llama-server set up for a bunch of other stuff and actually had my own homebrew RAG dialog engine, aider is just way better.

One crazy thing is that since I keep all my PIM data in git in flat text I now have essentially "siri for Linux" too if I want it. It's a great example of what Karpathy was talking about where improvements in the ML model have consumed the older decision trees and coded integrations.

I'd highly recommend /nothink in the system prompt. Qwen3 is not good at reasoning and tends to get stuck in loops until it fills up its context window.

My current config is qwen2.5-coder-0.5b for my editor plugin and qwen3-8b for interactive chat and aider. I use nibble quants for everything. 0.5b is not enough for something like aider, 8b is too much for interactive editing. I'd also recommend shrinking the ring context in the neovim plugin if you use that since the default is 32k tokens which takes forever and generates a ton of heat.

Re: Andrej Karpathy's talk on the future of the industry

#49

Post by Henchman21 »

alganet wrote: post #42

> imagine changing it and programming the computer's life > imagine that the inputs for the car are on the bottom, and they're going through the software stack to produce the steering and acceleration > imagine inspecting them, and it's got an autonomy slider > imagine works as like this binary array of a different situation, of like what works and doesn't work -- Software 3.0 is imaginary. All in your head. I'm kidd…

If I’m going to be leaning on my imagination this much I am going to imagine a world where the tech industry considers at great length whether or not something should be built.

Re: Andrej Karpathy's talk on the future of the industry

#50

Post by scottyah »

qwertox wrote: post #44
theyinwhy wrote: post #28

Earlier quoted context omitted.

What a poor judgement he must have if his outlook becomes irrelevant in a few weeks' time. Edit: the emoji at the end of the original sentence has not been quoted. How a smile makes the difference. Original tweet: https://x.com/karpathy/status/1935077692258558443

We better stop talking about the future then.

Every time you talk about the future, it gets altered.
Post reply on HN