See also https://www.latent.space/p/s3
haha, love how we have the two pieces of the puzzle. we should merge!
Andrej Karpathy's talk on the future of the industry
21–30 of 193 posts
Re: Andrej Karpathy's talk on the future of the industry
#22> So, it was really fascinating that I had the menu gem basically demo working on my laptop in a few hours, and then it took me a week because I was trying to make it do it
Reminds me of work where I spend more time figuring out how to run repos than actually modifying code. A lot of my work is focused on figuring out the development environment and deployment process - all with very locked down permissions.
I do think LLMs are likely to change industry considerably, as LLM-guided rewrites are sometimes easier than adding a new feature or fixing a bug - especially if the rewrite is something into more LLM-friendly (i.e., a popular framework). Each rewrite makes the code further Claude-codeable or Cursor-codeable; ready to iterate even faster.
Re: Andrej Karpathy's talk on the future of the industry
#23First time using NotebookLM and it blew my mind. I pasted in the OP's transcription of the talk into NotebookLM and got this "podcast": https://notebooklm.google.com/notebook/5ec54d65-f512-4e6c-9c...
This sounds like an informercial
Re: Andrej Karpathy's talk on the future of the industry
#24The talk is still not available on YouTube? What takes them so long?
Apparently AI doesn’t make you a 10x YouTube releaser. ;)
Re: Andrej Karpathy's talk on the future of the industry
#25A large contention of this essay (which I’m assuming the talk is based on or is transcribed from depending on order) I do think that open source models will eventually catch up to closed source ones, or at least be “good enough” and I also think you can already see how LLMs are augmenting knowledge work. I don’t think it’s the 4th wave of pioneering a new dawn of civilization but it’s clear LLMs will remain useful wh…
> I do think that open source models will eventually catch up to closed source ones It felt like that was the direction for a while, but in the last year or so, the gap seems to have widened. I'm curious whether this is my perception or validated by some metric.
This was how early browsers felt too, the open source browser engines were slower at adapting than the ones developed by Netscape
and Microsoft, but eventually it all reversed and open source excelled past the closed source software.
Another way to put it, is that over time you see this, it usually takes a little while for open source projects to catch up, but once they do they gain traction quite quickly over the closed source counter parts.
Re: Andrej Karpathy's talk on the future of the industry
#26A large contention of this essay (which I’m assuming the talk is based on or is transcribed from depending on order) I do think that open source models will eventually catch up to closed source ones, or at least be “good enough” and I also think you can already see how LLMs are augmenting knowledge work. I don’t think it’s the 4th wave of pioneering a new dawn of civilization but it’s clear LLMs will remain useful wh…
> I do think that open source models will eventually catch up to closed source ones It felt like that was the direction for a while, but in the last year or so, the gap seems to have widened. I'm curious whether this is my perception or validated by some metric.
Already today I can use aider with qwen3 for free but have to pay per token to use it with any of the commercial models. The flexibility is worth the lower performance.
Re: Andrej Karpathy's talk on the future of the industry
#27Re: Andrej Karpathy's talk on the future of the industry
#28For context - I was in the audience when Karpathy gave this amazing talk on software 3.0. YC has said the official video will take a few weeks to release, by which Karpathy himself said the talk will be deprecated. https://x.com/karpathy/status/1935077692258558443
What a poor judgement he must have if his outlook becomes irrelevant in a few weeks' time.
Edit: the emoji at the end of the original sentence has not been quoted. How a smile makes the difference. Original tweet: https://x.com/karpathy/status/1935077692258558443
Re: Andrej Karpathy's talk on the future of the industry
#29First time using NotebookLM and it blew my mind. I pasted in the OP's transcription of the talk into NotebookLM and got this "podcast": https://notebooklm.google.com/notebook/5ec54d65-f512-4e6c-9c...
This sounds like an informercial
How so? That sounds a completely realistic use of NotebookLM.