Live data from Hacker News

Andrej Karpathy's talk on the future of the industry

donnamagi.com

31–40 of 193 posts

Re: Andrej Karpathy's talk on the future of the industry

#31

Earlier quoted context omitted.

No, they are totally unrelated. Web 3.0 is blockchain-backed web applications (rather than proprietary server-backed web applications, which is Web 2.0) and Software 3.0 is LLM-powered agents.

What was Software 2.0?

It's using NNs or ML models which are given datasets and learn using those datasets. https://karpathy.medium.com/software-2-0-a64152b37c35

If you read the talk you can find out this and more :)

Re: Andrej Karpathy's talk on the future of the industry

#32

Earlier quoted context omitted.

No, they are totally unrelated. Web 3.0 is blockchain-backed web applications (rather than proprietary server-backed web applications, which is Web 2.0) and Software 3.0 is LLM-powered agents.

What was Software 2.0?

Trained Neural Networks.

Re: Andrej Karpathy's talk on the future of the industry

#33

Earlier quoted context omitted.

No, they are totally unrelated. Web 3.0 is blockchain-backed web applications (rather than proprietary server-backed web applications, which is Web 2.0) and Software 3.0 is LLM-powered agents.

What was Software 2.0?

Early application specific ML models, Software 1.0 is normal programs.

Re: Andrej Karpathy's talk on the future of the industry

#34
post #20

For context - I was in the audience when Karpathy gave this amazing talk on software 3.0. YC has said the official video will take a few weeks to release, by which Karpathy himself said the talk will be deprecated. https://x.com/karpathy/status/1935077692258558443

i synced the slides with the talk transcript here : https://latent.space/s3

so you took my transcript and put it behind a newsletter sub? haha. just share them!

Re: Andrej Karpathy's talk on the future of the industry

#35
post #29

Earlier quoted context omitted.

This sounds like an informercial

How so? That sounds a completely realistic use of NotebookLM.

Just the tone, I mean I listen to podcasts a bit but.. yuck. I'd rather just read than listen to this.

Re: Andrej Karpathy's talk on the future of the industry

#36

> So, it was really fascinating that I had the menu gem basically demo working on my laptop in a few hours, and then it took me a week because I was trying to make it do it Reminds me of work where I spend more time figuring out how to run repos than actually modifying code. A lot of my work is focused on figuring out the development environment and deployment process - all with very locked down permissions. I do thi…

The last 10% always takes 1000% of the time...

Re: Andrej Karpathy's talk on the future of the industry

#37
post #36

> So, it was really fascinating that I had the menu gem basically demo working on my laptop in a few hours, and then it took me a week because I was trying to make it do it Reminds me of work where I spend more time figuring out how to run repos than actually modifying code. A lot of my work is focused on figuring out the development environment and deployment process - all with very locked down permissions. I do thi…

The last 10% always takes 1000% of the time...

I am not saying rewrites are always warranted, but I think LLMs change the cost-benefit balance considerably.

Re: Andrej Karpathy's talk on the future of the industry

#38
post #7

First time using NotebookLM and it blew my mind. I pasted in the OP's transcription of the talk into NotebookLM and got this "podcast": https://notebooklm.google.com/notebook/5ec54d65-f512-4e6c-9c...

Thank you for putting it together, it was pretty good - 27m:12s

Re: Andrej Karpathy's talk on the future of the industry

#39
post #29

Earlier quoted context omitted.

This sounds like an informercial

How so? That sounds a completely realistic use of NotebookLM.

I think he meant the audio output itself sounds like an infomercial.

https://www.youtube.com/watch?v=gfr4BP4V1R8

Re: Andrej Karpathy's talk on the future of the industry

#40
post #20

Earlier quoted context omitted.

i synced the slides with the talk transcript here : https://latent.space/s3

so you took my transcript and put it behind a newsletter sub? haha. just share them!

not quite, i compiled the slides within a few hours of the talk yesterday well before your transcript was available. the slides are my main output/contribution. a full slides+transcript is too long for substack. i've linked your transcript prominently for people to find, and used it to fix slide ordering because twitter people took terrible notes for the purpose of exact talk reconstruction.

i exepct YC to prioritize publishing this talk so propbably the half life of any of this work is measured in days anyway.

100% of our podcast is published for free, but we still have ~1000 people who choose to support our work with a subscription (it does help pay for editors, equipment, and travel). I always feel bad that we dont have much content for them so i figured i'd put just the slide compilation up for subscribers. i'm trying to find nice ways to ramp up value for our subs over time, mostly by showing "work in progress" things like this that i had to do anyway to summarize/internalize the talk properly - which again is what we published entirely free/no subscription required

Post reply on HN