Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy's talk on the future of the industry

donnamagi.com

Post reply on HN
Print view View original

81–90 of 193 posts

Re: Andrej Karpathy's talk on the future of the industry

#81

Post by baxtr »

autobodie wrote: post #63
arkj wrote: post #54

>Software 2.0 are the weights which program neural networks. >I think it's a fundamental change, is that neural networks became programmable with large libraries... And in my mind, it's worth giving it the designation of a Software 3.0. I think it's a bit early to change your mind here. We love your 2.0, let's wait for some more time till th e dust settles so we can see clearly and up the revision number. In fact I'm…

Objectivity is lacking throughout the entire talk, not only in the thesis. But objectivity isn't very good for building hype.

How can someone so smart become a hype machine? I can’t wrap my head around it. Maybe he had the opportunity to learn from someone he worked closely with?

Re: Andrej Karpathy's talk on the future of the industry

#82

Post by mattgreenrocks »

__loam wrote: post #76
bcrosby95 wrote: post #65

I might be wrong, but it seems like some people are misinterpreting what is being said here. Software 3.0 isn't about using AI to write code. It's about using AI instead of code. So not Human -> AI -> Create Code -> Compile Code -> Code Runs -> The Magic Happens. Instead, it's Human -> AI -> The Magic Happens.

This industry is so tiring

Definitely. And it gets more tiring the more experience you have, because you've seen countless hype cycles come and go with very little change. Each time, the same mantra is chanted: "but this time, it's different!" Except, it usually isn't.

Started learning metal guitar seriously to forget about industry as a whole. Highly recommended!

Re: Andrej Karpathy's talk on the future of the industry

#83

Post by computator »

sammcgrail wrote: post #72

You’ve got “two bars” instead of “two rs” in strawberry

I was going to ask what this meant about strawberries:

> LLMs make mistakes that basically no human will make, like, you know, it will insist that 9.11 is greater than 9.9, or that there are two bars of strawberry. These are some famous examples.

But you answered it: It’s a stupid mistake a human makes when trying to mock the stupid mistakes that LLMs make!

Re: Andrej Karpathy's talk on the future of the industry

#84

Post by [deleted] »

swyx wrote: post #40
pudiklubi wrote: post #34

Earlier quoted context omitted.

so you took my transcript and put it behind a newsletter sub? haha. just share them!

not quite, i compiled the slides within a few hours of the talk yesterday well before your transcript was available. the slides are my main output/contribution. a full slides+transcript is too long for substack. i've linked your transcript prominently for people to find, and used it to fix slide ordering because twitter people took terrible notes for the purpose of exact talk reconstruction. i exepct YC to prioritize…

[deleted]

Re: Andrej Karpathy's talk on the future of the industry

#85

Post by [deleted] »

Karrot_Kream wrote: post #80
autobodie wrote: post #63

Earlier quoted context omitted.

Objectivity is lacking throughout the entire talk, not only in the thesis. But objectivity isn't very good for building hype.

I'm curious why you think that? I thought the talk was pretty grounded. There was a lot of skepticism of using LLMs unbounded to write software and an insistence on using ground truth free from LLM hallucination. The main thesis, to me, seemed like "we need to write software that was designed with human-centric APIs and UI patterns to now use an LLM layer in front and that'll be a lot of opportunity for software engi…

[deleted]

Re: Andrej Karpathy's talk on the future of the industry

#86

Post by TeMPOraL »

baxtr wrote: post #81
autobodie wrote: post #63

Earlier quoted context omitted.

Objectivity is lacking throughout the entire talk, not only in the thesis. But objectivity isn't very good for building hype.

How can someone so smart become a hype machine? I can’t wrap my head around it. Maybe he had the opportunity to learn from someone he worked closely with?

> How can someone so smart become a hype machine? I can’t wrap my head around it.

Maybe they didn't, and it's just your perception.

Re: Andrej Karpathy's talk on the future of the industry

#87

Post by throwawayoldie »

baxtr wrote: post #81
autobodie wrote: post #63

Earlier quoted context omitted.

Objectivity is lacking throughout the entire talk, not only in the thesis. But objectivity isn't very good for building hype.

How can someone so smart become a hype machine? I can’t wrap my head around it. Maybe he had the opportunity to learn from someone he worked closely with?

"It is difficult to get a man to understand something, when his salary depends upon his not understanding it." --Upton Sinclair

Re: Andrej Karpathy's talk on the future of the industry

#88

Post by zie1ony »

bcrosby95 wrote: post #65

I might be wrong, but it seems like some people are misinterpreting what is being said here. Software 3.0 isn't about using AI to write code. It's about using AI instead of code. So not Human -> AI -> Create Code -> Compile Code -> Code Runs -> The Magic Happens. Instead, it's Human -> AI -> The Magic Happens.

This is great idea, until you have to build something.

Re: Andrej Karpathy's talk on the future of the industry

#89

Post by barrkel »

baxtr wrote: post #81
autobodie wrote: post #63

Earlier quoted context omitted.

Objectivity is lacking throughout the entire talk, not only in the thesis. But objectivity isn't very good for building hype.

How can someone so smart become a hype machine? I can’t wrap my head around it. Maybe he had the opportunity to learn from someone he worked closely with?

Maybe you haven't seen the frontier and envisioned the possibilities?

Re: Andrej Karpathy's talk on the future of the industry

#90

Post by bmicraft »

bcrosby95 wrote: post #65

I might be wrong, but it seems like some people are misinterpreting what is being said here. Software 3.0 isn't about using AI to write code. It's about using AI instead of code. So not Human -> AI -> Create Code -> Compile Code -> Code Runs -> The Magic Happens. Instead, it's Human -> AI -> The Magic Happens.

The AI isn't much easier, when you consider the "AI" step is actually: create dataset -> train model -> fine-tune model -> run model to train a much smaller model -> ship much smaller model to end devices.
Post reply on HN