Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy's talk on the future of the industry

donnamagi.com

Post reply on HN
Print view View original

131–140 of 193 posts

Re: Andrej Karpathy's talk on the future of the industry

#131

Post by debugnik »

bgwalter wrote: post #93
Frummy wrote: post #51

Earlier quoted context omitted.

Totally not a supervillain "Q: What does your name (badmephisto) mean? A: I've had this name for a really long time. I used to be a big fan of Diablo2, so when I had to create my email address username on hotmail, i decided to use Mephisto as my username. But of course Mephisto was already taken, so I tried Mephisto1, Mephisto2, all the way up to about 9, and all was taken. So then I thought... "hmmm, what kind of ch…

> Since Mephisto (the brother of Diablo) Unbelievable. Perhaps some techies should read Goethe's Faust instead of Lord of the Rings.

Tell that to the writers of Diablo. In the context of the game, those two characters are brothers.

Re: Andrej Karpathy's talk on the future of the industry

#132

Post by Vegenoid »

agarren wrote: post #116
bcrosby95 wrote: post #65

I might be wrong, but it seems like some people are misinterpreting what is being said here. Software 3.0 isn't about using AI to write code. It's about using AI instead of code. So not Human -> AI -> Create Code -> Compile Code -> Code Runs -> The Magic Happens. Instead, it's Human -> AI -> The Magic Happens.

That jibes with what Nadella said in an interview not too long ago. Essentially, SaaS apps disappear entirely as LLMs interface directly with the underlying data store. The unspoken implication being that software as we understand it goes away as people interface with LLMs directly rather than ~~computers~~ software at all. I kind of expect that from someone heading a company that appears to have sold-the-farm in an…

> people interface with LLMs directly rather than software at all

What does this mean? An LLM is used via a software interface. I don’t understand how “take software out of the loop” makes any sense when we are using reprogrammable computers.

Re: Andrej Karpathy's talk on the future of the industry

#134

Post by iLoveOncall »

Just a grifter grifting.

> The more reliance we have on these models, which already is, like, really dramatic

Please point me to a single critical component anywhere that is built on LLMs. There's absolutely no reliance on models, and ChatGPT being down has absolutely no impact on anything beside teenagers not being able to cheat on their homeworks and LLM wrappers not being able to wrap.

Re: Andrej Karpathy's talk on the future of the industry

#135

Post by Aeolun »

andai wrote: post #36
afiodorov wrote: post #22

> So, it was really fascinating that I had the menu gem basically demo working on my laptop in a few hours, and then it took me a week because I was trying to make it do it Reminds me of work where I spend more time figuring out how to run repos than actually modifying code. A lot of my work is focused on figuring out the development environment and deployment process - all with very locked down permissions. I do thi…

The last 10% always takes 1000% of the time...

Jup. Claude develops the first 90% without a sweat, and then starts flailing.

Re: Andrej Karpathy's talk on the future of the industry

#136

Post by FridgeSeal »

Vegenoid wrote: post #132
agarren wrote: post #116

Earlier quoted context omitted.

That jibes with what Nadella said in an interview not too long ago. Essentially, SaaS apps disappear entirely as LLMs interface directly with the underlying data store. The unspoken implication being that software as we understand it goes away as people interface with LLMs directly rather than ~~computers~~ software at all. I kind of expect that from someone heading a company that appears to have sold-the-farm in an…

> people interface with LLMs directly rather than software at all What does this mean? An LLM is used via a software interface. I don’t understand how “take software out of the loop” makes any sense when we are using reprogrammable computers.

It’s just…the vibe of it man! It’s LLM’s! They’ll just…do things! And stuff…it’ll just happen!!! Don’t worry about the details!!!!

Re: Andrej Karpathy's talk on the future of the industry

#137

Post by Aeolun »

iLoveOncall wrote: post #134

Just a grifter grifting. > The more reliance we have on these models, which already is, like, really dramatic Please point me to a single critical component anywhere that is built on LLMs. There's absolutely no reliance on models, and ChatGPT being down has absolutely no impact on anything beside teenagers not being able to cheat on their homeworks and LLM wrappers not being able to wrap.

Well, you have all these social security programs using them to decide whether people should be investigated. That’s pretty nasty. I can totally see them not processing any applications if the model is down.

Re: Andrej Karpathy's talk on the future of the industry

#138

Post by ath3nd »

I find it hard to care for the marginal improvements in a glorifiedutocomplete that guzzles a shit ton of water and electricity (all stuff that can be used for more useful stuff than generating a picture of a cat with human hands or some lazy rando's essay assignment) and then ends up having to be coddled by a real engineer into a working solution.

Software 2.0? 3.0? Why stop there? Why not software 1911.1337? We went through crypto, NFTs, web3.0, now LLMs are hyped as if they are frigging AGI (spoiler, LLMs are not designed to be AGI, and even if they were, you sure as hell won't be the one to use them to your advantage, so why are you so irrationally happy about it?).

Man this industry is so tiring! What is the most tiring is the dog-like enthusiasm of the people who buy it EVERY.DAMN.TYPE, as if it's gonna change the life of most of them for the better. Sure, some of these are worse and much more useless than others (NFTs), but in the core of all of it is this cult-like awe we as a society have towards figures like the Karpathy's, Musks and Altmans of this world.

How are LLMs gonna help society? How are they gonna help people work, create and connect with one another? They take away the joy of making art, the joy of writing, of learning how to play a music instrument and sing, and now they are coming for software engineering. Sure, you might be 1%/2% faster, but are you happier, are you smarter (probably not: https://www.mdpi.com/2076-3417/14/10/4115)?

Re: Andrej Karpathy's talk on the future of the industry

#139

Post by DaveChurchill »

arkj wrote: post #54

>Software 2.0 are the weights which program neural networks. >I think it's a fundamental change, is that neural networks became programmable with large libraries... And in my mind, it's worth giving it the designation of a Software 3.0. I think it's a bit early to change your mind here. We love your 2.0, let's wait for some more time till th e dust settles so we can see clearly and up the revision number. In fact I'm…

The death of deterministic computing and unverifiable information is a horror show

Re: Andrej Karpathy's talk on the future of the industry

#140

Post by umeshunni »

no_wizard wrote: post #25
umeshunni wrote: post #18

Earlier quoted context omitted.

> I do think that open source models will eventually catch up to closed source ones It felt like that was the direction for a while, but in the last year or so, the gap seems to have widened. I'm curious whether this is my perception or validated by some metric.

This was how early browsers felt too, the open source browser engines were slower at adapting than the ones developed by Netscape and Microsoft, but eventually it all reversed and open source excelled past the closed source software. Another way to put it, is that over time you see this, it usually takes a little while for open source projects to catch up, but once they do they gain traction quite quickly over the cl…

That's a good analogy. Makes a lot of sense. The only caveat I see is that there is a lot of context locked up in proprietary data sets (e.g. YT, books, podcasts) and I'm not sure how OSS models get access to that.
Post reply on HN