Earlier quoted context omitted.
I had few projects like that this year and I can say it how messy and demotivating its to cleaning up mess. And its actually not well paid because client now has the expectation that mostly everything is now done, you have to just only fix few things and you even have AI at your disposal so expect that you just write a better magic prompt. I think actually often its faster and cheaper to start from scratch or at leas…
Would you be able to share any more details on the clean up projects you had to do? Like, wasn't front or back end, which tech stack, where were the LLM code issues etc. I'm just very curious where we are at the moment with in this profession.
Karpathy on Programming: “I've never felt this much behind”
551–560 of 630 posts
Re: Karpathy on Programming: “I've never felt this much behind”
#552Earlier quoted context omitted.
Eh, for myself as a middle-aged software engineer, it feels a little like the last chopper out of Saigon. I feel less and less confident that I can make as good a living in software for the next decade as I have for the last couple. Or if I want to. The job is changing so fast right now, and I’m not sure I like it. When I worked in big tech, I preferred being an IC over an EM or tech lead because I like writing code.…
You'll make more money than ever cleaning up AI generated messes.
Second, do you actually want to do that work? I don’t. I spent years working as a freelancer and I cleaned up a lot of shitty code from other freelancers. Not really what I want to spend my 50s doing.
Re: Karpathy on Programming: “I've never felt this much behind”
#553Earlier quoted context omitted.
Eh, for myself as a middle-aged software engineer, it feels a little like the last chopper out of Saigon. I feel less and less confident that I can make as good a living in software for the next decade as I have for the last couple. Or if I want to. The job is changing so fast right now, and I’m not sure I like it. When I worked in big tech, I preferred being an IC over an EM or tech lead because I like writing code.…
You'll make more money than ever cleaning up AI generated messes.
Re: Karpathy on Programming: “I've never felt this much behind”
#554Earlier quoted context omitted.
You need a lot more money than $200 if your code base is more than 100,000 lines. If only more people understood what quadratic attention means in the real world.
Are you saying the LLM costs grow quadratically in the size of the code base? The prompts are already highly subsidized, can't wait to see what happens when they charge the actual price to the consumer.
Re: Karpathy on Programming: “I've never felt this much behind”
#555Earlier quoted context omitted.
Well, I don’t really think it’s “simple”. The code uses React, nodejs, realtime events pushed via SSE, infra pushed via Terraform, postgres, blob store on S3, emails send with SES… sure, it’s not the next Google, but it’s a bit above, like, a personal blog. And in any case, you are moving goalposts. OP said he had never seen anyone serious claim that they got productivity gains from AI. When I claim that, you say “we…
If you want my opinion, I think LLMs can be pretty good at generating simple code for things you can find on stackoverflow and require minor adjustments. Even then, if you don't really understand the code you can have major issues. Your site is case in point of why LLMs demo well but kind of fall apart in the real world. It's pretty good at fitting lego blocks together based on a ton of work other people have put int…
Re: Karpathy on Programming: “I've never felt this much behind”
#556Earlier quoted context omitted.
It's because the models keep getting better! What you could do with GPT-4 was more impressive than what you could do with GPT 3.5. What you could do with Sonnet 3.5 was more impressive yet, and Sonnet 4, and Sonnet 4.5. Some of these improvements have been minor, some of them have been big enough to feel like step changes. Sonnet 3.7 + Claude Code (they came out at the same time) was a big step change; Opus 4.5 simil…
Models keep getting better but the argument I'm critiquing stays the same. So does the comment I critiqued in the sibling comment to yours. I don't know why it's so hard to believe we just haven't tried. I have a Claude subscription. I'm an ML researcher myself. Trust me, I do try. But that last part also makes me keenly aware of their limitations and failures. Frankly I don't trust experts who aren't critiquing thei…
The answer is: Exactly what we are saying. This is also why people keep suggesting that you need to try them out with a more open mind, or with different techniques: Because we know with absolute first-person iron-clad certainty what is possible, and if you don't think it's possible, you're missing something.
Re: Karpathy on Programming: “I've never felt this much behind”
#557Earlier quoted context omitted.
Practically every post on HN that mentions AI now ends up with a thread that is "I get 100X speed-up using LLMs" vs. "It made me slower and I've never met a single person in real life who has worked faster with AI." I'm a half-decent developer with 40 years experience. AI regularly gives me somewhere in the range of 10-100X speed-up of development. I don't benefit from a meme, I do benefit from better code delivered…
I've posted this on another comment verbatim that was similar to yours, so apologies for the copy and paste: Can you share what exactly this was (that got you the 10-100x speedup)? Perhaps I don't do anything exciting or challenging, but personally this hasn't happened to me so I find it hard to imagine what this could be. Instead of AI companies talking about their products, I think the thing to really sell it for m…
Re: Karpathy on Programming: “I've never felt this much behind”
#558Earlier quoted context omitted.
I personally think that everyone knows AI produces subpar code, and that the infallible humans are just passing it along because they don't understand/care. We're starting to see the gaslighting now, it's not that AI makes you better, it's that AI makes you ship faster, and now shipping faster (with more bugs) is more important because "tech debt is an appreciating asset" in the world where AI tools can pump out feat…
Yep, bugs are already just another cost of doing business for companies that aren’t user-focused. We can expect buggier code from now on. Especially for software where the users aren’t the ones buying it. Disclaimer because I sound pessimistic: I do use a lot of AI to write code. I do feel behind on the usage of it.
Re: Karpathy on Programming: “I've never felt this much behind”
#559I think this is mostly a frontend sentiment. In the backend, we're mostly just pushing data around from one place to another. Not much changes, there's only a few ways to really do that. Your data structures change, but ultimately the work is the same. You don't even really need an LLM at all, or super complex frameworks and ORMs, etc.
We don't need you.
Re: Karpathy on Programming: “I've never felt this much behind”
#560Honestly surprised at this take by him. For one, feels like exaggeration. For two, are these tools really that hard to use?
> are these tools really that hard to use? Exactly! If people have 'never felt this far behind' and the LLM's are that good. Ask the LLM to teach you. Like so many articles on 'prompt engineers' this (never felt this behind) take too is laughable. Programmers having learnt how to program (writing algorithms, understanding data structures, reading source code and API docs) are now completely incapable of using a text…