Firing programmers for AI is a mistake
421–430 of 886 posts
Re: Firing programmers for AI is a mistake
#422Earlier quoted context omitted.
I think you're right; I can see it in the accelerating growth curve of my good Junior devs; I see grandOP's vision in my bad Junior devs. Optimistically, I think this gives more jr devs more runway to advance deeper into more sophisticated tech stacks. I think we're gonna need more SW devs, not fewer, as these tools get better: things that were previously impossible will be possible.
> more sophisticated tech stacks Please don't do this, pick more boring tech stacks https://news.ycombinator.com/item?id=43012862 instead. "Sophisticated" tech stacks are a huge waste, so please save the sophisticated stuff for the 0.1% of the time where you actually need it.
Re: Firing programmers for AI is a mistake
#423Earlier quoted context omitted.
In a similar situation at my workplace. What models are you using that you feel comfortable trusting it to understand and operate on 10-20k LOC? Using the latest and greatest from OpenAI, I've seen output become unreliable with as little as ~300 LOC on a pretty simple personal project. It will drop features as new ones are added, make obvious mistakes, refuse to follow instructions no matter how many different ways I…
I usually use Claude 3.5 sonnett since its still the one I've had my best luck with for coding tasks. When it comes to 10k LOC codebases, I still don't really trust it with anything. My best luck has been small personal projects where I can sort of trust it to make larger scale changes, but larger scale at a small level in the first place. I've found it best for generating tests, autocompletion, especially if you giv…
It's when I try to give it a clear, logical specification for a full feature and expect it to write everything that's required to deliver that feature (or the entirety of slightly-more-than-non-trivial personal project) that it falls over.
I've experimented trying to get it to do this (for features or personal projects that require maybe 200-400 LOC) mostly just to see what the limitations of the tool are.
Interestingly, I hit a wall with GPT-4 on a ~300 LOC personal project that o3-mini-high was able to overcome. So, as you'd expect - the models are getting better. Pushing my use case only a little bit further with a few more enhancements, however, o3-mini-high similarly fell over in precisely the same ways as GPT-4, only a bit worse in the volume and severity of errors.
The improvement between GPT-4 and o3-mini-high felt nominally incremental (which I guess is what they're claiming it offers).
Just to say: having seen similar small bumps in capability over the last few years of model releases, I tend to agree with other posters that it feels like we'll need something revolutionary to deliver on a lot of the hype being sold at the moment. I don't think current LLM models / approaches are going to cut it.
Re: Firing programmers for AI is a mistake
#424Earlier quoted context omitted.
What makes you think (1) will be true? It is only generating based on training data. In mature code bases there is a massive amount of interconnected state that is not already present in any github repository. The new logic you'd want to add is likely something never done before. As other programmers have stated, it seems to be improving at generating useful boilerplate and making simple websites and such related to…
> The new logic you'd want to add is likely something never done before. 99% of software development jobs are not as groundbreaking as this. It’s mostly companies doing exactly what their competitors are doing. Very few places are actually doing things that an LLM model has truly never seen crawling through GutHub. Even new innovative products generally boil down to the same database fetches and CRUD glue and JSON pa…
Re: Firing programmers for AI is a mistake
#425Earlier quoted context omitted.
Isn’t this kind of thing the story of tech though? Languages like Python and Java come around, and old-school C engineers grouse that the kids these days don’t really understand how things work, because they’re not managing memory. Modern web-dev comes around and now the old Java hands are annoyed that these new kids are just slamming NPM packages together and polyfills everywhere and no one understands Real Software…
Yea, every progeammer should write at least a cpu emulator in their language of choice, its such a undervalued exercise that will teach you so much about how stuff really works.
Re: Firing programmers for AI is a mistake
#426however, I for one can't wait for unreliable garbage code in:
- engine management systems
- aircraft safety and navigation systems
- trains and railway signalling systems
- elevator control systems
- operating systems
- medical devices (pacemakers, drug dispensing devices, monitoring, radiography control, etc)
- payment systems
- stock exchanges
maybe AI generated code is the Great Filter?Re: Firing programmers for AI is a mistake
#427I would say that AI is not to blame here. It just accelerated existing process, but didn't initiate it. We (as a society) started to value quantity over quality some time ago, and, apparently, no-one care enough to change it. Why tighten the bolts on the airplane's door yourself if you can just outsource it somewhere cheaper (see Boeing crisis)? Why design and test hundreds of physical and easy-to-use knobs in the ca…
Why write a couple of lines of code when you can just include an `is-odd` library? Hopefully one which type checks integers vs floats, and checks for overflows. I'm not stating that I could not write one if/else, I'm asking you to do more than sneer and actually justify why a computer loading a couple of lines of code from a file is the end of the world.
Why invest time and effort into making a good TV if people aren't going to buy it, because they are fine with the competitor's much cheaper Android OS on questionable hardware?
Why run and manage your project on a baremetal server, and deal with its power requirements and cooling and firmware patching and driver version compatibility and out-of-band management and hardware failures and physical security and supply chain lead times and needing to spec it for the right size up front and commit thousands of dollars to it immediately, if you can just rent Amazon DynamoDB and pay $10 to get going right now?
I could fill in the answers you are expecting, I have seen that pattern argued, and argued it myself, but it boils down to "I dislike laggy ad-filled Android TV so it shouldn't exist". And I do dislike it, but so what, I'm not world dictator. No company has taken over the market making a responsive Android-free TV, so how/why should they be made to make one, and with what justification?
> What more could I name?
Why go to a cobbler for custom fitted shoes when you could just buy sneakers from a store? (I assume you wear mass produced shoes?) Why go to a tailor when you could just buy clothes made off-shore for cheaper? (I assume you wear mass produced clothes?) Why learn to play a keyboard, guitar, drums and sing, when you could just listen to someone else's band? (I assume you listen to music?) Why spend months creating characters and scenarios and writing a novel when you could just read one someone else wrote? (I assume you have read books?) Why grow your own food when you could just buy lower quality industrially packaged food from a shop? (I assume you aren't a homesteader?) Why develop your own off-grid power system with the voltage and current and redundancy and storage you need when you could just buy from the mains? (I assume you use mains electricity?)
You could name every effort-saving, money-saving, time-saving, thing you use which was once done by hand with more effort, more cost, and less convenience.
And then state that the exact amount of price/convenience/time/effort you happened to grow up with, is the perfect amount (what a coincidence!) and change is bad.
Re: Firing programmers for AI is a mistake
#428Earlier quoted context omitted.
You mean Karpathy's post discussed on https://twitter.com/karpathy/status/1886192184808149383 ? If so, I quite enjoyed that as a way of considering how LLM-driven exploratory coding has now become feasible. It's not quite there yet, but we're getting closer to a non-technical user being able to create a POC on their own, which would then be a much better point for them in engaging an engineer. And it will only get be…
Technology to allow business people to create POCs has been around for a long time.
Re: Firing programmers for AI is a mistake
#429There's such a huge disconnect between people reading headlines and developers who are actually trying to use AI day to day in good faith. We know what it is good at and what it's not. It's incredibly far away from doing any significant change in a mature codebase. In fact I've become so bearish on the technology trying to use it for this, I'm thinking there's going to have to be some other breakthrough or something…
I think that LLMs are only going to make people with real tech/programming skills much more in demand, as younger programmers skip straight into prompt engineering and never develop themselves technically beyond the bare minimum needed to glue things together. The gap between people with deep, hands-on experience that understand how a computer works and prompt engineers will become so insanely deep. Somebody needs to…
When they do this, I really want to know they did this. Like an organic food label. Right now AI is this buzzword that companies self-label with for marketing, but when that changes, I still want to see who's using AI to handle my data.