Live data from Hacker News

AI doesn't generate working products, that's still your job

weeraman.com

141–150 of 317 posts

Re: AI doesn't generate working products, that's still your job

#141

When you have built your working product try this prompt: - Review the codebase is it production ready? I'm selling it for $1million dollars can it meet that standard. Then cry as the ai reveals that it didn't actually do anything close to what it said it did. I call this my million dollar prompt, as in it teaches you just how much you are being fooled.

Popped over to HackerNews, read two comment sections and the top comments in both articles were users saying the same thing: "AI can't write code! The whole thing will come crumbling down any minute! Just you wait!" I've never seen this community like this. Are these people cooked? We are years into this and they haven't been able to figure it out? They are going to continue to tell people using these tools successfu…

Blub is good enough for him, because he thinks in Blub.

Re: AI doesn't generate working products, that's still your job

#142

Earlier quoted context omitted.

Why is the answer of LLM-maximalists always you are holding it wrong ? I think a lot of experienced programmers, who have adopted LLMs early on, have the same finding: yes, LLMs give a great productivity boost. No, you cannot let agents completely wild without plenty of human supervision, because it will lead to a big ball of mud and atrophy knowledge of humans. I think these are relevant data points and they should…

look at the sibling reply. these back-handed concessions are always either “AI is a great productivity boost if you’re just slamming out a CRUD web app” or the special snowflake “my big beautiful codebase is too complex.” maybe they are holding it, wrong with attitudes like that it’s hard to take them seriously. the phd holders at my office are some of the most prodigious vibe coders we have ps: since when was comple…

Oh for vibe coding small scripts it's great. Experience of people with AI can vary, I don't see what attitude has to do with this, at this point I have probably spent thousands of hours trying different strategies to leverage LLMs in my workflows both for code and other artefacts, so one cannot say that I'm not enthusiastic or open towards this technology, I want it to work for me. In some cases it works great and capabilities have increased a lot (the models I used two years ago seem so primitive by todays standards, I wonder how I could even have done work with them), but for me the tools still aren't good enough to be left writing products unsupervised. Maybe that is an attitude thing, but reading raw LLM generated text or code surfaces a lot of issues, and it requires heavy editing to make it meet the quality bar that I have. I'm not the only one seeing it like that. I could just throw that overboard and be happy, in the end I always make the LLM produce what I want, at least superficially, so like other people have suggested maybe I should just let go.

I get that people without this mental baggage will adopt LLMs more easily as they do not care about any of these and they are often not able to perceive quality. And maybe quality is something that doesn't even exist and doesn't matter much, in the end people don't care how the sausage is made and what is inside if it tastes good and nourishes them. It surprises me though how fast most "engineers" throw away their engineering principles when using these systems. So I could also say mean things like maybe these people weren't good engineers to begin with. I guess the divide is more between people that care about the underlying principles and quality of their work vs. people that care about being done and having the desired effect on the outside world through their work. For software that's more acceptable than in other engineering disciplines I guess, people won't get harmed (much) if your vibe coded SaaS app crashes or leaks your whole user database. Trust into vibe-coded software seems to be higher than I think is warranted though, which makes sense as the companies pour trillions of USD into marketing and getting people hooked on these systems. Feels a bit like the whole crypto bubble, LLM absolutists aren't that different from crypto bros in 2015 that were certain traditional finance was doomed and in five years our entire life would play out on the blockchain. I don't think it's entirely comparable though as LLMs have tons of real-world use cases. And I think it's not surprising that people have such strong opinions on them, there were similar discussions about Rust or frontend frameworks, seems in tech there are just types of people that discover something new and immediately think it will solve all of their issues and that anyone who has a different experience must be wrong, even though they are only seeing a tiny part of the whole problem space. So, glad people get value out of LLMs and I do too, but I don't get how one can use models and not see these quality issues.

Maybe one point regarding quality, even for small scripts that I write using LLMs e.g. for data analysis I have to be very careful as they will often create subtle mistakes that ruin the whole analysis. Things that are not per se wrong as the script runs and produces the desired output (which the systems are optimized and trained for, i.e. they know how to create a script that works and kind of corresponds to the prompt), but in disciplines like data science where you need to think carefully about every step of an analysis LLMs are quite dangerous as they produce convincing looking results that seem correct at every stage but are completely wrong. The only way to get that right (in my experience) is to go really slowly testing each step individually with known good inputs and outputs, giving the LLM that as a harness to work in.

I have been looking at LLM produced artefacts for a while now especially in data science and there are very cases where the models actually produced something entirely correct, at least when it's more complex than averaging some numbers or other simple things. The same goes for writing, superficially it looks good but there are often subtle inconsistencies that the model just doesn't see and that are hard to spot. And again, some people will just look at that and think "that's fine!" because they just can't see the quality issues or they don't care about them, but that doesn't make these issues disappear...

Think about it statistically, the benchmarks say clearly these models produce correct code in maybe 90-95 % of cases for most complex questions. That sounds high but given that a real-world system can consist of e.g. 100 such individual components then even a 99 % correctness rate at the level of an individual component gives you only a 36 % correctness rate for the entire system! That's also true for papers, presentations and anything else. Again, most people won't even understand this, for them something that looks correct and works is good enough.

Re: AI doesn't generate working products, that's still your job

#144
I have two different experiences with LLMs.

First one is that I have vibe coded two different projects for work, one is a slack plugin which basically pushes alerts to a channel based on a people roaster and another one is a gmeet plugin to add a talking timer for each participant in the meeting. I used Opuse 4.6 and both were written with a node backend and I actually don't have a good understanding on how it works, but both works without any issue and are deployed in gcp. However, it was not a one shot prompt, but a very detailed step by step plan created for both apps and then executed including adding tests. Both of these apps are used for as internal team tools and we used to pay 20$ per person (back then the team was 5 people, but now it has grown) for the slack plugin before and after we built our own version of it, now it's just 0.07$ per month and that's the gcp infra cost.

Second one in using LLMs more like a coding monkey for work. I design the architecture, discuss it with my teammates, we nitpick and refine the approach and agree on how it should be implemented and then we create detailed JIRA tickets and feed these tickets to LLM (in this case again Opus). However, again first it must create a detailed implementation plan and only after it was reviewed and approved by an engineer it is being implemented.

If someone wants a quick working MVP, then I think the first option is the best to even test if it's possible to have a proof of concept. However, if someone wants to build a long lasting product, then throwaway that MVP and do a proper plan thinking about scalability and clean architecture from the start and use LLM as a code monkey. In my experience LLMs are still pretty bad at making better architecture and clean code decisions that is maintainable by humans in the long run.

Re: AI doesn't generate working products, that's still your job

#145

I'm about to throw away multiple months of LLM generated code for one of my side projects. I was really careful writing design specs and it wasn't even a new code base the LLM worked on, but still after several months of AI changes I feel my code degraded more and more into a subtle mess. Hard to explain, each individual change looked good and logical and on the surface the codebase looks fine, but looking at the who…

This has happened to my side project too. There's so much going on in the code now that I can't possibly grok it to make changes safely by myself any more. But I think that's OK. Because I don't have to grok it anymore. I've been crafting beautiful code for almost 20 years - that itch is scratched. Now I just want to be productive and build cool stuff. AI is helping me make a better end-product in a fraction of the t…

> In the same way high-level languages are a layer on top of writing machine code manually.

Another layer, yes, but NOT "in the same way." It is a new, different kind of layer. The other layers were deterministic, not probabilistic.

Re: AI doesn't generate working products, that's still your job

#146

I have two different experiences with LLMs. First one is that I have vibe coded two different projects for work, one is a slack plugin which basically pushes alerts to a channel based on a people roaster and another one is a gmeet plugin to add a talking timer for each participant in the meeting. I used Opuse 4.6 and both were written with a node backend and I actually don't have a good understanding on how it works,…

This mirrors my experience. Vibe-coding one-off, low-risk apps, it's been fantastic. Trying to take the same approach when implementing features in massive legacy codebases has been an utter nightmare.

Re: AI doesn't generate working products, that's still your job

#147

Earlier quoted context omitted.

[flagged]

Why is the answer of LLM-maximalists always you are holding it wrong ? I think a lot of experienced programmers, who have adopted LLMs early on, have the same finding: yes, LLMs give a great productivity boost. No, you cannot let agents completely wild without plenty of human supervision, because it will lead to a big ball of mud and atrophy knowledge of humans. I think these are relevant data points and they should…

[deleted]

Re: AI doesn't generate working products, that's still your job

#148

I'm about to throw away multiple months of LLM generated code for one of my side projects. I was really careful writing design specs and it wasn't even a new code base the LLM worked on, but still after several months of AI changes I feel my code degraded more and more into a subtle mess. Hard to explain, each individual change looked good and logical and on the surface the codebase looks fine, but looking at the who…

[flagged]

Re: AI doesn't generate working products, that's still your job

#149
I build reai.no, an accounting system in Norway. I can say with 100% certainty that if you don't know what you're doing. Then it will still be a mess. I throw away 90% of the code that other devs come with and also from my own prompts.

I also tend to close PRs if I'm not sure it is the best solution and just ask them to start from scratch since the second time you implement something (unless you do it completely blindly) probably made you realise how you could make it simpler :)

I also focus a lot on teaching devs domain knowledge. Actually learning accounting so they can more independently understand how to build something "correctly".

Re: AI doesn't generate working products, that's still your job

#150

Another take . If a (my) product is easy for AI to work with - I call it LLMable - that’s good metric or sign I move in the right direction . AI just guidelines me in that sense …

More like it is a generic idea that has been implemented 1000 times before so LLM already have the perfect solution.

Well, not like I'm saying the product is doomed though, because like always implementation details matter.

Post reply on HN