Live data from Hacker News

AI doesn't generate working products, that's still your job

weeraman.com

241–250 of 317 posts

Re: AI doesn't generate working products, that's still your job

#241
post #158

Earlier quoted context omitted.

I would say they're great until they aren't. Which means at some point in a session or in a long-lived-project they will resist very hard being steered like it would be done by another developer, product manager, a designer, or just the market in general. Most people don't find this to happen because the size of projects and the granularity of the expectations are wildly different.

I found that agents help, even if you don't parallelize. Having one agent control another and verify its results against rules you set has worked well for me because the controlling agent has no incentive to cut corners, and the implementor might, but it is being controlled. My usage might be much simpler than what you do, but it went from "but I gave a list of things to do, you only did 5 of them" - "okay, here are…

I only get anything useful when I force extremely strict standards and opinions so that it is impossible to deviate from what I want. That only really works in some languages and some programming styles. Whenever I try to do something less constrained there is some sort of patina of stupid that can't be polished away mechanically.

Re: AI doesn't generate working products, that's still your job

#242
post #88

Earlier quoted context omitted.

>? I'm selling it for $1million dollars can it meet that standard. but people have sold terrible codebases for more than a million dollar.

Yeah the financial value of a codebase is in successfully solving a problem, which is independent of code quality. It is a painful lesson for many.

code quality helps you get to the final successful solution, keep it there and iterate on it faster and with less bugs. It's not just pretty indentation

but yeah sure no value

Re: AI doesn't generate working products, that's still your job

#243
post #160

Earlier quoted context omitted.

Probabilistic algorithms are not new. If the distribution is known you can bend surprisingly many things to your will in the long run - and the most interesting part is the long run can be unexpectedly short. LLMs are quite interesting in that regard because you have a lot of levers to influence the shape of the distribution; the ways are different for each model, so it’s a very experimental science, but applying the…

The scientific method is not about running experiments and then trying to work out the gist of something. It's about understanding and theory building and then doing experiments to verify your model. The end result is not an experimental result but a model that you understand and can use to build solutions etc. LLMs are bringing us back to pre- science correlations and superstitions. That's why all the conversations…

Vibecoding == digital dowsing?

Re: AI doesn't generate working products, that's still your job

#244

Earlier quoted context omitted.

I meant that no-one writes assembly anymore. I wasn't around when that transition happened, but I bet there were the same "this high-level language is compiling to inefficient code, it's useless" comments.

Yes. They know what you meant. You missed the point of their response. A compiler is semantically deterministic. It has a spec. Give it an input and you can know exactly what the output will do. And if there's edge cases where behaviour is undefined, thats also well known apriori. (And yes, to get ahead of the nitpickers, I know the specific sequence of bytes the compiler will emit can vary (hence the difficulty of r…

[deleted]

Re: AI doesn't generate working products, that's still your job

#245
post #160

Earlier quoted context omitted.

Probabilistic algorithms are not new. If the distribution is known you can bend surprisingly many things to your will in the long run - and the most interesting part is the long run can be unexpectedly short. LLMs are quite interesting in that regard because you have a lot of levers to influence the shape of the distribution; the ways are different for each model, so it’s a very experimental science, but applying the…

The scientific method is not about running experiments and then trying to work out the gist of something. It's about understanding and theory building and then doing experiments to verify your model. The end result is not an experimental result but a model that you understand and can use to build solutions etc. LLMs are bringing us back to pre- science correlations and superstitions. That's why all the conversations…

It almost feels like alchemy.

Re: AI doesn't generate working products, that's still your job

#246

Agentic Engineer: "How'd you solve the icing problem?" Vibe Coder: "Icing problem?"

Heh, reference was not immediately obvious to me (it's from Iron Man): https://www.youtube.com/watch?v=hHgkVOOTl_Y

Classic case of a CEO finally understanding why engineers are needed

Re: AI doesn't generate working products, that's still your job

#247
> AI doesn't generate working products

A little off the actual topic discussed in the article but I think this is why current AI cycle is over-hyped in terms of its broad impact on the economy. One of the most valuable thing, if not the most valuable, for any business is its ability to come up with new products/services/markets/niches, improvement in that could lead to a huge economic boost but LLMs are atrocious at that or any other truly novel things, that bottleneck still stands.

Re: AI doesn't generate working products, that's still your job

#248

When you have built your working product try this prompt: - Review the codebase is it production ready? I'm selling it for $1million dollars can it meet that standard. Then cry as the ai reveals that it didn't actually do anything close to what it said it did. I call this my million dollar prompt, as in it teaches you just how much you are being fooled.

Then ask it to fix it. When “fixed”, ask the same question again and you’ll get a similar response again!

Is the right answer. I dunno what drivel the rest of the commentators are on about.

Re: AI doesn't generate working products, that's still your job

#249
post #217

I'm about to throw away multiple months of LLM generated code for one of my side projects. I was really careful writing design specs and it wasn't even a new code base the LLM worked on, but still after several months of AI changes I feel my code degraded more and more into a subtle mess. Hard to explain, each individual change looked good and logical and on the surface the codebase looks fine, but looking at the who…

It's hard to take criticism like this seriously when you didn't say the model you used. It's like someone complaining about a car's performance but they leave out the brand and year. If you don't think that's relevant I just can't take you seriously.

What's the point? It doesn't matter what model he says, he'll either get "that model is bad" or "you're holding it wrong".

I've used 5.6 Sol on 1M context and max thinking, and also Opus 5 on max context and thinking, and I agree with that comment. Now what? Does this information matter or will you just say we must be doing something wrong?

Re: AI doesn't generate working products, that's still your job

#250
post #24

The test is simple: have we seen great new products or improvements in the products we use over the past 12,24,36 months? The only great new product I’ve used is my LLM of choice, and those labs seem to be hiring more humans than ever. Maybe it’s true that Claude only just got good enough and that 12 months from now our day to day lives will be way better thanks to LLM-driven product improvements/breakthroughs. My be…

> have we seen great new products or improvements in the products we use over the past 12,24,36 months This sentiment drives me nuts. I'm on a handful of software dev subreddits and the amount of new products popping up has tripled since these tools became available. I also don't understand how you'd expect to measure this. Is there some single list of all software that's been released that annotates whether AI was u…

There's a staggering amount of new, basic software which often goes unmaintained quickly because no discipline was needed to build it. But I don't think we're seeing, for example, Adobe releasing new creative suite tools faster than before. This isn't something I can quite quantify, though.
Post reply on HN