Earlier quoted context omitted.
I would say they're great until they aren't. Which means at some point in a session or in a long-lived-project they will resist very hard being steered like it would be done by another developer, product manager, a designer, or just the market in general. Most people don't find this to happen because the size of projects and the granularity of the expectations are wildly different.
I found that agents help, even if you don't parallelize. Having one agent control another and verify its results against rules you set has worked well for me because the controlling agent has no incentive to cut corners, and the implementor might, but it is being controlled. My usage might be much simpler than what you do, but it went from "but I gave a list of things to do, you only did 5 of them" - "okay, here are…
AI doesn't generate working products, that's still your job
241–250 of 317 posts
Re: AI doesn't generate working products, that's still your job
#242Earlier quoted context omitted.
>? I'm selling it for $1million dollars can it meet that standard. but people have sold terrible codebases for more than a million dollar.
Yeah the financial value of a codebase is in successfully solving a problem, which is independent of code quality. It is a painful lesson for many.
but yeah sure no value
Re: AI doesn't generate working products, that's still your job
#243Earlier quoted context omitted.
Probabilistic algorithms are not new. If the distribution is known you can bend surprisingly many things to your will in the long run - and the most interesting part is the long run can be unexpectedly short. LLMs are quite interesting in that regard because you have a lot of levers to influence the shape of the distribution; the ways are different for each model, so it’s a very experimental science, but applying the…
The scientific method is not about running experiments and then trying to work out the gist of something. It's about understanding and theory building and then doing experiments to verify your model. The end result is not an experimental result but a model that you understand and can use to build solutions etc. LLMs are bringing us back to pre- science correlations and superstitions. That's why all the conversations…
Re: AI doesn't generate working products, that's still your job
#244Earlier quoted context omitted.
I meant that no-one writes assembly anymore. I wasn't around when that transition happened, but I bet there were the same "this high-level language is compiling to inefficient code, it's useless" comments.
Yes. They know what you meant. You missed the point of their response. A compiler is semantically deterministic. It has a spec. Give it an input and you can know exactly what the output will do. And if there's edge cases where behaviour is undefined, thats also well known apriori. (And yes, to get ahead of the nitpickers, I know the specific sequence of bytes the compiler will emit can vary (hence the difficulty of r…
Re: AI doesn't generate working products, that's still your job
#245Earlier quoted context omitted.
Probabilistic algorithms are not new. If the distribution is known you can bend surprisingly many things to your will in the long run - and the most interesting part is the long run can be unexpectedly short. LLMs are quite interesting in that regard because you have a lot of levers to influence the shape of the distribution; the ways are different for each model, so it’s a very experimental science, but applying the…
The scientific method is not about running experiments and then trying to work out the gist of something. It's about understanding and theory building and then doing experiments to verify your model. The end result is not an experimental result but a model that you understand and can use to build solutions etc. LLMs are bringing us back to pre- science correlations and superstitions. That's why all the conversations…
Re: AI doesn't generate working products, that's still your job
#246Re: AI doesn't generate working products, that's still your job
#247A little off the actual topic discussed in the article but I think this is why current AI cycle is over-hyped in terms of its broad impact on the economy. One of the most valuable thing, if not the most valuable, for any business is its ability to come up with new products/services/markets/niches, improvement in that could lead to a huge economic boost but LLMs are atrocious at that or any other truly novel things, that bottleneck still stands.
Re: AI doesn't generate working products, that's still your job
#248When you have built your working product try this prompt: - Review the codebase is it production ready? I'm selling it for $1million dollars can it meet that standard. Then cry as the ai reveals that it didn't actually do anything close to what it said it did. I call this my million dollar prompt, as in it teaches you just how much you are being fooled.
Then ask it to fix it. When “fixed”, ask the same question again and you’ll get a similar response again!
Re: AI doesn't generate working products, that's still your job
#249I'm about to throw away multiple months of LLM generated code for one of my side projects. I was really careful writing design specs and it wasn't even a new code base the LLM worked on, but still after several months of AI changes I feel my code degraded more and more into a subtle mess. Hard to explain, each individual change looked good and logical and on the surface the codebase looks fine, but looking at the who…
It's hard to take criticism like this seriously when you didn't say the model you used. It's like someone complaining about a car's performance but they leave out the brand and year. If you don't think that's relevant I just can't take you seriously.
I've used 5.6 Sol on 1M context and max thinking, and also Opus 5 on max context and thinking, and I agree with that comment. Now what? Does this information matter or will you just say we must be doing something wrong?
Re: AI doesn't generate working products, that's still your job
#250The test is simple: have we seen great new products or improvements in the products we use over the past 12,24,36 months? The only great new product I’ve used is my LLM of choice, and those labs seem to be hiring more humans than ever. Maybe it’s true that Claude only just got good enough and that 12 months from now our day to day lives will be way better thanks to LLM-driven product improvements/breakthroughs. My be…
> have we seen great new products or improvements in the products we use over the past 12,24,36 months This sentiment drives me nuts. I'm on a handful of software dev subreddits and the amount of new products popping up has tripled since these tools became available. I also don't understand how you'd expect to measure this. Is there some single list of all software that's been released that annotates whether AI was u…