Superpowers: How I'm using coding agents in October 2025

Post by oblio » Sat, Oct 11, 2025, 4:56 PM UTC

potatolicious wrote: post #54

mwigdahl wrote: post #22

Earlier quoted context omitted.

The problem is that you're talking about a multistep process where each step beyond the first depends on the particular path the agent starts down, along with human input that's going to vary at each step. I made a crude first stab at an approach that at least uses similar steps and structure to compare the effectiveness of AI agents. My approach was used on a small toy problem, but one that was complex enough the ag…

What you're getting at is the heart of the problem with the LLM hype train though, isn't it? "We should have rigorous evaluations of whether or not [thing] works." seems like an incredibly obvious thought. But in the realm of LLM-enabled use cases they're also expensive . You'd need to recruit dozens, perhaps even hundreds of developers to do this, with extensive observation and rating of the results. So rather than…

Post by 3eb7988a1663 » Sat, Oct 11, 2025, 4:57 PM UTC

  @/Users/jesse/.claude/plugins/cache/Superpowers/...

Post by dexwiz » Sat, Oct 11, 2025, 4:58 PM UTC

causal wrote: post #58

Avicebron wrote: post #7

I often feel these types of blogposts would be more helpful if they demonstrated someone using the tools to build something non-trivial. Is Claude really "learning new skills" when you feed it a book, or does it present it like that because you're prompting encourages that sort of response-behavior. I feel like it has to demo Claude with the new skills and Claude without. Maybe I'm a curmudgeon but most of these type…

Using LLMs for coding complex projects at scale over a long time is really challenging! This is partly because defining requirements alone is much more challenging than most people want to believe. LLMs accelerate any move in the wrong direction.

Post by sreekanth850 » Sat, Oct 11, 2025, 5:01 PM UTC

causal wrote: post #58

Avicebron wrote: post #7

I often feel these types of blogposts would be more helpful if they demonstrated someone using the tools to build something non-trivial. Is Claude really "learning new skills" when you feed it a book, or does it present it like that because you're prompting encourages that sort of response-behavior. I feel like it has to demo Claude with the new skills and Claude without. Maybe I'm a curmudgeon but most of these type…

Using LLMs for coding complex projects at scale over a long time is really challenging! This is partly because defining requirements alone is much more challenging than most people want to believe. LLMs accelerate any move in the wrong direction.

Post by antonvs » Sat, Oct 11, 2025, 5:15 PM UTC

nightski wrote: post #57

simonw wrote: post #31

Earlier quoted context omitted.

Here's one from today: https://mitchellh.com/writing/non-trivial-vibing

Even though the author refers to it as "non-trivial", and I can see why that conclusion is made, I would argue it is in fact trivial. There's very little domain specific knowledge needed, this is purely a technical exercise integrating with existing libraries for which there is ample documentation online. In addition, it is a relatively isolated feature in the app. On top of that, it doesn't sound enjoyable. Anti slo…