documents like https://github.com/obra/superpowers/blob/main/skills/testing... are very confusing to read as a human. "skills" in this project generally don't seem to follow set format and just look like what you would get when prompting an LLM to "write a markdown doc that step by step describes how to do X" (which is what actually happened according to the blog post). idk, but if you already assume that the LLM kno…
Superpowers: How I'm using coding agents in October 2025
211–220 of 242 posts
Re: Superpowers: How I'm using coding agents in October 2025
#212Earlier quoted context omitted.
My impression is we're still in the tinkering phase. The metrics are coming.
What metrics? We could never objectively measure productivity except in the macro economic sense, so what makes you think we'll be able to now?
Re: Superpowers: How I'm using coding agents in October 2025
#213Earlier quoted context omitted.
Curious what you think of sub agents, don't they still consume a massive amount of tokens compared to simply running in main context? I'm skeptical of any process that starts massively delegating to sub agents. I'm on Pro and don't think its worth upgrading to 200 a month just to not pollute main context.
In my opinion, subagents (or more generally, "agents as tools" as a pattern) are an order-of-magnitude level feature. Soon every CLI agent will have them as a first-class feature (you can get them via custom scripting right now with and CLI agent, albeit less ergonomically). The ability to isolate context-noisy subtasks (like agentically searching through a large codebase by grepping through dozens of irrelevant file…
Re: Superpowers: How I'm using coding agents in October 2025
#214Earlier quoted context omitted.
I think the asking clarifying questions thing is solved already. Tell a coding agent to "ask clarifying questions" and watch what it does!
Obviously if you instruct the autocomplete engine to fill in questions it will. That's not the point. The LLM has no model of the problem it is trying to solve, nor does it attempt to understand the problem better. It is merely regurgitating. This can be extremely useful. But it is very limiting when it comes to using as an agent to write code.
Re: Superpowers: How I'm using coding agents in October 2025
#215I can't recommend this post strongly enough. The way Jesse is using these tools is wildly more ambitious than most other people. Spend some time digging around in his https://github.com/obra/Superpowers repo. I wrote some notes on this last night: https://simonwillison.net/2025/Oct/10/superpowers/
Curious what you think of sub agents, don't they still consume a massive amount of tokens compared to simply running in main context? I'm skeptical of any process that starts massively delegating to sub agents. I'm on Pro and don't think its worth upgrading to 200 a month just to not pollute main context.
Using them in a way that doesn't waste tokens is something I haven't fully figured out out yet!
Re: Superpowers: How I'm using coding agents in October 2025
#216``` Claude Code v2.0.13 Sonnet 4.5 (with 1M token context) Claude Max /Users/jesse/tmp/new-tool/.worktrees/todo-cli ```
How does this person have access to Sonnet 4.5 with 1m token context? I don't see this referenced anywhere when I search or when I ask Claude about it.
Re: Superpowers: How I'm using coding agents in October 2025
#217Earlier quoted context omitted.
The UK government ran a study with thousands of developers quite recently: https://www.gov.uk/government/publications/ai-coding-assista...
I don't necessarily think the conclusions are wrong, but this relies entirely on self-reported survey results to measure productivity gains. That's too easy to poke holes in, and I think studies like this are unlikely to convince real skeptics in the near term.
Re: Superpowers: How I'm using coding agents in October 2025
#218Earlier quoted context omitted.
I don't necessarily think the conclusions are wrong, but this relies entirely on self-reported survey results to measure productivity gains. That's too easy to poke holes in, and I think studies like this are unlikely to convince real skeptics in the near term.
At this point it's becoming clear from threads similar to this one that quite a lot of the skeptics are actively working not to be convinced by anything.
I agree. I think there are too many resources, examples, and live streams out there for someone to credibly claim at this point that these tools have no value and are all hype. I think the nuance is in how and where you apply it, what your expectations and tolerances are, and what your working style is. They are bad at many things, but there is tremendous value to be discovered. The loudest people on both sides of this debate are typically wrong in similar ways imo.
Re: Superpowers: How I'm using coding agents in October 2025
#219I'm so curious around what people's median experience is of AI coding tools. I've tried agents every now and then, recently for something very simple- add an option to request csb format in a data api. The results were, well, not good. . . I ended up undoing literally all changes because writing from scratch was a lot easier than trying to refactor the total mess it has made from what I'd have thought was a trivial f…
But only on micro tasks, coming with explicit instructions, inside a very well documented architecture.
Give AI freedom of expression and they will never find first principals in their training data. You will receive code that is not performant and when analyzing the output, AI will try to convince you that it is. If the task goes beyond your domain, you may believe the wrong principals are ok.
Re: Superpowers: How I'm using coding agents in October 2025
#220Earlier quoted context omitted.
Also the persuasion paper he links isn't at all about what he's talking about. That paper is about using persuasion prompts to overcome trained in "safety" refusals, not to improve prompt conformance.
Co-Author of the paper here. We don't know exactly why modern llms don't want to call you a jerk, or for that matter why persuasive techniques convince them otherwise. it's not a hard line like many of the guardrails. That said, I talked to Jesse about this, and I strongly suspect the same techniques will work for prompt conformance when the topic is something other than name calling.