Should the best agents be bottlenecked by the least verifable part of the workflow?
How much can you delegate to agents?
21–24 of 24 posts
Re: How much can you delegate to agents?
#22This post is full of things opposite of what I've found. An agent (claude code at least) will certainly refactor feature flags better than I ever could and is less likely to miss special cases. What the agent struggles with is business knowledge - context I hold in my head as a human communicating with other humans and working on a codebase over a long period of time.
One of the main problems I face is that business knowledge is not explicitly written down and formulated. No matter how much you describe something in human text format those are not formal rules about how something should work. If you can't inspect the output of the LLM you do not have full understanding of the business.
Most "classic" computer systems (code that runs on a CPU) are not strictly formal[1], but they are orders of magnitude more formal than human language.
[1] things like distributed systems, memory corruption, performance characteristics, etc can make a system behavior not predictable
Re: How much can you delegate to agents?
#23I find agents are definitely useful as a blind audit/adversarial attack on a set of changes. A more comprehensive prompt, but in essence "go come up with a set of changes you'd make to achieve -set of requirements and then compare to what has actually been done and report back". I have CC so am more liberal with this towards the end my week when I have spare tokens!
Edit: I have no clue if they earn their tokens, but as I get them 'free' on the sub I haven't needed to evaluate.
Re: How much can you delegate to agents?
#24I have never once delegated anything to an agent and my life is still going on. Funny how that goes.