Wouldn't it be a bit unusual if that wasn't true? We build our coding agent...with our coding agent... feeling like this is table steaks.
How Anthropic teams use Claude Code
81–90 of 248 posts
Re: How Anthropic teams use Claude Code
#82Earlier quoted context omitted.
Thanks for the tip - we employees should run and re-run the code generation hundreds of times even if the changes are pretty good. That way, the brass will see a huge bill without many actual commits. Sorry boss, it looks like we need to hire more software engineers since the AI route still isn't mathing.
> we employees should run and re-run the code generation hundreds of times Well, Anthropic sure thinks that you should. Number go up!
Re: How Anthropic teams use Claude Code
#83I've been trying Claude Code for a few weeks after using Gemini Cli. There's something a little better the tool use loop, which is nice. But Claude seems a little dumber and is aggressive about "getting things done", often ignoring common sense or explicit instructions or design information. If I tell it to make a test pass, it will sometimes change my database structure to avoid having to debug the test. At least tw…
The hilarious part I’ve found is that when it runs into the least bit of trouble with a step on one of its plans, it will say it has been “Deferred” and then make up an excuse for why that’s acceptable. It is sometimes acceptable for humans to use judgment and defer work; the machine doesn’t have judgment so it is not acceptable for it to do so.
Re: How Anthropic teams use Claude Code
#84I use Claude and like it, but this post has kind of a clunky and stilted style So I guess the blog team also uses Claude
Yeah this is kind of a stunning amount of information to provide but also basically like polished bullet points
Re: How Anthropic teams use Claude Code
#85I use Claude and like it, but this post has kind of a clunky and stilted style So I guess the blog team also uses Claude
Re: How Anthropic teams use Claude Code
#86I use Claude and like it, but this post has kind of a clunky and stilted style So I guess the blog team also uses Claude
Re: How Anthropic teams use Claude Code
#87A repeated trend is that Claude Code only gets 70-80% of the way, which is fine and something I wish was emphasized more by people pushing agents. This bullet point is funny: > Treat it like a slot machine > Save your state before letting Claude work, let it run for 30 minutes, then either accept the result or start fresh rather than trying to wrestle with corrections. Starting over often has a higher success rate th…
A bigger issue here is that the random process is not a good engineering pattern. It's not repeatable, does not drive coherent architecture, and struggles with complex problems. In my experience, problem size correlates inversely with generated code quality. Engineering is a process of divide-and-conquer and there is a good reason people don't use bogo (random) sort in production.
More specifically, if you only look at the final code, you are either spending a lot of time reviewing the code or accepting the code with less review scrutiny. Carefully reviewing semi random diffs seems like a poor use of time... so I suspect the default is less review scrutiny and higher tech debt. Interestingly enough, higher tech debt might be an acceptable tradeoff if you believe that soon Code Assistants will be good enough to burn the tech debt down autonomously or with minimal oversight.
On the other hand, if the code you are writing is not allowed to fail, the stakes change and you can't pick the less review option. I never thought to codify it as a process, but here is what I do to guide the development process:
- Start by stating the problem and asking Claude Code to: analyze the existing code, restate the problem in a structured fashion, scan the codebase for existing patterns solving the problem, brainstorm alternative solutions. An enhancement here could be to have a map / list of the codebase to improve the search.
- Evaluate presented solutions and iterate on the list. Add problem details, provide insight, eliminate the solutions that would not work. A lot of times I have enough context to pick a winner here, but if not, I ask for more details about each solution and their relative pros and cons.
- Ask Claude to provide a detailed plan for the down-selected solution. Carefully review the plan (a significantly faster endeavor compared to reviewing the whole diff). Iterate on the plan as needed; after that, tell Claude to save the plan for comparison after the implementation and then to get cracking.
- Review Claude's report of what was implemented vs. what was initially planned. This step is crucial because Claude will try dumb things to get things working, and I've already done the legwork on making sure we're not doing anything dumb in the previous step. Make changes as needed.
- After implementation, I generally do a pass on the unit tests because Claude is extremely prolific with them. You generally need to let it write unit tests to make sure it is on the right track. Here, I ask it to scan all of the unit tests and identify similar or identical code. After that, I ask for refactor options that most importantly maximize clarity, secondly minimize lines of code, and thirdly minimize diffs. Pick the best ones.
Yes, I accept that the above process takes significantly longer for any single change; however, in my experience, it produces far superior results in a bounded amount of time.
P.S. if you got this far please leave some feedback on how I can improve the flow.
Re: How Anthropic teams use Claude Code
#88Re: How Anthropic teams use Claude Code
#89A repeated trend is that Claude Code only gets 70-80% of the way, which is fine and something I wish was emphasized more by people pushing agents. This bullet point is funny: > Treat it like a slot machine > Save your state before letting Claude work, let it run for 30 minutes, then either accept the result or start fresh rather than trying to wrestle with corrections. Starting over often has a higher success rate th…
Recently, I realized that this applies not only to the first 70–80% of a project but sometimes also to the final 70-80%.
I couldn’t make progress with Claude on a major refactoring from scratch, so I started implementing it myself. Once I had shaped the idea clearly enough but in a very early state, I handed it back to Claude to finish and it worked flawlessly, down to the last CHANGELOG entry, without any further input from me.
I saw this as a form of extensive guardrails or prompting-by-example.
Re: How Anthropic teams use Claude Code
#90We passed a milestone with little fanfare. AI is now improving itself.
By a more honest standard we are still a very long way away from AI suggesting new ANN architectures, new approaches to managing RLHF, better training data, new benchmarks, etc etc. LLMs are nowhere close to being able to improve themselves.