Now I'm looking for an extremely simple open-source coding agent. Nanocoder doesn't seem install on my Mac and it brings node-modules bloat, so no. Opencode seems not quite open-source. For now, I'm doing the work of coding agent and using llama_cpp web UI. Chugging it along fine.
I cancelled Claude: Token issues, declining quality, and poor support
21–30 of 604 posts
Re: I cancelled Claude: Token issues, declining quality, and poor support
#22Claude with Sonnet medium effort just used 100% of my session limit, some extra dollars, thought for 53 minutes, and said: API Error: Claude's response exceeded the 32000 output token maximum. To configure this behavior, set the CLAUDE_CODE_MAX_OUTPUT_TOKENS environment variable.
You're using it within their high usage rate window. I hope you're aware of this, if you use it out of the high usage time window it's supposed to use less, but it does seem a little odd that Sonnet uses so much, even on Medium.
Re: I cancelled Claude: Token issues, declining quality, and poor support
#23Re: I cancelled Claude: Token issues, declining quality, and poor support
#24Re: I cancelled Claude: Token issues, declining quality, and poor support
#25This is what worries me. People become dependent on these GenAI products that are proprietary, not transparant, and need a subscription. People build on it like it is a solid foundation. But all of a sudden the owner just pulls the foundation from under your building.
Re: I cancelled Claude: Token issues, declining quality, and poor support
#26Yesterday was a realization point for me. I gave a simple extraction task to Claude code with a local LLM and it "whirred" and "purred" for 10 minutes. Then I submitted the same data and prompt directly to model via llama_cpp chat UI and the model single-shotted it in under a minute. So obviously something wrong with coding agent or the way it is talking to LLM. Now I'm looking for an extremely simple open-source cod…
Re: I cancelled Claude: Token issues, declining quality, and poor support
#27Seems like some of the token issues may be corrected now https://www.anthropic.com/engineering/april-23-postmortem
Dear Anthropic:
Please, for the love of all things holy, NEVER change someone's defaults without INFORMING the end user first, because you will wind up with people confused, upset, and leaving your service.
Re: I cancelled Claude: Token issues, declining quality, and poor support
#28Re: I cancelled Claude: Token issues, declining quality, and poor support
#29Re: I cancelled Claude: Token issues, declining quality, and poor support
#30This is what worries me. People become dependent on these GenAI products that are proprietary, not transparant, and need a subscription. People build on it like it is a solid foundation. But all of a sudden the owner just pulls the foundation from under your building.
Luckily local AI is becoming more feasible every day.