Earlier quoted context omitted.
I never got into any of the AI models because it was clear local first was going to be more valueable, if they were to replace coding tasks. I tried out a few models and ended up going with either Qwen3-Coder-Next (no think, just do) and Qwen3.6-35B (thinking, w/llamacpp token budget). Created a customized prompt that works fairly well to around ~60k tokens and then is a toss up on whether it's poisoned itself or I'v…
Cool! Anything you want to share? I haven't looked much into my system prompt yet, do you have any tips?
N>0 for token budget (default: -1) (env: LLAMA_ARG_THINK_BUDGET)
--reasoning-budget-message MESSAGE message injected before the end-of-thinking tag when reasoning budget
Currently, opencode doesn't do this, but the budget-message could be implemented by a harness to put in custom message. So I tailored an agent with a message that has it either compress the context via dynamic compression plugin or request that it uses a subagent to avoid bloating the context.
It's mildly successful, but you can tell as context size grows it becomes more and more narrow sited or wayward.