Earlier quoted context omitted.
copilot (and others) try to be too smart and do context reduction (to save their own wallets). I want ENTIRETY of the files I attached to context, not RAG-ed version of it.
I believe this is the root of the problem for all agentic coding solutions. They are gimping the full context through fancy function calling and tool use to reduce the full context that is being sent through the API. Problem with this is you can never know what context is actually needed for the problem to be solved in the best way. The funny thing is, this type of behavior actually leads many people to believe these…
OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
171–180 of 298 posts
Re: OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
#172Earlier quoted context omitted.
copilot (and others) try to be too smart and do context reduction (to save their own wallets). I want ENTIRETY of the files I attached to context, not RAG-ed version of it.
Regarding context reduction. This got me wondering. If I use my own API key, there is no way for the IDE or coplilot provider to benefit other than monthly sub. But if I am using their provided model with tokens from the monthly subscription, they are incentivized to charge me based on tokens I submit to them, but then optimize that and pass on a smaller request to the LLM and get more margin. Is that what you are re…
Re: OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
#173Earlier quoted context omitted.
Why not just select Gemini Pro 2.5 in Copilot with Edit mode? Virtually unlimited use without extra fees. Copilot used to be useless, but over the last few months has become quite excellent once edit mode was added.
copilot (and others) try to be too smart and do context reduction (to save their own wallets). I want ENTIRETY of the files I attached to context, not RAG-ed version of it.
Claude Projects, chatgpt projects, Sourcegraph Cody context building, MCP file systems, all of these are black boxes of what I can only describe as lossy compression of context.
Each is incentivized to deliver ~”pretty good” results at the highest token compression possible.
The best way around this I’ve found is to just own the web clients by including structured, concatenation related files directly in chat contexts.
Self plug but super relevant: I built FileKitty specifically to aid this, which made HN front page and I’ve continued to improve:
https://news.ycombinator.com/item?id=40226976
If you can prepare your file system context yourself using any workflow quickly, and pair it with appropriate additional context such as run output, problem description etc, you can get excellent results and you can pound away at OpenAI or Anthropic subscription refining the prompt or updating the file context.
I have been finding myself spending more time putting together prompt complexity for big difficult problems, they would not make sense to solve in the IDE.
Re: OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
#174Earlier quoted context omitted.
copilot (and others) try to be too smart and do context reduction (to save their own wallets). I want ENTIRETY of the files I attached to context, not RAG-ed version of it.
This problem is real. Claude Projects, chatgpt projects, Sourcegraph Cody context building, MCP file systems, all of these are black boxes of what I can only describe as lossy compression of context. Each is incentivized to deliver ~”pretty good” results at the highest token compression possible. The best way around this I’ve found is to just own the web clients by including structured, concatenation related files di…
Re: OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
#175Fingers crossed for this to work well! Claude Code is pretty excellent. I’m actually legitimately surprised how good it is, since other coding agents I’ve used before have mostly been a letdown, which made me only use Claude in direct change prompting with Zed (“implement xyz here”, “rewrite this function with abc”, etc), so very hands-on. So I’ve went into trying out Claude Code rather pessimistically, and now I’m u…
Claude Code has a closed license https://github.com/anthropics/claude-code/blob/main/LICENSE.... There is fork named Anon Kode https://github.com/dnakov/anon-kode which can use more models and non-Anthropic ones. But the license is unclear for it. It's interesting to see codex to be Apache License. Maybe somebody extends it to be usable with competing models.
Now whether or not anthropic care enough to enforce their license is separate issue, but it seems unwise to make much of an investment in it.
Re: OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
#176Fingers crossed for this to work well! Claude Code is pretty excellent. I’m actually legitimately surprised how good it is, since other coding agents I’ve used before have mostly been a letdown, which made me only use Claude in direct change prompting with Zed (“implement xyz here”, “rewrite this function with abc”, etc), so very hands-on. So I’ve went into trying out Claude Code rather pessimistically, and now I’m u…
Re: OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
#177Earlier quoted context omitted.
copilot (and others) try to be too smart and do context reduction (to save their own wallets). I want ENTIRETY of the files I attached to context, not RAG-ed version of it.
I believe this is the root of the problem for all agentic coding solutions. They are gimping the full context through fancy function calling and tool use to reduce the full context that is being sent through the API. Problem with this is you can never know what context is actually needed for the problem to be solved in the best way. The funny thing is, this type of behavior actually leads many people to believe these…
Re: OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
#178Re: OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
#179Earlier quoted context omitted.
I think it depends a lot on how you value your time. I'm personally willing to spend hundreds or thousands per month happily if it saves me enough hours. I'd estimate that if I were to do consulting, I'd likely be charging in the $150-250 per hour range, so by my math, it's pretty easy to justify any tools that save me even a few hours per month.
Or, increasingly, how the company values your time. If Claude Code can make a $100K/year dev 10% more productive, it's worth it to the employer to pay anything under $1600/month for it (assuming fully loaded cost of the employee to the business is twice salary).
Re: OpenAI Codex CLI: Lightweight coding agent that runs in your terminal
#180Earlier quoted context omitted.
I believe this is the root of the problem for all agentic coding solutions. They are gimping the full context through fancy function calling and tool use to reduce the full context that is being sent through the API. Problem with this is you can never know what context is actually needed for the problem to be solved in the best way. The funny thing is, this type of behavior actually leads many people to believe these…
This stuff is so easy to do with Cursor. Just pass in the approximate surface area of the context and it doesn't RAG anything if your context isn't too large.