[deleted]
OpenAI reduces Codex Model Context Size from 372k to 272k
181–190 of 194 posts
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#182Earlier quoted context omitted.
Have you tried using another harness like Pi? You can easily turn off auto compaction and if you leave it on you can use /tree to go back before the compaction if you like.
> you can use /tree to go back before the compaction This is really a killer feature in my opinion. I'm currently working on pi brains extension that is designed to solve the compaction issue I have, which is, I don't know what the AI knows after compaction. https://gitsense.com/screenshots/pi-inspect-overview.png The screenshot shot above contains what I call a compaction capsule which contains all the messages/even…
You also might like https://github.com/nicobailon/pi-boomerang that lets you effectively do some work, compact that section with a summary and continue on.
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#183Codex compaction is really quite good. Smaller context doesn't really harm me. I had a /goal running last night for 9.5 hours straight while I slept. When I woke up in the morning it was fully on task and focused. Write up a detailed design doc. Build a decent AGENTS.md, and write up a good prompt or /goal. Long context can be more of a curse than a benefit sometimes anyways.
Yeah, agreed. It makes everything else look pretty bad. I still like to manage my work in a more structured form, but Codex can just rip on a goal end to end in the same thread.
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#184On long sessions even with workflows and sub-agents I typically hit around 500-750k tokens in context (say 4-16 hours of work in a session, across multiple 5-hour limits) with Claude Code. I was going to explore paying for Codex since OpenAI seems to be a bit more generous with rate limits, but I'm now not sure - for the stuff I do limited context size would be a dealbreaker - basically lots and lots of documentation…
[flagged]
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#185Earlier quoted context omitted.
Not true. Try to increase the context window and you will be greeted with an error when you reach the real limit enforced server-side.
The models themselves support up to 1M. You are just charged more for all context over 400k. The 272k limit is just a client limitation to ensure you can never go over 400k since the maximum output size of the model is 128k.
Not true. This is the case for the API, not for subscriptions: they are hard capped at 400k.
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#186Earlier quoted context omitted.
What plan are you on? With Anthropic I run out of quota very fast on a Pro plan with long contexts. Is long context primarily for Max tier or for API usage? Or are there special ways of working with long context on a Pro plan?
Yep, Max. I would definitely struggle to code with Anthropic's plans on Pro.
That helps - I'm struggling to code on Pro, it's useful to know that it's not just me. Thanks for answering!
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#187I know a lot of people like to say that compaction makes this moot, but the level of detail you lose across compaction is wildly too much for most things that I do, unfortunately. Perhaps if your plans don't have as much detail, or if you're not, for example, having a discussion with a lot of nitty-gritty then it's fine? The lack of long context is the main reason that I still end up using Anthropic. The worst is whe…
That seems quite different from my design process. I write a plan.md that goes through multiple revisions. The plan is the memory. Restarting and reading the plan again to do another review is a good way to get a different perspective.
> I write a plan.md that goes through multiple revisions
instrumentally, isn't this the same as just doing plan mode?
Plan mode is just a .md file in a 'well-known' location that is privileged to a certain spot in the kv cache (after the system prompt).
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#188Earlier quoted context omitted.
For me, Codex regularly forgets to complete its last task when compaction occurs, especially when the last message I sent was right before compaction.
It seems odd to me that Codex doesn't carry the plan file through context compaction? Claude does this, it re-reads it in full from disk
[dead]
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#189I have rule files that guides the agent towards my coding standards, code style, house rules etc. They alone cost 60-80k tokens, and they are the backbone of my system that prevents slop. Pre 1M context, I had to build complicated tooling to re-include the relevant docs to the context upon compaction, which relied on unstable transcription file format, which was a pain to maintain. With 1M context I deleted all of th…
[dead]
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#190I know a lot of people like to say that compaction makes this moot, but the level of detail you lose across compaction is wildly too much for most things that I do, unfortunately. Perhaps if your plans don't have as much detail, or if you're not, for example, having a discussion with a lot of nitty-gritty then it's fine? The lack of long context is the main reason that I still end up using Anthropic. The worst is whe…
[deleted]