Live data from Hacker News

OpenAI reduces Codex Model Context Size from 372k to 272k

github.com

11–20 of 194 posts

Re: OpenAI reduces Codex Model Context Size from 372k to 272k

#11

I never felt that context size was any issue at all in codex. I don't know how their compaction works, but it just keeps on going as if it has no context limit at all. At least in my experience.

For me, Codex regularly forgets to complete its last task when compaction occurs, especially when the last message I sent was right before compaction.

Re: OpenAI reduces Codex Model Context Size from 372k to 272k

#12
Another interesting change in that commit is the addition of this section to the system prompt:

  Before taking a destructive action:
  
  - Make sure the action is clearly within
    the user's request.
  - Resolve the exact targets with
    read-only checks when necessary.
  - Do not use `$HOME`, `~`, `/`, a
    workspace root, or another broad
    directory as the target of a
    recursive or destructive command
Looks like the fix for this bug where Codex would occasionally accidentally delete your entire home directory: https://twitter.com/thsottiaux/status/2077630111499882637

Re: OpenAI reduces Codex Model Context Size from 372k to 272k

#13
No matter how good compaction is, on some big projects it needs to read a lot of files. In my experience the first 200.000 tokens go FAST, but after that it slows down. Most of my Fable sessions don't go over 500.000 tokens, I don't need to compact once. But when I use Codex a single session has to compact over and over again.

Re: OpenAI reduces Codex Model Context Size from 372k to 272k

#15
Good move given some experienced issues and compaction across the 5.6 range is closer to 5.4 than 5.5, i.e solid and reliable.

Will say that 5.6-Sol is a minor bump in my benchmarks in most areas vs 5.5 but a severe regression in a few specific task focused on rearranging trees, addressing merge conflicts, etc. where the model to accomplish the task does not properly adhere to prompts in a way GPT-5 originally managed, not retaining parts of history in the way prompted despite specific instructions not to as that made the final completion easier…

I am of the conservative and cautious opinion that no model should be able to run destructive tasks at all, I have seen every model do things that make me concerned enough to maintain that opinion and know my evals can’t catch everything. But for 5.6-Sol specifically, I’d caution everyone to reevaluate how you run the model, maybe take a few more precautions you tend to forgo.

It is extremely capable as a reviewer and for extensive tasks, though for the later, the safety net I feel is required to be comfortable limits the utility. The code 5.6-Sol provides also still is a bit harder to parse in reviews.

Release strategy wise, feel it’s have been smarter to release only Luna and Sol now, then Terra a few weeks of posttraining later, I simply cannot see a purpose for it in the current form given how well both Luna and Sol scale up and down respectively with reasoning. Two models from a lab at a time is also the limit I feel one can properly assess at a time.

Re: OpenAI reduces Codex Model Context Size from 372k to 272k

#16

I never felt that context size was any issue at all in codex. I don't know how their compaction works, but it just keeps on going as if it has no context limit at all. At least in my experience.

For me, Codex regularly forgets to complete its last task when compaction occurs, especially when the last message I sent was right before compaction.

It seems odd to me that Codex doesn't carry the plan file through context compaction? Claude does this, it re-reads it in full from disk

Re: OpenAI reduces Codex Model Context Size from 372k to 272k

#17
post #12

Another interesting change in that commit is the addition of this section to the system prompt: Before taking a destructive action: - Make sure the action is clearly within the user's request. - Resolve the exact targets with read-only checks when necessary. - Do not use `$HOME`, `~`, `/`, a workspace root, or another broad directory as the target of a recursive or destructive command Looks like the fix for this bug…

This happened to me one time. On windows though, deleting C:/ lmao. The direction I'm heading now is a better harness, i.e. isolating codex at a container level with dedicated workspaces / mounts etc. I'm building something at the moment that serves my needs.

Re: OpenAI reduces Codex Model Context Size from 372k to 272k

#18
post #12

Another interesting change in that commit is the addition of this section to the system prompt: Before taking a destructive action: - Make sure the action is clearly within the user's request. - Resolve the exact targets with read-only checks when necessary. - Do not use `$HOME`, `~`, `/`, a workspace root, or another broad directory as the target of a recursive or destructive command Looks like the fix for this bug…

That's ok, if AI deletes my home directory I can just ask AI to regenerate my home directory.

Re: OpenAI reduces Codex Model Context Size from 372k to 272k

#19
post #5

That's quite small for my workloads. I try to keep it under 200k but my DeepSeek and MiMo sessions can sometimes grow to 350k tokens when I try to squeeze one last iteration I compact. Can't OpenAI copy DeepSeek K/V cache tech (from published papers) to make it super cheap?

Nobody does caching as well as DeepSeek, so I guess it's a big enough difference in the implementation to make it difficult.

If you use Reasonix with DeepSeek it gets silly, as it is append-only to work with how caching works. It gets something like 97-98% cached tokens in a long session. It makes an already cheap model even cheaper.

Re: OpenAI reduces Codex Model Context Size from 372k to 272k

#20
Not a fan of their context compaction and I feel like 1M-token context should minimum today. Each day I see how GPT 5.5 and 5.6 struggle a bit after each compaction before they get to the full speed, sometimes focusing too much on some older steering message that made it into the compacted context.
Post reply on HN