OpenAI reduces Codex Model Context Size from 372k to 272k
1–10 of 194 posts
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#2Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#3Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#4Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#5I try to keep it under 200k but my DeepSeek and MiMo sessions can sometimes grow to 350k tokens when I try to squeeze one last iteration I compact.
Can't OpenAI copy DeepSeek K/V cache tech (from published papers) to make it super cheap?
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#6Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#7Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#8I never felt that context size was any issue at all in codex. I don't know how their compaction works, but it just keeps on going as if it has no context limit at all. At least in my experience.
I'm guessing you just started using codex, it suffered greatly from "model context size exceeded" errors early on, where compaction couldn't even recover from it, these errors just stopped happening maybe some month(s) ago.
Nowadays it's a lot better though and I've don't get stuck in those anymore. Although I don't like the idea that they don't surface what goes into the "concise summary" afterwards, make it really hard to know if it actually got everything important or not.
In general, codex seems to be moving into the way of hiding as much from the user as possible, and it wouldn't surprise me if they eventually start encrypting the entire session logs just like they did with agent>sub-agent prompts recently. Sad though as it's easily the best harness+model combo available today out of the ones I've tried.
Re: OpenAI reduces Codex Model Context Size from 372k to 272k
#9This was tweeted about when it happened, with some explanation from Tibo here: https://x.com/thsottiaux/status/2076543065045795309
The linked tweet is an unofficial reply to Tibo's official info and Tibo makes a correction in a reply.