Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-5.3-Codex

openai.com

Post reply on HN
Print view View original

51–60 of 634 posts

Re: GPT-5.3-Codex

#51

Post by nurettin »

granzymes wrote: post #3

I think Anthropic rushed out the release before 10am this morning to avoid having to put in comparisons to GPT-5.3-codex! The new Opus 4.6 scores 65.4 on Terminal-Bench 2.0, up from 64.7 from GPT-5.2-codex. GPT-5.3-codex scores 77.3.

Opus was quite useless today. Created lots of globals, statics, forward declarations, hidden implementations in cpp files with no testable interface, erasing types, casting void pointers, I had to fix quite a lot and decouple the entangled mess.

Hopefully performance will pick up after the rollout.

Re: GPT-5.3-Codex

#53

Post by input_sh »

modeless wrote: post #41

It's so difficult to compare these models because they're not running the same set of evals. I think literally the only eval variant that was reported for both Opus 4.6 and GPT-5.3-Codex is Terminal-Bench 2.0, with Opus 4.6 at 65.4% and GPT-5.3-Codex at 77.3%. None of the other evals were identical, so the numbers for them are not comparable.

It's better on a benchmark I've never heard of!? That is groundbreaking, I'm switching immediately!

Re: GPT-5.3-Codex

#54

Post by fooker »

the_duke wrote: post #19
granzymes wrote: post #3

I think Anthropic rushed out the release before 10am this morning to avoid having to put in comparisons to GPT-5.3-codex! The new Opus 4.6 scores 65.4 on Terminal-Bench 2.0, up from 64.7 from GPT-5.2-codex. GPT-5.3-codex scores 77.3.

I do not trust the AI benchmarks much, they often do not line up with my experience. That said ... I do think Codex 5.2 was the best coding model for more complex tasks, albeit quite slow. So very much looking forward to trying out 5.3.

Yeah, these benchmarks are bogus.

Every new model overfits to the latest overhyped benchmark.

Someone should take this to a logical extreme and train a tiny model that scores better on a specific benchmark.

Re: GPT-5.3-Codex

#55

Post by yunyu »

nine_k wrote: post #39
Tiberium wrote: post #17

Earlier quoted context omitted.

It's not in the API yet - "We are working to safely enable API access soon.", but I assume the rate-limits won't be worse than for 5.2 Codex.

Ah, "It's ready, but not yet".

You can just use it outside of the API?

Re: GPT-5.3-Codex

#57

Post by sdf2erf »

trilogic wrote: post #22

When 2 multi billion giants advertise same day, it is not competition but rather a sign of struggle and survival. With all the power of the "best artificial intelligence" at your disposition, and a lot of capital also all the brilliant minds, THIS IS WHAT YOU COULD COME UP WITH? Interesting

Yeah they are both fighting for survival. No surprise really.

Need to keep the hype going if they are both IPO'ing later this year.

Re: GPT-5.3-Codex

#58

Post by brokencode »

GenerWork wrote: post #46

I find it very, very interesting how they demoed visuals in the form of the “soft SaaS” website and mentioned how it can do user research. Codex has usually lagged behind Claude and Gemini when it comes to UX, so I’m curious to see if 5.3 will take the lead in real world use. Perhaps it’ll be available in Figma Make now?

I’m hoping they add better IDE integration to track active file and selection. That’s the biggest annoyance I have in working with Codex.

Re: GPT-5.3-Codex

#59

Post by tomashubelbauer »

OutOfHere wrote: post #38

It is absurd to release 5.3-Codex before first releasing 5.3. Also, there is no reason for OpenAI and Anthropic to be trying to one-up each other's releases on the same day. It is hell for the reader.

I agree, I was confused about where 5.3 non Codex was. 5.2-Codex disappointed me enough that I won't be giving 5.3 Codex a try, but I'm looking forward to trying 5.3 non Codex with Pi.
Post reply on HN