Live data from Hacker News

Claude Sonnet 4.5

anthropic.com

21–30 of 819 posts

Re: Claude Sonnet 4.5

#21
post #5

Looking at the chart here, it seems like Sonnet 4 was already better than GPT-5-codex in the SWE verified benchmark. However, my subjective personal experience was GPT-5-codex was far better at complex problems than Claude Code.

Opposite for me…5-codex high ran out of tokens extremely quickly and didn’t adhere as well to the agents.md as Claude did to the Claude.md, perhaps because it insists on writing extremely complicated bash scripts or whole python programs to execute what should be simple commands.

Re: Claude Sonnet 4.5

#22
Ah, the company where the models are unusable even with Pro subscription (start to hit the limit after 20 minutes of talking), and free models are not usable at all (currently can't even send a single message to Sonnet 4.5)...

Re: Claude Sonnet 4.5

#23
post #14

Price is playing a big role in my AI usage for coding. I am using Grok Code Fast as it's super cheap. Next to it GPT-5 Codex. If you are paying for model use out of pocket Claude prices are super expensive. With better tooling setup those less smart (and often faster) models can give you better results. I am going to give this another shot but it will cost me $50 just to try it on a real project :(

how are you using grok code fast? what tooling/cli/etc?

[deleted]

Re: Claude Sonnet 4.5

#25
post #5

Looking at the chart here, it seems like Sonnet 4 was already better than GPT-5-codex in the SWE verified benchmark. However, my subjective personal experience was GPT-5-codex was far better at complex problems than Claude Code.

Well, they seem to benchmark better only when giving the model "parallel test time compute" which AFAIU is just reasoning enabled? Whereas the GPT5 numbers are not specified to have any reasoning mode enabled.

Re: Claude Sonnet 4.5

#26
post #14

Price is playing a big role in my AI usage for coding. I am using Grok Code Fast as it's super cheap. Next to it GPT-5 Codex. If you are paying for model use out of pocket Claude prices are super expensive. With better tooling setup those less smart (and often faster) models can give you better results. I am going to give this another shot but it will cost me $50 just to try it on a real project :(

how are you using grok code fast? what tooling/cli/etc?

It’s currently free in OpenRouter.

Re: Claude Sonnet 4.5

#27
post #5

Looking at the chart here, it seems like Sonnet 4 was already better than GPT-5-codex in the SWE verified benchmark. However, my subjective personal experience was GPT-5-codex was far better at complex problems than Claude Code.

I'm only a week into testing, but so far codex has been slow and the cli is worse than claude code. I intend to return to Claude.

Re: Claude Sonnet 4.5

#28
post #19

That's a pretty pelican on a bicycle! https://jsbin.com/hiruvubona/edit?html,output https://claude.ai/share/618abbbf-6a41-45c0-bdc0-28794baa1b6c

pelican on a bicycle benchmark probably getting saturated... especially as it's become a popular way to demonstrate model ability quickly

Re: Claude Sonnet 4.5

#29
post #4

I've really got to refactor my side project which I tailored to just use OpenAI API calls. I think the Anthropic APIs are a bit different so I just never put in the energy to support the changes. I think I remember reading that there are tools to simpify this kind of work, to support multiple LLM APIs? I'm sure I could do it manually but how do you all support multiple API providers that have some differences in the…

[deleted]
Post reply on HN