Live data from Hacker News

Claude Haiku 4.5

anthropic.com

191–200 of 292 posts

Re: Claude Haiku 4.5

#191

Ain't nobody got time to pick models and compare features. It's annoying enough having to switch from one LLM ecosystem to another all the time due to vague usage restrictions. I'm paying $20/mo to Anthropic for Claude Code, to OpenAI for Codex, and previously to Cursor for...I don't even know what. I know Cursor lets you select a few different models under the covers, but I have no idea how they differ, nor do I car…

I don’t mean this with snark, but with age. It’s actually totally cool to not upgrade and then you have stability in your tooling.

I bet there is some hella good art being made with Photoshop 6.0 from the 90s right now.

The upgrade path is like the technical hedonistic treadmill. You don’t have to upgrade.

Re: Claude Haiku 4.5

#192
post #52

I am really interested in the future of Opus; is it going to be an absolute monster, and continue to be wildly expensive? Or is the leap from 4 -> 4.5 for it going to be more modest.

I wonder what the next smaller model after Haiku will be called. "Claude Phrase"?

Claude Char

Re: Claude Haiku 4.5

#193

Earlier quoted context omitted.

I’m surprised none of the frontier model companies have thrown this test in as an Easter egg.

OpenAI / Bing admit it's in its knowledge base. are you aware of the pelican on a bicycle test? Yes — the "Pelican on a Bicycle" test is a quirky benchmark created by Simon Willison to evaluate how well different AI models can generate SVG images from prompts.

Knowing that does not make it easier to draw one though.

Re: Claude Haiku 4.5

#194
post #111

Earlier quoted context omitted.

Gemini 3.0 Pro (or what is deemed to be 3.0 Pro - you can get access to it via A/B testing on AI Studio) does a noticeably better job https://x.com/cannn064/status/1972349985405681686 https://x.com/whylifeis4/status/1974205929110311134 https://x.com/cannn064/status/1976157886175645875

How do people trigger A/B testing?

As far as I can tell they just keep on hammering the same prompt in https://aistudio.google.com/ until they get lucky and the A/B test triggers for them on one of those prompts.

Re: Claude Haiku 4.5

#195

Earlier quoted context omitted.

Hey! I work on the Claude Code team. Both PAYG and Subscription usage look to be configured correctly in accordance with the price for Haiku 4.5 ($1/$5 per M I/O tok). Feel free to DM me your account info on twitter ( https://x.com/katchu11 ) and I can dig deeper!

lol, I don’t know if you work there or not, but directing folks to send their account info to a random Twitter address is, not considered best practice.

Being charitable, let's assume parent wasn't talking about secrets.

Re: Claude Haiku 4.5

#196
post #30

Very preliminary testing is very promising, seems far more precise in code changes over GPT-5 models in not ingesting irrelevant to the task at hand code sections for changes which tends to make GPT-5 as a coding assistant take longer than sometimes expected. With that being the case, it is possible that in actual day-to-day use, Haiku 4.5 may be less expensive than the raw cost breakdown may appear initially, though…

Those numbers don’t mean anything without average token usage stats.

Exactly, token per dollar rates are useful, but without knowing the typical input output token distribution for each model on this specific task, the numbers alone don’t give a full picture of cost.

Re: Claude Haiku 4.5

#197

Ain't nobody got time to pick models and compare features. It's annoying enough having to switch from one LLM ecosystem to another all the time due to vague usage restrictions. I'm paying $20/mo to Anthropic for Claude Code, to OpenAI for Codex, and previously to Cursor for...I don't even know what. I know Cursor lets you select a few different models under the covers, but I have no idea how they differ, nor do I car…

I don’t mean this with snark, but with age. It’s actually totally cool to not upgrade and then you have stability in your tooling. I bet there is some hella good art being made with Photoshop 6.0 from the 90s right now. The upgrade path is like the technical hedonistic treadmill. You don’t have to upgrade.

Almost all my tooling is years (or decades) old and stable. But the code assistant LLM scene effectively didn't exist in any meaningful way until this year, and it changes almost daily. There is no stability in the tooling, and you're missing out if you don't switch to newer models at least every few weeks right now. Codex (OpenAI/ChatGPT CLI) didn't even exist a month ago, and it's a contender for the best option. Claude Code has only been out for a few months.

I use Neovim in tmux in a terminal and haven't changed my primary dev environment or tooling in any meaningful way since switching from Vim to Neovim years ago.

I'm still changing code AIs as soon as the next big thing comes out, because you're crippling yourself if you don't.

Re: Claude Haiku 4.5

#198

Earlier quoted context omitted.

You can use Crystal ( https://github.com/stravu/crystal ) to run Codex and Claude Code at the same time and just pick the best result.

Ain't nobody got time and money to run multiple agents at the same time

Unfortunately I already pay for and use both, because on the $20/mo plan, you get cut off after a few hours due to usage limits. Claude resets daily after "5 hours" (I can't determine what runs the clock, but it seems to be wall time (?!)), and Codex cuts you off for multiple days after a long session.

Re: Claude Haiku 4.5

#199

Earlier quoted context omitted.

How close are you? Oh right, Anthropic doesn't tell you. I got that 'close to weekly limits' message for an entire week without ever reaching it, came to the conclusion that it is just a printer industry 'low ink!' tactic, and cancelled my subscription. You don't take money from a customer for a service, and then bar the customer form using that service for multiple days. Either charge more, stop subsidizing free acc…

These days, running `/usage` in Claude Code shows you how close you are to the session and weekly limits. Also available in the web interface settings under "Usage".

Super helpful, thanks!

Re: Claude Haiku 4.5

#200
post #136

Earlier quoted context omitted.

Was just about to post that Haiku 4.5 does something I have never encountered before [0], there is a massive delta between token/sec depending on the query. Some variance including task specific is of course nothing new, but never as pronounced and reproducible as here. A few examples, prompted at UTC 21:30-23:00 via T3 Chat [0]: Prompt 1 — 120.65 token/sec — https://t3.chat/share/tgqp1dr0la Prompt 2 — 118.58 token/s…

That's what you get when you use speculative decoding and focus / overfit the draft model on coding. Then when the answer is out of distribution for the draft model, you get increased token rejections by the main model and throughput suffers. This probably still makes sense for them if they expect a lot of their load will come from claude code and they need to make it economical.

I'm curious to know if Anthropic mentions anywhere that they use speculative decoding. For OpenAI they do seem to use it based on this tweet [1].

[1] https://x.com/stevendcoffey/status/1853582548225683814

Post reply on HN