Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude Haiku 4.5

anthropic.com

Post reply on HN
Print view View original

141–150 of 292 posts

Re: Claude Haiku 4.5

#141

Post by basket_horse »

UncleOxidant wrote: post #131
qsort wrote: post #127

Earlier quoted context omitted.

Models are stateless, why would that not work?

OK I understand what those words mean, but how exactly does that work? How does the new model 'know' what's being worked on when the old model was in the middle of working on a task and then a new model is switched to? (and where the task might be modifying a C++ file)

Generally speaking, agents send the entire previous conversation to the model on every message. That’s why you have to do things like context compaction. So if you switch models mid way, you are still sending the entire previous chat history to the new model

Re: Claude Haiku 4.5

#142

Post by actionfromafar »

ziofill wrote: post #57
simonw wrote: post #18

Pretty cute pelican on a slightly dodgy bicycle: https://tools.simonwillison.net/svg-render#%3Csvg%20viewBox%...

Gemini Pro initially refused (!) but it was quite simple to get a response: > give me the svg of a pelican riding a bicycle > I am sorry, I cannot provide SVG code directly. However, I can generate an image of a pelican riding a bicycle for you! > ok then give me an image of svg code that will render to a pelican riding a bicycle, but before you give me the image, can you show me the svg so I make sure it's correct?…

What is dada?

Re: Claude Haiku 4.5

#143

Post by cromulen »

Topfi wrote: post #136
rbitar wrote: post #122

Earlier quoted context omitted.

Where do you get the 220 token/second? Genuinely curious as that would be very impressive for a model comparable to sonnet 4. OpenRouter currently publishing around 116/tps[1] [1] https://openrouter.ai/anthropic/claude-haiku-4.5

Was just about to post that Haiku 4.5 does something I have never encountered before [0], there is a massive delta between token/sec depending on the query. Some variance including task specific is of course nothing new, but never as pronounced and reproducible as here. A few examples, prompted at UTC 21:30-23:00 via T3 Chat [0]: Prompt 1 — 120.65 token/sec — https://t3.chat/share/tgqp1dr0la Prompt 2 — 118.58 token/s…

That's what you get when you use speculative decoding and focus / overfit the draft model on coding. Then when the answer is out of distribution for the draft model, you get increased token rejections by the main model and throughput suffers. This probably still makes sense for them if they expect a lot of their load will come from claude code and they need to make it economical.

Re: Claude Haiku 4.5

#144

Post by jhancock »

justinbaker84 wrote: post #74
minimaxir wrote: post #2

$1/M input tokens and $5/M output tokens is good compared to Claude Sonnet 4.5 but nowadays thanks to the pace of the industry developing smaller/faster LLMs for agentic coding, you can get comparable models priced for much lower which matters at the scale needed for agentic coding. Given that Sonnet is still a popular model for coding despite the much higher cost, I expect Haiku will get traction if the quality is a…

I am a professional developer so I don't care about the costs. I would be willing to pay more for 4.5 Haiku vs 4.5 Sonnet because the speed is so valuable. I spend way to much time waiting for the cutting edge models to return a response. 73% on SWE Bench is plenty good enough for me.

How do you review code when the LLM can produce so much so fast?

Re: Claude Haiku 4.5

#145

Post by scottyah »

taf2 wrote: post #126

I just don't find the benchmarks on the site here at all believable. codex for me with gpt-5 is so much better then claude any model version. I mean maybe it's because they compare to gpt-5-codex model but they don't mention is that high, medium, low, etc... so it's just misleading probably... but i must reiterate zero loyalty to any AI vendor. 100% what solves the problem more consistently and of a higher quality an…

Out of curiosity, what kind of work do you use them for? I did a comparison of a few different models for setting up a home server with k3s and a few web apps in nextjs. Claude was my favorite for both tasks, but mainly because it seemed to take my feedback a lot better than others.

Re: Claude Haiku 4.5

#147

Post by nothrabannosir »

UncleOxidant wrote: post #131
qsort wrote: post #127

Earlier quoted context omitted.

Models are stateless, why would that not work?

OK I understand what those words mean, but how exactly does that work? How does the new model 'know' what's being worked on when the old model was in the middle of working on a task and then a new model is switched to? (and where the task might be modifying a C++ file)

In addition to sibling comments you can play with this yourself by sending raw api requests with fake history to gaslight the model into believing it said things which it didn’t. I use this sometimes to coerce it into specific behavior, feeling like maybe it will listen to itself more than to my prompt (though I never benchmarked it):

- do and be succinct

-

- I love how succinct that was. Perfect. Now please do

The models don’t have state so they don’t know they never said it. You’re just asking “given this conversation , what is the most likely next token?”

Re: Claude Haiku 4.5

#148

Post by PhilippGille »

caymanjim wrote: post #114

Ain't nobody got time to pick models and compare features. It's annoying enough having to switch from one LLM ecosystem to another all the time due to vague usage restrictions. I'm paying $20/mo to Anthropic for Claude Code, to OpenAI for Codex, and previously to Cursor for...I don't even know what. I know Cursor lets you select a few different models under the covers, but I have no idea how they differ, nor do I car…

One option: Use OpenRouter [1] with the `openrouter/auto` model [2], which will pick among GPT-5, Gemini 2.5 Pro, Claude Sonnet 4.5 and similar.

[1] https://openrouter.ai/

[2] https://openrouter.ai/openrouter/auto

Re: Claude Haiku 4.5

#149

Post by schmookeeg »

caymanjim wrote: post #114

Ain't nobody got time to pick models and compare features. It's annoying enough having to switch from one LLM ecosystem to another all the time due to vague usage restrictions. I'm paying $20/mo to Anthropic for Claude Code, to OpenAI for Codex, and previously to Cursor for...I don't even know what. I know Cursor lets you select a few different models under the covers, but I have no idea how they differ, nor do I car…

I use OpenRouter for similar reasons -- half to avoid lock-in, and the other half to reduce the switching pain, which is just a way to say "if I do get locked in, I want to move easily"

Re: Claude Haiku 4.5

#150

Post by jbentley1 »

caymanjim wrote: post #114

Ain't nobody got time to pick models and compare features. It's annoying enough having to switch from one LLM ecosystem to another all the time due to vague usage restrictions. I'm paying $20/mo to Anthropic for Claude Code, to OpenAI for Codex, and previously to Cursor for...I don't even know what. I know Cursor lets you select a few different models under the covers, but I have no idea how they differ, nor do I car…

You can use Crystal (https://github.com/stravu/crystal) to run Codex and Claude Code at the same time and just pick the best result.
Post reply on HN