Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude Sonnet 4 now supports 1M tokens of context

anthropic.com

Post reply on HN
Print view View original

11–20 of 706 posts

Re: Claude Sonnet 4 now supports 1M tokens of context

#11

Post by csunoser »

falcor84 wrote: post #5

Strange that they don't mention whether that's enabled or configurable in Claude Code.

They don't say it outright. But I think it is not in Claude Code yet.

> We’re also exploring how to bring long context to other Claude products. - Anthropic

That is, any other product that is not Anthropic API tier 4 or Amazon bedrock.

Re: Claude Sonnet 4 now supports 1M tokens of context

#14

Post by Tostino »

faangguyindia wrote: post #6

In my testing the gap between claude and gemini pro 2.5 is close. My company is in asia pacific and we can't get access to claude via vertex for some stupid reason. but i tested it via other providers, the gap used to be huge but now not.

For me the gap is pretty large (in Gemini Pro 2.5's favor).

For reference, the code I am working on is a Spring Boot / (Vaadin) Hilla multi-module project with helm charts for deployment and a separate Python based module for ancillary tasks that were appropriate for it.

I've not been able to get any good use out of Sonnet in months now, whereas Gemini Pro 2.5 has (still) been able to grok the project well enough to help out.

Re: Claude Sonnet 4 now supports 1M tokens of context

#15

Post by penguin202 »

faangguyindia wrote: post #6

In my testing the gap between claude and gemini pro 2.5 is close. My company is in asia pacific and we can't get access to claude via vertex for some stupid reason. but i tested it via other providers, the gap used to be huge but now not.

Claude doesn't have a mid-life crisis and try to `rm -rf /` or delete your project.

Re: Claude Sonnet 4 now supports 1M tokens of context

#16

Post by aliljet »

This is definitely one of my CORE problem as I use these tools for "professional software engineering." I really desperately need LLMs to maintain extremely effective context and it's not actually that interesting to see a new model that's marginally better than the next one (for my day-to-day).

However. Price is king. Allowing me to flood the context window with my code base is great, but given that the price has substantially increased, it makes sense to better manage the context window into the current situation. The value I'm getting here flooding their context window is great for them, but short of evals that look into how effective Sonnet stays on track, it's not clear if the value actually exists here.

Re: Claude Sonnet 4 now supports 1M tokens of context

#18

Post by rootnod3 »

So, more tokens means better but at the same time more tokens means it distracts itself too much along the way. So at the same time it is an improvement but also potentially detrimental. How are those things beneficial in any capacity? What was said last week? Embrace AI or leave?

All I see so far is: don't embrace and stay.

Re: Claude Sonnet 4 now supports 1M tokens of context

#20

Post by rootnod3 »

aliljet wrote: post #16

This is definitely one of my CORE problem as I use these tools for "professional software engineering." I really desperately need LLMs to maintain extremely effective context and it's not actually that interesting to see a new model that's marginally better than the next one (for my day-to-day). However. Price is king. Allowing me to flood the context window with my code base is great, but given that the price has su…

Flooding the context also means increasing the likelihood of the LLM confusing itself. Mainly because of the longer context. It derails along the way without a reset.
Post reply on HN