21–30 of 1001 posts
This is pretty big! Previously most models could accept massive input tokens but would be restricted to 4096 or 8192 output tokens.
The docs for Claude code don't seem to be up yet but are linked here: http://docs.anthropic.com/s/claude-code I'm not sure if it's a broken link in the blog post or just hasn't been published yet.
> Include the beta header output-128k-2025-02-19 in your API request to increase the maximum output token length to 128k tokens for Claude 3.7 Sonnet. This is pretty big! Previously most models could accept massive input tokens but would be restricted to 4096 or 8192 output tokens.
It's fascinating how close these companies are to each other. Some company comes up with something clever/ground-breaking and everyone else has implemented it a few weeks later. Hard not to think of Kurzweil's Law of Accelerating Returns.
It does seem like it will be very, very hard for the companies training their own models to recoup their investment when the capabilities of open-weight models catch up so quickly - general purpose LLMs just seem destined to be a cheap commodity.
Just as humans use a single brain for both quick responses and deep reflection, we believe reasoning should be an integrated capability of frontier models rather than a separate model entirely.
Anyone happen to have insight on the details here? Or, even better, anyone from Anthropic lurking in these comments that cares to give us some hints? I promise, I'm not a competitor!
Separately, the throwaway paragraph on alignment is worrying as hell, but that's nothing new. I maintain hope that Anthropic is keeping to their founding principles in private, and tracking more serious concerns than "unnecessary refusals" and prompt injection...
Pretty amazing how DeepSeek started the visual reasoning trend, xAI featured it in their latest release, and now Anthropic does the same.
Wish I could find the link to enroll in their Claude Code beta...