Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

1M context is now generally available for Opus 4.6 and Sonnet 4.6

claude.com

Post reply on HN
Print view View original

511–520 of 565 posts

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#511

Post by namtab00 »

phendrenad2 wrote: post #155
Frannky wrote: post #117

Opus 4.6 is nuts. Everything I throw at it works. Frontend, backend, algorithms—it does not matter. I start with a PRD, ask for a step-by-step plan, and just execute on each step at a time. Sometimes ideas are dumb, but checking and guiding step by step helps it ship working things in hours. It was also the first AI I felt, "Damn, this thing is smarter than me." The other crazy thing is that with today's tech, these…

The replies to this really make me think that some people are getting left behind the AI age. Colleges are likely already teaching how to prompt, but a lot of existing software devs just don't get it. I encourage people who aren't having success with AI to watch some youtube videos on best practices.

I am such a dev (backend).

I'm working in a codebase of 200+ "microservices", separate repos, each deployed as multiple FaaS, CQRS-style. None of it my choice, everything precedes me, many repos I know nothing of. Little to no code re-use between them.

Any trace of "business logic" is so distributed in multiple repos, that I have no possible use of LLM codegen, unless I can somehow feed it ALL the codebase.

I've tried generating some tests, but they always miss the mark, as in the system under test is almost always the wrong one.

I guess LLM are cool for greenfield, but when the brownfield is really brown, there's no use for LLMs.

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#513

Post by cubefox »

bob1029 wrote: post #378
cubefox wrote: post #374

> Standard pricing now applies across the full 1M window for both models, with no long-context premium. Does that mean it's likely not a Transformer with quadratic attention, but some other kind of architecture, with linear time complexity in sequence length? That would be pretty interesting.

It's almost certainly not quadratic at 1M. This would be wildly infeasible at scale. 10^6^2 = 10^12. That's a trillion things. They are probably doing something like putting the original user prompt into the model's environment and providing special tools to the model, along with iterative execution, to fully process the entire context over multiple invokes. I think the Recursive Language Model paper has a very good…

So that would mean it's not "really" a 1M context window. I guess this is more plausible than a linear architecture like MAMBA or GDN.

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#514

Post by brookst »

qualifck wrote: post #466
brookst wrote: post #391

Earlier quoted context omitted.

Interesting take. Does that mean SWE's are outsourcing their thinking by relying on management to run the company, designers to do UX, support folks to handle customers? Or is thinking about source code line by line the only valid form of thinking in the world?

I mean yes? That's like, the whole idea behind having a team. The art guy doesn't want to think about code, the coder doesn't want to think about finances, the accountant doesn't want to worry about customer support. It would be kind of a structural failure if you weren't outsourcing at least some of your thinking.

I’m with you, perhaps I just misread some kind of condescension into the “outsourcing your thinking” comment.

We all have limited context windows, the world’s always worked that way, just seemed odd to (mis)read someone saying there’s something wrong with focusing on when you add the greatest value and trusting others to do the same.

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#515

Post by Myrmornis »

jeremychone wrote: post #419

Interesting, I’ve never needed 1M, or even 250k+ context. I’m usually under 100k per request. About 80% of my code is AI-generated, with a controlled workflow using dev-chat.md and spec.md. I use Flash for code maps and auto-context, and GPT-4.5 or Opus for coding, all via API with a custom tool. Gemini Pro and Flash have had 1M context for a long time, but even though I use Flash 3 a lot, and it’s awesome, I’ve neve…

This is interesting but don't you worry that you're competing with entire companies (e.g. Anthropic) and thus it's a losing battle? Since you're re-implementing a bunch of stuff they either do in their harness or have decided it was better not to do?

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#516

Post by AnotherGoodName »

AnotherGoodName wrote: post #390
Bombthecat wrote: post #363

Earlier quoted context omitted.

If it's not coding, even with 200k context it starts to write gibberish, even with the correct information in the context. I tried to ask questions about path of exile 2. And even with web research on it gave completely wrong information... Not only outdated. Wrong I think context decay is a bigger problem then we feel like.

Fwiw put a copy of the game folder in a directory and tell claude to extract game files and dissasemble the game in preparation for questions about the game. As an example of doing this in a session with jagged alliance 3 (an rpg) https://pastes.io/jagged-all-69136 Claude extracting game archives and dissasembling leads to far more reliable results than random internet posts.

Just as another one i did today. I asked claude to decompile Newstower and make a static site that could take in game saves, edit them and download them again.

https://thedailycheat.com/

Seriously coding agents make messing with games super easy.

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#517

Post by sporkland »

Can someone help me with insights about large context models? Are there relationships that pop up at the beginning and end of long context windows that don't transitively follow from intermediate points? Is there value in the training over these longer windows vs using the more basic/closer weight distributions over different sliding windows?

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#518

Post by sarchertech »

godd2 wrote: post #491
sarchertech wrote: post #142

Earlier quoted context omitted.

What kinds of things are you building? This is not my experience at all. Just today I asked Claude using opus 4.6 to build out a test harness for a new dynamic database diff tool. Everything seemed to be fine but it built a test suite for an existing diff tool. It set everything up in the new directory, but it was actually testing code and logic from a preexisting directory despite the plan being correct before I tol…

> After about 4 hours and $75 Huh? The max plan is $200/month. How are you spending $75 in 4 hrs?

Enterprise plan. We've been instructed that our goal is to spend at least as much as our salary.

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#519

Post by FrostKiwi »

sarchertech wrote: post #518
godd2 wrote: post #491

Earlier quoted context omitted.

> After about 4 hours and $75 Huh? The max plan is $200/month. How are you spending $75 in 4 hrs?

Enterprise plan. We've been instructed that our goal is to spend at least as much as our salary.

> is to spend at least as much as our salary

Reads as a very distopian "let's see how many people we can replace"

Post reply on HN