Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

1M context is now generally available for Opus 4.6 and Sonnet 4.6

claude.com

Post reply on HN
Print view View original

451–460 of 565 posts

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#451

Post by aenis »

LoganDark wrote: post #303
aenis wrote: post #252

Earlier quoted context omitted.

I find it hard to understand that people consider $200 p/m a lot for what they are getting. Expensive compared to what? A netflix sub? A 1hr of a senior dev is at least $100, depending where one lives. Since Claude saves me hours every day, it pays for itself almost instantly. I think the economic value of the Claude subscription is on the order of $20-40k a month for a pro.

When did I say anything about what I'm getting? I said I pay $200/mo and I expect that to cover anything up to my usage limit. I don't expect any slightly non-standard configuration to immediately ignore the high subscription price that I pay and go straight to "extra usage" that has to be billed separately by the token. I wouldn't even care if fast mode used 10x or 50x the usage as long as I could actually USE the b…

Fair point. I read your comment as '$200 is a lot, they shouldnt ask for more'. My bad!

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#453

Post by daemonk »

jeremychone wrote: post #419

Interesting, I’ve never needed 1M, or even 250k+ context. I’m usually under 100k per request. About 80% of my code is AI-generated, with a controlled workflow using dev-chat.md and spec.md. I use Flash for code maps and auto-context, and GPT-4.5 or Opus for coding, all via API with a custom tool. Gemini Pro and Flash have had 1M context for a long time, but even though I use Flash 3 a lot, and it’s awesome, I’ve neve…

Yeah this is the simpler and also effective strategy. A lot of people are building sophisticated AST RAG models. But you really just need to ask Claude to generally build a semantic index for each large-ish piece of code and re-use it when getting context.

You have to make sure the semantic summary takes up significantly less tokens than just reading the code or its just a waste of token/time.

Then have a skill that uses git version logs to perform lazy summary cache when needed.

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#455

Post by jeremychone »

firemelt wrote: post #422
jeremychone wrote: post #419

Interesting, I’ve never needed 1M, or even 250k+ context. I’m usually under 100k per request. About 80% of my code is AI-generated, with a controlled workflow using dev-chat.md and spec.md. I use Flash for code maps and auto-context, and GPT-4.5 or Opus for coding, all via API with a custom tool. Gemini Pro and Flash have had 1M context for a long time, but even though I use Flash 3 a lot, and it’s awesome, I’ve neve…

whenever I see post like this i said well yeah, but its too sophiscated to be practical

Fair point, but because I spent a year building and refining my custom tool, this is now the reality for all of my AI requests.

I prompt, press run, and then I get this flow: dev setup (dev-chat or plan) code-map (incremental 0s 2m for initial) auto-context (~20s to 40s) final AI query (~30s to 2m)

For example, just now, in my Rust code (about 60k LOC), I wanted to change the data model and brainstorm with the AI to find the right design, and here is the auto-context it gave me:

- Reducing 381 context files ( 1.62 MB)

- Now 5 context files ( 27.90 KB)

- Reducing 11 knowledge files ( 30.16 KB)

- Now 3 knowledge files ( 5.62 KB)

The knowledge files are my "rust10x" best practices, and the context files are the source files.

(edited to fix formatting)

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#456

Post by heraldgeezer »

AnotherGoodName wrote: post #390
Bombthecat wrote: post #363

Earlier quoted context omitted.

If it's not coding, even with 200k context it starts to write gibberish, even with the correct information in the context. I tried to ask questions about path of exile 2. And even with web research on it gave completely wrong information... Not only outdated. Wrong I think context decay is a bigger problem then we feel like.

Fwiw put a copy of the game folder in a directory and tell claude to extract game files and dissasemble the game in preparation for questions about the game. As an example of doing this in a session with jagged alliance 3 (an rpg) https://pastes.io/jagged-all-69136 Claude extracting game archives and dissasembling leads to far more reliable results than random internet posts.

This will not work for an online game like PoE 2

Or even one with DRM?

Right?

Or?

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#457

Post by [deleted] »

daemonk wrote: post #453
jeremychone wrote: post #419

Interesting, I’ve never needed 1M, or even 250k+ context. I’m usually under 100k per request. About 80% of my code is AI-generated, with a controlled workflow using dev-chat.md and spec.md. I use Flash for code maps and auto-context, and GPT-4.5 or Opus for coding, all via API with a custom tool. Gemini Pro and Flash have had 1M context for a long time, but even though I use Flash 3 a lot, and it’s awesome, I’ve neve…

Yeah this is the simpler and also effective strategy. A lot of people are building sophisticated AST RAG models. But you really just need to ask Claude to generally build a semantic index for each large-ish piece of code and re-use it when getting context. You have to make sure the semantic summary takes up significantly less tokens than just reading the code or its just a waste of token/time. Then have a skill that…

[deleted]

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#458

Post by speakbits »

jeremychone wrote: post #419

Interesting, I’ve never needed 1M, or even 250k+ context. I’m usually under 100k per request. About 80% of my code is AI-generated, with a controlled workflow using dev-chat.md and spec.md. I use Flash for code maps and auto-context, and GPT-4.5 or Opus for coding, all via API with a custom tool. Gemini Pro and Flash have had 1M context for a long time, but even though I use Flash 3 a lot, and it’s awesome, I’ve neve…

I think you've kind of hit on the more successful point here, which is that you should be keeping things focused in a sufficiently focused area to have better success and not necessarily needing more context.

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#459

Post by devld »

danielbln wrote: post #280
fbrncci wrote: post #204

Earlier quoted context omitted.

I am starting to believe it’s not OPUS but developers getting better at using LLMs across the board. And not realizing they are just getting much better at using these tools. I also thought it was OPUS 4.5 (also tested a lot with 4.6) and then in February switched to only using auto mode in the coding IDEs. They do not use OPUS (most of the times), and I’m ending up with a similar result after a very rough learning c…

Opus is not an acronym.

O.P.U.S OutProgram U Soon

Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6

#460

Post by jeremychone »

cloverich wrote: post #434
jeremychone wrote: post #419

Interesting, I’ve never needed 1M, or even 250k+ context. I’m usually under 100k per request. About 80% of my code is AI-generated, with a controlled workflow using dev-chat.md and spec.md. I use Flash for code maps and auto-context, and GPT-4.5 or Opus for coding, all via API with a custom tool. Gemini Pro and Flash have had 1M context for a long time, but even though I use Flash 3 a lot, and it’s awesome, I’ve neve…

This is really interesting; ive done very high level code maps but the entire project seems wild, it works? So, small model figures out which files to use based on the code map, and then enriches with snippets, so big model ideally gets preloaded with relevant context / snippets up front? Where does code map live? Is it one big file?

So, I have a pro@coder/.cache/code-map/context-code-map.json.

I also have a `.tmpl-code-map.jsonl` in the same folder so all of my tasks can add to it, and then it gets merged into context-code-map.json.

I keep mtime, but I also compute a blake3 hash, so if mtime does not match, but it is just a "git restore," I do not redo the code map for that file. So it is very incremental.

Then the trick is, when sending the code map to AI, I serialize it in a nice, simple markdown format.

- path/to/file.rs - summary: ... - when to use: ... - public types: .., .., .. - public functions: .., .., ..

- ...

So the AI does not have to interpret JSON, just clean, structured markdown.

Funny, I worked on this addition to my tool for a week, planning everything, but even today, I am surprised by how well it works.

I have zero sed/grep in my workflow. Just this.

My prompt is pro@coder/coder-prompt.md, the first part is YAML for the globs, and the second part is my prompt.

There is a TUI, but all input and output are files, and the TUI is just there to run it and see the status.

Post reply on HN