I used this for a bit and I felt like it was slower and generally worse than using 200K with context compaction. Context compaction does lose some things though.
1M context is now generally available for Opus 4.6 and Sonnet 4.6
401–410 of 565 posts
Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6
#402Earlier quoted context omitted.
til you can edit context. i keep a running log and /clear /reload log
double escape gets you to a rewind. not sure about much else. the conversation history is a linked list, so you can screw with it, with some care. I spend this afternoon building an MCP do break the conversation up into topics, then suggest some that aren't useful but are taking up a bunch of context to remove (eg iterations through build/edit just needs the end result) its gonna take a while before I'm confident its…
Yeah just selective rewind. Selective edit where you elide large token sinks of coding and banging its head on the wall is what u mean. Not something I’ve seen done yet but there’s no reason - I suspect if you do a token use distribution in programming session most goes to pretty low semantic value malarkey.
Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6
#403Earlier quoted context omitted.
If it's not coding, even with 200k context it starts to write gibberish, even with the correct information in the context. I tried to ask questions about path of exile 2. And even with web research on it gave completely wrong information... Not only outdated. Wrong I think context decay is a bigger problem then we feel like.
The question that comes to mind for me after reading your comment is how can a question about a game require that much context?
Path of exile is complex, just check the skill tree , skills and gems:)
It could almost be used as a benchmark good models are in math, memory, updated information etc
Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6
#404I'm fairly sure that your best throughput is single-prompt single-shot runs with Claude (and that means no plan, no swarms, etc) -- just with a high degree of work in parallel.
So for me this is a pretty huge change as the ceiling on a single prompt just jumped considerably. I'm replaying some of my less effective prompts today to see the impact.
Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6
#405Earlier quoted context omitted.
If it's not coding, even with 200k context it starts to write gibberish, even with the correct information in the context. I tried to ask questions about path of exile 2. And even with web research on it gave completely wrong information... Not only outdated. Wrong I think context decay is a bigger problem then we feel like.
It could also be a skill problem. It would be more helpful if when people made llm sucks claims they shared their prompt. The people I work with who complain about this type of thing horribly communicate their ask to the llm and expect it to read their minds.
Totally agree the LLM sucks posts should be accompanied with the prompt.
Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6
#406Earlier quoted context omitted.
If it's not coding, even with 200k context it starts to write gibberish, even with the correct information in the context. I tried to ask questions about path of exile 2. And even with web research on it gave completely wrong information... Not only outdated. Wrong I think context decay is a bigger problem then we feel like.
Context decay is noticeable within 3 messages, nearly every time. Maybe not substantial, but definitely noticeable. It’s lead to me starting new chats with bigger and bigger starting ‘summary, prompts to catch the model up while refreshing it. Surely there’s a way to automate that technique.
Yeah absolutely, at this point I also start new chats after 3-4 prompts. Especially with thinking models that produce so many tokens.
Usually things go smoothly but sometimes I have situations like: “please add feature X, needs to have ABCD.” -> does ABC correct but D wrong -> “here is how to fix D” -> fixes D but breaks AB -> “remember I also want AB this way, you broke it” -> fixes AB but removes C and so on
Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6
#407Earlier quoted context omitted.
I've found it's ok at Rust. I think a lot of existing Rust code is high quality and also the stricter Rust compiler enforces that the output of the LLM is somewhat reasonable.
Yes, it's nice to have a strict compiler, so the agent has to keep fixing its bugs until it actually compiles. Rust and TypeScript are great for this.
A big downside with rust is the compile times. Being in a tight AI loop just wasn't part of the design of any existing programming languages.
As languages designed for (and probably written by) AI come out over the next decade, it will be really interesting to see what dragon tradeoffs they make.
Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6
#408The stuff I built with Opus 4.6 in the past 2.5 weeks: Full clone of Panel de Pon/Tetris attack with full P2P rollback online multiplayer: https://panel-panic.com An emulator of the MOS 6502 CPU with visual display of the voltage going into the DIP package of the physical CPU: https://larsdu.github.io/Dippy6502/ I'm impressed as fuck, but a part of me deep down knows that I know fuck all about the 6502 or its assembl…
That game is AWESOME! The fact that was vibe coded is insane.
Honestly that game wasnt oneshotted. I had longtine PdP enthusiasts play it and guve feedback
Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6
#409Earlier quoted context omitted.
I care about the privacy implications, but not the length. Out of curiosity, why do you care about the URL length at all? What is the cost to you?
My point is Google engineers go to the trouble of setting up a URL shortener service on one hand, but on the other hand it seems ad the business anti-privacy executives can override anything. This points out it's a dysfunctional company.
The point is whatever group controls the money controls the power.
Also, only the domain is shorter
Re: 1M context is now generally available for Opus 4.6 and Sonnet 4.6
#410Earlier quoted context omitted.
It could also be a skill problem. It would be more helpful if when people made llm sucks claims they shared their prompt. The people I work with who complain about this type of thing horribly communicate their ask to the llm and expect it to read their minds.
Totally agree the LLM sucks posts should be accompanied with the prompt.
I agree, but at the same time it feels like victim blaming.