Live data from Hacker News

Managing context on the Claude Developer Platform

anthropic.com

81–90 of 93 posts

Re: Managing context on the Claude Developer Platform

#81
post #71

I'll let them (ai companies) figure it out while i keep coding manually. I'll wait for the day they will release a js library to programmatically do all this llm context juggling, instead of using a UI, and then I will adopt it by doing what I do now, writting code. I will write code that orchestrates llms for writting code. Edit: This is obviously a joke... but is it really a joke?

[dead]

Re: Managing context on the Claude Developer Platform

#82

Earlier quoted context omitted.

It may be harsh but the reality is, if you have to ask you’re likely not a viable candidate. The leading AI companies have the kind of capital to be able to hire the very best of the industry. If you’re only just starting now and even worse yet need your hand held to do so you’re totally out of the running…

so what would be wise to do in this situation? leave the hope and surrender or completely start out and work in a nascent field?

Build up experience. There's no shortcuts

You're basically like a junior dev trying to apply to be a lead dev for a team at Google

Re: Managing context on the Claude Developer Platform

#83

I want to really get into anthropic. For context: I have background in CV and ML in general. Currently reviewing and revising RL. Any idea how I can get into RL? I have 3 years of industry/research experience. Whenever I see post like this, it triggers a massive fomo creating a scene of urgency on I should work in these problems. Not being able to work here is making be anxious. what does it take for someone in Non-U…

The hardest part of that journey is that there are a _lot_ of people out there now thinking the same thing. It is really difficult to get into these jobs without a network helping you.

Re: Managing context on the Claude Developer Platform

#84
post #28

Earlier quoted context omitted.

Claude Code already compacts automatically.

I believe Codex CLI also auto compacts when the context limit is met, but in addition to that, you can manually issue a /compact command at any time.

Codex was only explicit last time I checked

Re: Managing context on the Claude Developer Platform

#85
post #66

Earlier quoted context omitted.

/compact does most of that, for me at least /compact we will now work on x, discard y, keep z

the trouble with compact is that no one really knows how it works and what it does. hence, for me at least, there is just no way I would ever allow my context to get there. you should seriously reconsider ever using compact (I mean this literally) - the quality of CC at that point is order of magnitute significantly worse that you are doing yourself significant disservice

When you hit ^O after compact runs (or anytime), it tells you exactly what compact did, so it isn’t that mysterious

Re: Managing context on the Claude Developer Platform

#86
Why client side? Doesn't that mean re-uploading the whole context whenever you change something? Seems like storing it server-side and providing an API to swap pieces in and out of context would be a lot more efficient. Or if the LLM is the one deciding what to swap, that could be done without client involvement at all. Even better would be if this API was standardized across providers.

Outside of context manipulation, it'd also be nice to standardize a format to label sections of the context and later append keywords to the context to ignore / unignore those sections (or refer back to them, emphasize them, whatever). With that, I imagine we'd be able to have a pretty good set of standard LoRA adapters that enable all LLMs to be controlled in the same fashion. That way agents will be able to manipulate LLMs in a standard way, without having to rewrite context itself.

Re: Managing context on the Claude Developer Platform

#87
post #36

I wish every instruction and response had a enable/disable checkbox so that I can disable parts of the conversation in such a way that it is excluded from the context. Let's say I submit or let it create a piece of code, and we're working on improving it. At some point I want to consider the piece of code to be significantly better that what I had initially, so all those initial interactions containing old code could…

FWIW, in Claude Desktop you can edit previous user context and Claude will fork the conversation from that point. I know it's not quite what you as asking for, but it's something.

There are 3rd-party chat interfaces out there that have much better context controls if it matters enough for you that you're willing to resort to direct API usage.

Re: Managing context on the Claude Developer Platform

#88
post #36

I wish every instruction and response had a enable/disable checkbox so that I can disable parts of the conversation in such a way that it is excluded from the context. Let's say I submit or let it create a piece of code, and we're working on improving it. At some point I want to consider the piece of code to be significantly better that what I had initially, so all those initial interactions containing old code could…

I exit and restart CC all the time to get a “Fresh perspective on the universe as it now is”.

I went with an extra CURRENT.md for whatever extra info that might be useful for what I am working on and frequently /clear after each very small task. /compact is rarely used unless there are reasons to maintain a summary on what its working on.

Each new prompt involves asking Claude to read CURRENT.md for additional context.

I'm not sure if I should move this to CLAUDE.md but the stuff in CURRENT.md are very short term information that gets useless after a while.

---

There is one time where Claude entirely messed up the directory when moving things around and it sort of stuck in a weird "panic" loop in chat for quite a while (involving oh no / oh dear in chat), nothing git can't fix, but I suspect is due to the directory info in CLAUDE.md getting stale. Ever since then I moved things that might get stale to a separate file and frequently keep it updated/trimmed as needed.

Re: Managing context on the Claude Developer Platform

#89
post #36

I wish every instruction and response had a enable/disable checkbox so that I can disable parts of the conversation in such a way that it is excluded from the context. Let's say I submit or let it create a piece of code, and we're working on improving it. At some point I want to consider the piece of code to be significantly better that what I had initially, so all those initial interactions containing old code could…

I think the main issue with removing certain previous responses from context would be that you no longer hit the cache for a large part of your chat history, which makes responses much more expensive and slow.

Its faster and cheaper (in most cases) to leave the history as is and hit the cache.

Re: Managing context on the Claude Developer Platform

#90

Would this mean cursor and cline don’t have to do context management? Their value is much more just in the ui now?

I don't think cline ever had to do much context management, which is why i prefer them over cursor. Cline is similar to claude code, but without the vendor lock in.
Post reply on HN