Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude Memory

anthropic.com

Post reply on HN
Print view View original

271–280 of 326 posts

Re: Claude Memory

#271

Post by marcus_holmes »

cainxinth wrote: post #23

I don't use any of these type of LLM tools which basically amount to just a prompt you leave in place. They make it harder to refine my prompts and keep track of what is causing what in the outputs. I write very precise prompts every time. Also, I try not work out a problem over the course of several prompts back and forth. The first response is always the best and I try to one shot it every time. If I don't get what…

I use projects for sandboxing context, I find it really useful. A lot of the stuff I'm using Claude for needs a decent chunk of context, too much for a single prompt.

Memory is going to make that easier/better, I think. It'll be interesting to find out.

Re: Claude Memory

#272

Post by Sammi »

typpilol wrote: post #206
whoisthemachine wrote: post #203

Earlier quoted context omitted.

What's the right size claude.md file in your experience?

My experience is with copilot and it uses various models, but the sweet spot is between 60 and 120 lines. With psuedo xml tags between sections Might be different across platforms due to how stuff is setup though.

My AGENTS.md is 845 lines and it only started getting good once it got that long. I'm still wanting to add much more... I'm thinking maybe I need a folder of short doc files and an index in AGENTS.md describing the different doc files and when to use them instead.

Re: Claude Memory

#273

Post by picozeta »

lukol wrote: post #57

Anybody else experiencing severe decline in Claude output quality since the introduction of "skills"? Like Claude not being able to generate simple markdown text anymore and instead almost jumping into writing a script to produce a file of type X or Y - and then usually failing at that?

Yes, it's just another anecdote, but I agree, the quality of the outputs have gone down for me as well.

Re: Claude Memory

#274

Post by awesome_dude »

dns_snek wrote: post #252
awesome_dude wrote: post #247

Earlier quoted context omitted.

Like I said, the AI does exactly what I intend for it to do. Almost, as I said earler, like the AI has processed my request, realised that I am referring to the context of the earlier discussions, and moved on to the next prompt exactly how I have expected it to Given the two very VERY dumb responses, and multiple people down voting, I am reminded how thankful I am that AI is around now, because it understood what yo…

> I am reminded how thankful I am that AI is around now, because it understood what you clearly don't. We understand what you're saying just fine but what you're saying is simply wrong as a matter of technical fact. All of that context still exists and still degrades the output even if the model has fooled you into thinking that it doesn't. Therefore recommending it as an alternative to actually clearing the context…

What I'm saying is.. I tell the AI to "forget everything" and it understands what I mean... and you're arguing that it cannot do... what you INCORRECTLY think is being said

I get that you're not very intelligent, but do you have to show it repeatedly?

Re: Claude Memory

#275

Post by awesome_dude »

mediaman wrote: post #248
awesome_dude wrote: post #187

Earlier quoted context omitted.

I mean I am telling you what has actually worked for me so far - and being a NLP the system (should) understand what that means... as should you...

He is telling you how it mechanically works. Your comment about it “understanding what that means” because it is an NLP seems bizarre, but maybe you mean it in some other way. Are you proposing that the attention input context is gone, or that the attention mechanism’s context cost is computationally negated in some way, simply because the system processes natural language? Having the attention mechanism selectively…

I'm telling him... and you... that what I meant by the phrase is exactly how the LLM interpreted it.

For some reason that imbecile thinks that their failure to understand means they know something that's not relevant

How is it relevant what his interpretation of a sentence is if

1. His interpretation is not what I meant

2. The LLM "understood" my intent and behaved in a manner that exactly matched my desire

3. The universe was not deleted (Ok, that would be stupid... like the other individuals stupidity... but here we are)

Re: Claude Memory

#276

Post by cindyllm »

dns_snek wrote: post #252
awesome_dude wrote: post #247

Earlier quoted context omitted.

Like I said, the AI does exactly what I intend for it to do. Almost, as I said earler, like the AI has processed my request, realised that I am referring to the context of the earlier discussions, and moved on to the next prompt exactly how I have expected it to Given the two very VERY dumb responses, and multiple people down voting, I am reminded how thankful I am that AI is around now, because it understood what yo…

> I am reminded how thankful I am that AI is around now, because it understood what you clearly don't. We understand what you're saying just fine but what you're saying is simply wrong as a matter of technical fact. All of that context still exists and still degrades the output even if the model has fooled you into thinking that it doesn't. Therefore recommending it as an alternative to actually clearing the context…

[dead]

Re: Claude Memory

#277

Post by awesome_dude »

baq wrote: post #249
awesome_dude wrote: post #247

Earlier quoted context omitted.

Like I said, the AI does exactly what I intend for it to do. Almost, as I said earler, like the AI has processed my request, realised that I am referring to the context of the earlier discussions, and moved on to the next prompt exactly how I have expected it to Given the two very VERY dumb responses, and multiple people down voting, I am reminded how thankful I am that AI is around now, because it understood what yo…

I think you completely misunderstood me, actually. I explicitly say if it works, great, no sarcasm. LLMs are finicky beasts. Just keep in mind they don’t really forget anything, if you tell it to forget, the things you told it before are still taken into the matrix multiplication mincers and influence outputs just the same. Any forgetting is pretend in that your ‘please forget’ is mixed in after. But back to schedule…

No.

I think that you are misunderstanding EVERYTHING

Answer this:

1. Why would I care what the other interpretation of the wording I GAVE is?

2. What would that interpretation matter when the LLM/AI took my exact meaning and behaved correctly?

Finally - you think you "know how it works"????

Because you tried to correct me with an incorrect interpretation?

F0ff

Re: Claude Memory

#278

Post by awesome_dude »

awesome_dude wrote: post #136
corry wrote: post #27

Earlier quoted context omitted.

Strong agree. For every time that I'd get a better answer if the LLM had a bit more context on me (that I didn't think to provide, but it 'knew') there seems to be a multiple of that where the 'memory' was either actually confounding or possibly confounding the best response. I'm sure OpenAI and Antropic look at the data, and I'm sure it says that for new / unsophisticated users who don't know how to prompt, that thi…

If I find that previous prompts are polluting the responses I tell Claude to "Forget everything so far" BUT I do like that Claude builds on previous discussions, more than once the built up context has allowed Claude to improve its responses (eg. [Actual response] "Because you have previously expressed a preference for SOLID and Hexagonal programming I would suggest that you do X" which was exactly what I wanted)

Note to everyone - sharing what works leads to complete morons telling you their interpretation... which has no relevance.

Apparently they know better even though

1. They didn't issue the prompt, so they... knew what I was meaning by the phrase (obviously they don't)

2. The LLM/AI took my prompt and interpreted it exactly how I meant it, and behaved exactly how I desired.

3. They then claim that it's about "knowing exactly what's going on" ... even though they didn't and they got it wrong.

This is the advantage of an LLM - if it gets it wrong, you can tell it.. it might persist with an erroneous assumption, but you can tell it to start over (I proved that)

These "humans" however are convinced that only they can be right, despite overwhelming evidence of their stupidity (and that's why they're only JUNIORS in their fields)

Re: Claude Memory

#279

Post by awesome_dude »

logicallee wrote: post #171
awesome_dude wrote: post #136

Earlier quoted context omitted.

If I find that previous prompts are polluting the responses I tell Claude to "Forget everything so far" BUT I do like that Claude builds on previous discussions, more than once the built up context has allowed Claude to improve its responses (eg. [Actual response] "Because you have previously expressed a preference for SOLID and Hexagonal programming I would suggest that you do X" which was exactly what I wanted)

it can't really "forget everything so far" just because you ask it to. everything so far would still be part of the context. you need a new chat with memory turned off if you want a fresh context.

[flagged]

Re: Claude Memory

#280

Post by mikkupikku »

theshrike79 wrote: post #266
abustamam wrote: post #264

Earlier quoted context omitted.

I wish the LLMs would tell you exactly what the input was (system prompt, memory, etc, at least, the ones we have control over, not necessarily their system prompts) that resulted in the output. Also, out of curiosity, do you use LLMs for coding? Claude Code, Cursor, etc? I think it's a good idea to limit llm conversations to one input message but it makes me wonder how that could work with code generation given that…

The basic process is that you use a "plan mode" with whatever model is good at planning. Sometimes it's the same model, but not always. You refine your plan and go into details as much as you feel necessary. Then you switch to act mode (letting the model access the local filesystem) and tell it to write the plan to docs/ACDC1234_feature_plan.md or whatever is your system. I personally ask them to make github issues f…

I use plan mode, but then I let it go using its own todo tool and trust its auto-compaction to deal with context size. It seems to almost always work out okay.
Post reply on HN