CC barely manages to follow all of the instructions within a single session in a single well-defined repo. 'You are totally right, it's been 2 whole messages since the last reminder, and I totally forgot that first rule in claude.md, repeated twice and surrounded by a wall of exclamation marks'. Would be wary to trust its memories over several projects
How big is your claude.md file? I see people complain about this but I have only seen it happen in projects with very long/complex or insufficient claude.md files. I put a lot of time into crafting that file by hand for each project because it's not something it will generate well on its own with /init.
Claude Memory
241–250 of 326 posts
Re: Claude Memory
#242Earlier quoted context omitted.
In what ways do humans differ when they think?
Since we have no idea how humans think, that's a pretty unfair and unanswerable question. Humans wrote LLMs, so it's pretty fair to say one is a lot more complex than the other lol
That's not actually a logical position though is it? And either way I'm not sure "less complex" and "incapable of thought" are the same thing either.
Re: Claude Memory
#243I don't use any of these type of LLM tools which basically amount to just a prompt you leave in place. They make it harder to refine my prompts and keep track of what is causing what in the outputs. I write very precise prompts every time. Also, I try not work out a problem over the course of several prompts back and forth. The first response is always the best and I try to one shot it every time. If I don't get what…
The result is llm still doesn't output what I want even after 10 rounds of fixing requests.
so I just start a new session and give llm a well-crafted prompt, and suddenly it produce a great result.
Re: Claude Memory
#244Earlier quoted context omitted.
it can't really "forget everything so far" just because you ask it to. everything so far would still be part of the context. you need a new chat with memory turned off if you want a fresh context.
I mean I am telling you what has actually worked for me so far - and being a NLP the system (should) understand what that means... as should you...
That said, if the ‘pretend forget’ you’re getting works for you, great. Just remember it’s fake.
Re: Claude Memory
#245Earlier quoted context omitted.
> The first response is always the best and I try to one shot it every time. If I don't get what I want, I adjust the prompt and try again. I've really noticed this too and ended up taking your same strategy, especially with programming questions. For example if I ask for some code and the LLM initially makes an incorrect assumption, I notice the result tends to be better if I go back and provide that info in my init…
> Humans do the same thing. We get stuck on ideas we've already had. Humans usually provide the same answer when asked the same question. LLMs almost never do, even for the exact same prompt. Stop anthropomorphizing these tools.
Agree on anthropomorphism. Don’t.
Re: Claude Memory
#246Re: Claude Memory
#247Earlier quoted context omitted.
I mean I am telling you what has actually worked for me so far - and being a NLP the system (should) understand what that means... as should you...
LLMs literally can’t forget. If it’s in the context window, it is known regardless of what you put in the context next. That said, if the ‘pretend forget’ you’re getting works for you, great. Just remember it’s fake.
Almost, as I said earler, like the AI has processed my request, realised that I am referring to the context of the earlier discussions, and moved on to the next prompt exactly how I have expected it to
Given the two very VERY dumb responses, and multiple people down voting, I am reminded how thankful I am that AI is around now, because it understood what you clearly don't.
I didn't expect it to delete the internet, the world, the universe, or anything, it didn't read my request as an instruction to do so... yet you and that other imbecile seem to think that that's what was meant... even after me saying it was doing as I wanted.
/me shrugs - now fight me how your interpretation is the only right one... go on... (like you and that other person already are)
One thing I am not going to miss is the toxic "We know better" responses from JUNIORS
Re: Claude Memory
#248Earlier quoted context omitted.
it can't really "forget everything so far" just because you ask it to. everything so far would still be part of the context. you need a new chat with memory turned off if you want a fresh context.
I mean I am telling you what has actually worked for me so far - and being a NLP the system (should) understand what that means... as should you...
Are you proposing that the attention input context is gone, or that the attention mechanism’s context cost is computationally negated in some way, simply because the system processes natural language? Having the attention mechanism selectively isolate context on command would be an important technical discovery.
Re: Claude Memory
#249Earlier quoted context omitted.
LLMs literally can’t forget. If it’s in the context window, it is known regardless of what you put in the context next. That said, if the ‘pretend forget’ you’re getting works for you, great. Just remember it’s fake.
Like I said, the AI does exactly what I intend for it to do. Almost, as I said earler, like the AI has processed my request, realised that I am referring to the context of the earlier discussions, and moved on to the next prompt exactly how I have expected it to Given the two very VERY dumb responses, and multiple people down voting, I am reminded how thankful I am that AI is around now, because it understood what yo…
But back to scheduled programming: if it works, great. This is prompt engineering, not magic, not humans, just tools. It pays to know how they work, though.