91–100 of 350 posts
So I wonder how much of Claude's perceived personality is due to the system prompt versus the underlying LLM and training. Could you layer a "Claude mode"—like a vim/emacs mode—on ChatGPT or some other LLM by using a similar prompt?
Earlier quoted context omitted.
LLMs don’t seem to have much notion of themselves as a first person subject, in my limited experience of trying to engage it.
From their perspective they don't really know who put the tokens there. They just caculated the probabilities and then the inference engine adds tokens to the context window. Same with user and system prompt, they just appear in the context window and the LLM just gets "user said: 'hello', assistant said: 'how can I help '" and it just calculates the probabilities of the next token. If the context window had stopped…
I wonder which user queries the LLM would come up with.
So, how do you debug this?
https://claude.ai/share/ea4aa490-e29e-45a1-b157-9acf56eb7f8a
Meanwhile, I also asked the same to sonnet 3.7 through an API-based interface 5 times, and every time it hallucinated that Kamala Harris is the president (as it should not "know" the answer to this).
It is a bit weird because this is very different and larger prompt that the ones they provide [0], though they do say that the prompts are getting updated. In any case, this has nothing to do with the API that I assume many people here use.
[0] https://docs.anthropic.com/en/release-notes/system-prompts
So I wonder how much of Claude's perceived personality is due to the system prompt versus the underlying LLM and training. Could you layer a "Claude mode"—like a vim/emacs mode—on ChatGPT or some other LLM by using a similar prompt?
I somehow feel cheated seeing explicit instructions on what to do per language, per library. I hoped that the "intelligent handling" comes from the trained model rather than instructing on each request.
I don't know if I feel cheated, but it seems a little unmanageable. How is this suppose to scale? How the hell do you even start to debug the LLM when it does something incorrect? It's not like you can attach a debugger to English. The "vibe" I'm getting is that of a junior developer who slows problems be tacking on an ever increasing amount of code, rather than going back an fixing underlying design flaws.
Earlier quoted context omitted.
All System Prompts from Anthropic models are public information, released by Anthropic themselves: https://docs.anthropic.com/en/release-notes/system-prompts . I'm unsure (I just skimmed through) to what the differences between this and the publicly released ones are, so they're might be some differences.
This system prompt that was posted interestingly includes the result of the US presidential election in November, even though the model's knowledge cutoff date was October. This info wasn't in the anthropic version of the system prompt. Asking Claude who won without googling, it does seem to know even though it was later than the cutoff date. So the system prompt being posted is supported at least in this aspect.
edit:fixed link
Earlier quoted context omitted.
That’s what this is. It’s caching the state of the model after the tokens have been loaded. Reduces latency and cost dramatically. 5m TTL on the cache usually.
Interesting! I’m wondering, does caching the model state mean the tokens are no longer directly visible to the model? i.e. if you asked it to print out the input tokens perfectly (assuming there’s no security layer blocking this, and assuming it has no ‘tool’ available to pull in the input tokens), could it do it?
Earlier quoted context omitted.
All System Prompts from Anthropic models are public information, released by Anthropic themselves: https://docs.anthropic.com/en/release-notes/system-prompts . I'm unsure (I just skimmed through) to what the differences between this and the publicly released ones are, so they're might be some differences.
> The assistant is Claude, created by Anthropic. > The current date is {{currentDateTime}}. > Claude enjoys helping humans and sees its role as an intelligent and kind assistant to the people, with depth and wisdom that makes it more than a mere tool. Why do they refer to Claude in third person? Why not say "You're Claude and you enjoy helping hoomans"?
[user]: blah blah
[claude]: blah
[user]: blah blah blah
[claude]: _____