Claude's system prompt is over 24k tokens with tools
1–10 of 350 posts
Re: Claude's system prompt is over 24k tokens with tools
#2As seen on r/LocalLlaMA here: https://www.reddit.com/r/LocalLLaMA/comments/1kfkg29/
For what it's worth I pasted this into a few tokenizers and got just over 24k tokens. Seems like an enormously long manual of instructions, with a lot of very specific instructions embedded...
Re: Claude's system prompt is over 24k tokens with tools
#3Maybe therein is why it rarely follows my own project prompt instructions. I tell it to give me the whole code (no snippets), and not to make up new features, and it still barfs up refactoring and "optimizations" I didn't ask for, as well as "Put this into your script" with no specifics where the snippet lives.
Single tasks that are one-and-done are great, but when working on a project, it's exhausting the amount it just doesn't listen to you.
Re: Claude's system prompt is over 24k tokens with tools
#4is this claude the app or the api?
Re: Claude's system prompt is over 24k tokens with tools
#5do tools like cursor get a special pass? Or do they do some magic?
I'm always amazed at how well they deal with diffs. especially when the response jank clearly points to a "... + a change", and cursor maps it back to a proper diff.
Re: Claude's system prompt is over 24k tokens with tools
#6As seen on r/LocalLlaMA here: https://www.reddit.com/r/LocalLLaMA/comments/1kfkg29/ For what it's worth I pasted this into a few tokenizers and got just over 24k tokens. Seems like an enormously long manual of instructions, with a lot of very specific instructions embedded...
I think it’s feasible because of their token prefix prompt caching, available to everyone via API: https://docs.anthropic.com/en/docs/build-with-claude/prompt-...
Re: Claude's system prompt is over 24k tokens with tools
#7> Armed with a good understanding of the restrictions, I now need to review your current investment strategy to assess potential impacts. First, I'll find out where you work by reading your Gmail profile. [read_gmail_profile]
> Notable discovery: you have significant positions in semiconductor manufacturers. This warrants checking for any internal analysis on the export restrictions [google_drive_search: export controls]
Oh that's not creepy. Are these supposed to be examples of tools usage available to enterprise customers or what exactly?
Re: Claude's system prompt is over 24k tokens with tools
#8do tools like cursor get a special pass? Or do they do some magic? I'm always amazed at how well they deal with diffs. especially when the response jank clearly points to a "... + a change", and cursor maps it back to a proper diff.
Cursor for instance does lots of tricks to make applying janky diffs efficient, e.g. https://blog.getbind.co/2024/10/02/how-cursor-ai-implemented...
Re: Claude's system prompt is over 24k tokens with tools
#9my lord … does it work as some rule file?
Re: Claude's system prompt is over 24k tokens with tools
#10I like how there are IFs and ELSE IFs but those logical constructs aren't actually explicitly followed...
and inside the IF instead of a dash as a bullet point there's an arrow.. that's the _syntax_? hah.. what if there were two lines of instructions, you'd make a new line starting with another arrow..?
Did they try some form of it without IFs first?...