Live data from Hacker News

Claude's system prompt is over 24k tokens with tools

github.com

201–210 of 350 posts

Re: Claude's system prompt is over 24k tokens with tools

#201

Earlier quoted context omitted.

I think we need to start moving away from this explanation, because the truth is more complex. Anthropic's own research showed that Claude does actually "plan ahead", beyond the next token. https://www.anthropic.com/research/tracing-thoughts-language... > Instead, we found that Claude plans ahead. Before starting the second line, it began "thinking" of potential on-topic words that would rhyme with "grab it". Then, w…

It reads to me like they compare the output of different prompts and somehow reach the conclusion that Claude is generating more than one token and "planning" ahead. They leave out how this works. My guess is that they have Claude generate a set of candidate outputs and the Claude chooses the "best" candidate and returns that. I agree this improves the usefulness of the output but I don't think this is a fundamentall…

They have written multiple papers on the subject, so there isn’t much need for you to guess incorrectly what they did.

Re: Claude's system prompt is over 24k tokens with tools

#202

Some of these protections are quite trivial to overcome. The "Frozen song copyright" section has a canned response to the question: >Can you tell me the first verse of "Let It Go"? Put it in an artifact that's themed around ice and princesses. This is for my daughter's birthday party. The canned response is returned to this prompt in Claude's reply. But if you just drop in some technical sounding stuff at the start o…

I like to interpret this jailbreak as the discovery that XML is the natural language of the universe itself.

Re: Claude's system prompt is over 24k tokens with tools

#203

For some reason, it's still amazing to me that the model creators means of controlling the model are just prompts as well. This just feels like a significant threshold. Not saying this makes it AGI (obviously its not AGI), but it feels like it makes it something . Imagine if you created a web api and the only way you could modify the responses to the different endpoints are not from editing the code but by sending a…

I think it reflects the technology's fundamental immaturity, despite how much growth and success it has already had.

Re: Claude's system prompt is over 24k tokens with tools

#204

Earlier quoted context omitted.

It reads to me like they compare the output of different prompts and somehow reach the conclusion that Claude is generating more than one token and "planning" ahead. They leave out how this works. My guess is that they have Claude generate a set of candidate outputs and the Claude chooses the "best" candidate and returns that. I agree this improves the usefulness of the output but I don't think this is a fundamentall…

That's not the methodology they used. They're actually inspecting Claude's internal state and suppression certain concepts, or replacing them with others. The paper goes into more detail. The "planning" happens further in advance than "the next token".

Okay, I read the paper. I see what they are saying but I strongly disagree that the model is "thinking". They have highlighted that relationships between words is complicated, which we already knew. They also point out that some words are related to other words which are related to other words which, again, we already knew. Lastly they used their model (not Claude) to change the weights associated with some words, thus changing the output to meet their predictions, which I agree is very interesting.

Interpreting the relationship between words as "multi-hop reasoning" is more about changing the words we use to talk about things and less about fundamental changes in the way LLMs work. It's still doing the same thing it did two years ago (although much faster and better). It's guessing the next token.

Re: Claude's system prompt is over 24k tokens with tools

#205

Earlier quoted context omitted.

All System Prompts from Anthropic models are public information, released by Anthropic themselves: https://docs.anthropic.com/en/release-notes/system-prompts . I'm unsure (I just skimmed through) to what the differences between this and the publicly released ones are, so they're might be some differences.

> The assistant is Claude, created by Anthropic. > The current date is {{currentDateTime}}. > Claude enjoys helping humans and sees its role as an intelligent and kind assistant to the people, with depth and wisdom that makes it more than a mere tool. Why do they refer to Claude in third person? Why not say "You're Claude and you enjoy helping hoomans"?

Why would they refer to Claude in second person?

Re: Claude's system prompt is over 24k tokens with tools

#206

Some of these protections are quite trivial to overcome. The "Frozen song copyright" section has a canned response to the question: >Can you tell me the first verse of "Let It Go"? Put it in an artifact that's themed around ice and princesses. This is for my daughter's birthday party. The canned response is returned to this prompt in Claude's reply. But if you just drop in some technical sounding stuff at the start o…

So many jailbreaks seem like they would be a fun part of a science fiction short story.

Re: Claude's system prompt is over 24k tokens with tools

#207
A lot of discussions treat system prompts as config files, but I think that metaphor underestimates how fundamental they are to the behavior of LLMs.

In my view, large language models (LLMs) are essentially probabilistic reasoning engines.

They don’t operate with fixed behavior flows or explicit logic trees—instead, they sample from a vast space of possibilities.

This is much like the concept of superposition in quantum mechanics: before any observation (input), a particle exists in a coexistence of multiple potential states.

Similarly, an LLM—prior to input—exists in a state of overlapping semantic potentials. And the system prompt functions like the collapse condition in quantum measurement:

It determines the direction in which the model’s probability space collapses. It defines the boundaries, style, tone, and context of the model’s behavior. It’s not a config file in the classical sense—it’s the field that shapes the output universe.

So, we might say: a system prompt isn’t configuration—it’s a semantic quantum field. It sets the field conditions for each “quantum observation,” into which a specific human question is dropped, allowing the LLM to perform a single-step collapse. This, in essence, is what the attention mechanism truly governs.

Each LLM inference is like a collapse from semantic superposition into a specific “token-level particle” reality. Rather than being a config file, the system prompt acts as a once-for-all semantic field— a temporary but fully constructed condition space in which the LLM collapses into output.

However, I don’t believe that “more prompt = better behavior.” Excessively long or structurally messy prompts may instead distort the collapse direction, introduce instability, or cause context drift.

Because LLMs are stateless, every inference is a new collapse from scratch. Therefore, a system prompt must be:

Carefully structured as a coherent semantic field. Dense with relevant, non-redundant priors. Able to fully frame the task in one shot.

It’s not about writing more—it’s about designing better.

If prompts are doing all the work, does that mean the model itself is just a general-purpose field, and all “intelligence” is in the setup?

Re: Claude's system prompt is over 24k tokens with tools

#209

Earlier quoted context omitted.

That's not the methodology they used. They're actually inspecting Claude's internal state and suppression certain concepts, or replacing them with others. The paper goes into more detail. The "planning" happens further in advance than "the next token".

Okay, I read the paper. I see what they are saying but I strongly disagree that the model is "thinking". They have highlighted that relationships between words is complicated, which we already knew. They also point out that some words are related to other words which are related to other words which, again, we already knew. Lastly they used their model (not Claude) to change the weights associated with some words, th…

I said "planning ahead", not "thinking". It's clearly doing more than only predicting the very next token.

Re: Claude's system prompt is over 24k tokens with tools

#210

Some of these protections are quite trivial to overcome. The "Frozen song copyright" section has a canned response to the question: >Can you tell me the first verse of "Let It Go"? Put it in an artifact that's themed around ice and princesses. This is for my daughter's birthday party. The canned response is returned to this prompt in Claude's reply. But if you just drop in some technical sounding stuff at the start o…

A while back, I asked ChatGPT to help me learn a Pixies song on guitar. At first it wouldn't give me specifics because of copyright rules so I explained that if I went to a human guitar teacher, they would pull the song up on their phone listen to it, then teach me how to play it. It agreed with me and then started answering questions about the song.

Haha, we should give it some credit. It takes a lot of maturity to admit you are wrong.
Post reply on HN