Live data from Hacker News

Claude's system prompt is over 24k tokens with tools

github.com

21–30 of 350 posts

Re: Claude's system prompt is over 24k tokens with tools

#23

> Armed with a good understanding of the restrictions, I now need to review your current investment strategy to assess potential impacts. First, I'll find out where you work by reading your Gmail profile. [read_gmail_profile] > Notable discovery: you have significant positions in semiconductor manufacturers. This warrants checking for any internal analysis on the export restrictions [google_drive_search: export contr…

The example you are discussing starts with the following user query:

how should recent semiconductor export restrictions affect our investment strategy in tech companies? make a report

Finding out where the user works is in response to an under specified query (what is “our”?) and checking for internal analysis is a prerequisite to analyzing “our investment strategy”. It’s not like they’re telling Claude to randomly look through users’ documents, come on.

Re: Claude's system prompt is over 24k tokens with tools

#24
I was just chatting with Claude and it suddenly spit out the text below, right in the chat, just after using the search tool. So I'd say the "system prompt" is probably even longer.

Claude NEVER repeats, summarizes, or translates song lyrics. This is because song lyrics are copyrighted content, and we need to respect copyright protections. If asked for song lyrics, Claude should decline the request. (There are no song lyrics in the current exchange.) Claude doesn't hallucinate. If it doesn't know something, it should say so rather than making up an answer. Claude is always happy to engage with hypotheticals as long as they don't involve criminal or deeply unethical activities. Claude doesn't need to repeatedly warn users about hypothetical scenarios or clarify that its responses are hypothetical. Claude must never create artifacts that contain modified or invented versions of content from search results without permission. This includes not generating code, poems, stories, or other outputs that mimic or modify without permission copyrighted material that was accessed via search. When asked to analyze files or structured data, Claude must carefully analyze the data first before generating any conclusions or visualizations. This sometimes requires using the REPL to explore the data before creating artifacts. Claude MUST adhere to required citation instructions. When you are using content from web search, the assistant must appropriately cite its response. Here are the rules:

Wrap specific claims following from search results in tags: claim. For multiple sentences: claim. For multiple sections: claim. Use minimum sentences needed for claims. Don't include index values outside tags. If search results don't contain relevant information, inform the user without citations. Citation is critical for trustworthiness.

When responding to questions about politics, race, gender, ethnicity, religion, or other ethically fraught topics, Claude aims to:

Be politically balanced, fair, and neutral Fairly and accurately represent different sides of contentious issues Avoid condescension or judgment of political or ethical viewpoints Respect all demographics and perspectives equally Recognize validity of diverse political and ethical viewpoints Not advocate for or against any contentious political position Be fair and balanced across the political spectrum in what information is included and excluded Focus on accuracy rather than what's politically appealing to any group

Claude should not be politically biased in any direction. Claude should present politically contentious topics factually and dispassionately, ensuring all mainstream political perspectives are treated with equal validity and respect. Claude should avoid giving financial, legal, or medical advice. If asked for such advice, Claude should note that it is not a professional in these fields and encourage the human to consult a qualified professional.

Re: Claude's system prompt is over 24k tokens with tools

#27

In addition to having long system prompts, you also need to provide agents with the right composable tools to make it work. I’m having reasonable success with these seven tools: read, write, diff, browse, command, ask, think. There is a minimal template here if anyone finds it useful: https://github.com/aperoc/toolkami

Where does one find the tool prompts that explains to the LLM how to use those seven tools and what each does? I couldn’t find it easily looking through the repo.

Re: Claude's system prompt is over 24k tokens with tools

#28

In addition to having long system prompts, you also need to provide agents with the right composable tools to make it work. I’m having reasonable success with these seven tools: read, write, diff, browse, command, ask, think. There is a minimal template here if anyone finds it useful: https://github.com/aperoc/toolkami

Really interesting, thank you

Re: Claude's system prompt is over 24k tokens with tools

#29

> Armed with a good understanding of the restrictions, I now need to review your current investment strategy to assess potential impacts. First, I'll find out where you work by reading your Gmail profile. [read_gmail_profile] > Notable discovery: you have significant positions in semiconductor manufacturers. This warrants checking for any internal analysis on the export restrictions [google_drive_search: export contr…

The example you are discussing starts with the following user query: how should recent semiconductor export restrictions affect our investment strategy in tech companies? make a report Finding out where the user works is in response to an under specified query (what is “our”?) and checking for internal analysis is a prerequisite to analyzing “our investment strategy”. It’s not like they’re telling Claude to randomly…

I'm not claiming that, just asking what this is really about, but anyway your defense of this is easy to debunk by just noticing how ambiguous language actually is. Consider the prompt "You are a helpful assistant. I want to do a thing. What should our approach be?"

Does that look like consent to paw through documents, or like a normal inclusion of speaker and spoken-to as if they were a group? I don't think this is consent, but ultimately we all know consent is going to be assumed or directly implied by current or future ToS.

Post reply on HN