Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude's system prompt is over 24k tokens with tools

github.com

Post reply on HN
Print view View original

331–340 of 350 posts

Re: Claude's system prompt is over 24k tokens with tools

#331

Post by int_19h »

zeroonetwothree wrote: post #330
int_19h wrote: post #329

Earlier quoted context omitted.

Of course it can. Reasoning is algorithmic in nature, and algorithms can be encoded as sufficiently large state transition tables. I don't buy into Searle's "it can't reason because of course it can't" nonsense.

It can do something but I wouldn’t call it reasoning. IMO a reasoning algorithmic must be more complex than a lookup table.

We were talking about a "sufficiently large" table, which means that it can be larger than realistic hardware allows for. Any algorithm operating on bounded memory can be ultimately encoded as a finite state automaton with the table defining all valid state transitions.

Re: Claude's system prompt is over 24k tokens with tools

#332

Post by [deleted] »

Tadpole9181 wrote: post #328
BalinKing wrote: post #244

Earlier quoted context omitted.

There's a massive difference between "I have no reason to believe you are anything but a stochastic parrot" and "you are a stochastic parrot".

Then I'll just say you are a stochastic parrot. Again, solipsism is not a new premise. The philosophical zombie argument has been around over 50 years now.

[deleted]

Re: Claude's system prompt is over 24k tokens with tools

#333

Post by Tadpole9181 »

lanstin wrote: post #300
johnthewise wrote: post #233

Earlier quoted context omitted.

A perfect next token predictor is equivalent to god

Not really - even my kids knew enough to interrupt my stream of words with running away or flinging the food from the fork.

That's entirely an implementation limitation from humans. There's no reason to believe a reasoning model could NOT be trained to stream multimodal input and perform a burst of reasoning on each step, interjecting when it feels appropriate.

We simply haven't.

Re: Claude's system prompt is over 24k tokens with tools

#335

Post by cududa »

rvz wrote: post #152
turing_complete wrote: post #74

Interesting. I always ask myself: How do we know this is authentic?

Come back in a few months to see this repo taken down by Anthropic.

It’s already down. Did you happen to save it? I’m just coming across it

Re: Claude's system prompt is over 24k tokens with tools

#338

Post by nitwit005 »

nonethewiser wrote: post #124
freehorse wrote: post #95

I was a bit skeptical, so I asked the model through the claude.ai interface "who is the president of the United States" and its answer style is almost identical to the prompt linked https://claude.ai/share/ea4aa490-e29e-45a1-b157-9acf56eb7f8a Meanwhile, I also asked the same to sonnet 3.7 through an API-based interface 5 times, and every time it hallucinated that Kamala Harris is the president (as it should not "know…

I wonder why it would hallucinate Kamala being the president. Part of it is obviously that she was one of the candidates in 2024. But beyond that, why? Effectively a sentiment analysis maybe? More positive content about her? I think most polls had Trump ahead so you would have thought he'd be the guess from that perspective.

Their name may simply be the most common thing in the training data that follows "president". They were generally labeled "vice president", after all.

Re: Claude's system prompt is over 24k tokens with tools

#339

Post by tomhow »

moralestapia wrote: post #46

[flagged]

> HAHAHAHA

> What a load of crap

Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something.

Please don't fulminate. Please don't sneer

Please don't use uppercase for emphasis.

https://news.ycombinator.com/newsguidelines.html

Re: Claude's system prompt is over 24k tokens with tools

#340

Post by otabdeveloper4 »

int_19h wrote: post #296
otabdeveloper4 wrote: post #167

Earlier quoted context omitted.

By "rigorous" I mean peeking under the curtain and actually quantifying the interactions between different system prompts and model weights. "Chain of thought" and "reasoning" is marketing bullshit.

How would you quantify it? The LM is still a black box, we don't know what most of those weights actually do.

Yes, that was my question.
Post reply on HN