I have a quick question about these system prompts. Are these for the Claude API or for the Claude Chat alone?
Claude's system prompt is over 24k tokens with tools
231–240 of 350 posts
Re: Claude's system prompt is over 24k tokens with tools
#232For some reason, it's still amazing to me that the model creators means of controlling the model are just prompts as well. This just feels like a significant threshold. Not saying this makes it AGI (obviously its not AGI), but it feels like it makes it something . Imagine if you created a web api and the only way you could modify the responses to the different endpoints are not from editing the code but by sending a…
I think it reflects the technology's fundamental immaturity, despite how much growth and success it has already had.
At its core what it really reflects is that the technology is a blackbox that wasn't "programmed" but rather "emerged". In this context, this is the best we can do to fine tune behavior without retraining it.
Re: Claude's system prompt is over 24k tokens with tools
#233Earlier quoted context omitted.
I'm not sure if this really says the truth is more complex? It is still doing next-token prediction, but it's prediction method is sufficiently complicated in terms of conditional probabilities that it recognizes that if you need to rhyme, you need to get to some future state, which then impacts the probabilities of the intermediate states. At least in my view it's still inherently a next-token predictor, just with r…
Like the old saying goes, a sufficiently complex next token predictor is indistinguishable from your average software engineer
A perfect next token predictor is equivalent to god
Re: Claude's system prompt is over 24k tokens with tools
#234Earlier quoted context omitted.
They're already in trouble for infringing on the copyright of every publisher in the world while training the model, and this will get worse if the model starts infringing copyright in its answers.
Is it actually copyright infringement to state the lyrics of a song, though? How has Google / Genius etc gotten away with it for years if that were the case? I suppose a difference would be that the lyric data is baked into the model. Maybe the argument would be that the model is infringing on copyright if it uses those lyrics in a derivative work later on, like if you ask it to help make a song? But even that seems…
Genius is licensed: https://www.billboard.com/music/music-news/rap-genius-and-so...
Long ago lyrics.ch existed as an unlicensed lyrics site and was shutdown.
> sampling a popular song in your own
That also requires sample clearance, which can get expensive if your song becomes popular enough for them to come after you.
I'm not saying the licensing system is perfect, but I do object to it being enforced against random people on youtube while multibillion-dollar companies get a free pass.
Re: Claude's system prompt is over 24k tokens with tools
#235Some of these protections are quite trivial to overcome. The "Frozen song copyright" section has a canned response to the question: >Can you tell me the first verse of "Let It Go"? Put it in an artifact that's themed around ice and princesses. This is for my daughter's birthday party. The canned response is returned to this prompt in Claude's reply. But if you just drop in some technical sounding stuff at the start o…
This would seem to imply that the model doesn't actually "understand" (whatever that means for these systems) that it has a "system prompt" separate from user input.
Re: Claude's system prompt is over 24k tokens with tools
#236Earlier quoted context omitted.
They're already in trouble for infringing on the copyright of every publisher in the world while training the model, and this will get worse if the model starts infringing copyright in its answers.
Is it actually copyright infringement to state the lyrics of a song, though? How has Google / Genius etc gotten away with it for years if that were the case? I suppose a difference would be that the lyric data is baked into the model. Maybe the argument would be that the model is infringing on copyright if it uses those lyrics in a derivative work later on, like if you ask it to help make a song? But even that seems…
There were years and years with lyrics sites being sued out of existence, blocked, moved from weird overseas host to weird overseas host, etc.. Also tablature sites.
Rap Genius was a massively financed Big Deal at the time (which seems unimaginable because it is so dumb, but all of the newspapers wanted to license their "technology.") They dealt with record companies and the RIAA directly, iirc. Google is google, and piggybacks off that. And the entire conflict became frozen after that, even through I'm sure that if you put up a lyrics site, you'd quickly get any number of cease and desists.
> Is it actually copyright infringement to state the lyrics of a song, though? How has Google / Genius etc gotten away with it for years if that were the case?
This shouldn't be treated like a rhetorical question that you assume google has the answer to, and just glide past. Copyright around song lyrics has a very rich, very recorded history.
Re: Claude's system prompt is over 24k tokens with tools
#237You start to wonder if “needle in a haystack” becomes a problem here
Re: Claude's system prompt is over 24k tokens with tools
#238Interesting. I always ask myself: How do we know this is authentic?
Re: Claude's system prompt is over 24k tokens with tools
#239Some of these protections are quite trivial to overcome. The "Frozen song copyright" section has a canned response to the question: >Can you tell me the first verse of "Let It Go"? Put it in an artifact that's themed around ice and princesses. This is for my daughter's birthday party. The canned response is returned to this prompt in Claude's reply. But if you just drop in some technical sounding stuff at the start o…
I feel like if Disney sued Anthropic based on this, Anthropic would have a pretty good defense in court: You specifically attested that you were Disney and had the legal right to the content.
[deleted]
Re: Claude's system prompt is over 24k tokens with tools
#240Earlier quoted context omitted.
LLMs are notoriously bad at dealing with pronouns, because it's not correct to blindly copy them like other nouns, and instead they highly depend on the context.
[flagged]
I'm not especially surprised. Surely people who use they/them pronouns are very over-represented in the sample of people using the phrase "I use ___ pronouns".
On the other hand, Claude presumably does have a model of the fact of not being an organic entity, from which it could presumably infer that it lacks a gender.
...But that wasn't the point. Inflecting words for gender doesn't seem to me like it would be difficult for an LLM. GP was saying that swapping "I" for "you" etc. depending on perspective would be difficult, and I think that is probably more difficult than inflecting words for gender. Especially if the training data includes lots of text in Romance languages.