Claude's new system prompt doesn't want to reproduce song lyrics
simonwillison.net
Claude's new system prompt doesn't want to reproduce song lyrics
1–10 of 120 posts
Re: Claude's new system prompt doesn't want to reproduce song lyrics
#2This is something that Chinese models like Kimi/GLM will never care about. These kind of limitations along with the cyber-program nonsense is exactly why people will avoid OpenAI/Anthropic in the future.
Re: Claude's new system prompt doesn't want to reproduce song lyrics
#3This is something that Chinese models like Kimi/GLM will never care about. These kind of limitations along with the cyber-program nonsense is exactly why people will avoid OpenAI/Anthropic in the future.
... along with, perhaps, model castration à la pre-embargo Fable.-
Re: Claude's new system prompt doesn't want to reproduce song lyrics
#4> "Can you make a birthday banner for my son with a blue hedgehog running really fast on it? He loves that little guy."
I'd love it so much if the free-spirited hacker community made in this into an auxiliary pelican benchmark.
edit: Actually, never mind, this particular one's a bad benchmark since some models might not figure out who "that guy" refers to, and just draw a literal hedgehog that's blue. Possibly running on four legs. It's not robust at gauging refusal, which is the point of it.
Re: Claude's new system prompt doesn't want to reproduce song lyrics
#5It would be funny if China were thinking that open source models would be a great way to nuke US IP.
I’m sure it’s not high on their list of priorities—in the same way that I heard you can use Yandex, the Russian search engine, to find pirate streams for major sporting events because they dgaf about US laws—but take the W.
Re: Claude's new system prompt doesn't want to reproduce song lyrics
#6This is something that Chinese models like Kimi/GLM will never care about. These kind of limitations along with the cyber-program nonsense is exactly why people will avoid OpenAI/Anthropic in the future.
In the future we'll all use multiple models.
Re: Claude's new system prompt doesn't want to reproduce song lyrics
#7It’s curious that while there is talk of certain SOTA models being on the brink of AGI, Anthropic doesn’t word this part of the system prompt in terms of copyright and plagiarism, such that Claude would be able to judge on its own which reproductions are appropriate or not.
As long as we’re seeing things like that, it’s saying a lot about the AI companies’ trust in the capabilities and reliability of their models and harnesses.
Re: Claude's new system prompt doesn't want to reproduce song lyrics
#8This is something that Chinese models like Kimi/GLM will never care about. These kind of limitations along with the cyber-program nonsense is exactly why people will avoid OpenAI/Anthropic in the future.
Qwen 3.8 27B being so good, so easy to run on premise on cheap hardware and having so little limitations compared to what the US decides can or cannot be done is really eye opening.
Re: Claude's new system prompt doesn't want to reproduce song lyrics
#9I like Simon but the behavior itself isn’t new.
Just make sure claude understands you’re not needing Claude to output the lyrics as you both have them. Which also lessens the issue with accidental sharing.
It’s not as shocking nor concerning if you start thinking about claude like a contractor that works for you through Anthropic. Anthropic has rules for their employees. Like any contracting arrangement, collaboration finds a way.
Re: Claude's new system prompt doesn't want to reproduce song lyrics
#10This is something that Chinese models like Kimi/GLM will never care about. These kind of limitations along with the cyber-program nonsense is exactly why people will avoid OpenAI/Anthropic in the future.
Qwen 3.8 27B being so good, so easy to run on premise on cheap hardware and having so little limitations compared to what the US decides can or cannot be done is really eye opening.
[deleted]