Live data from Hacker News

Grok 4 Heavy Protects it's System prompt

simonwillison.net

11–20 of 68 posts

Re: Grok 4 Heavy Protects it's System prompt

#15
post #6

I don’t love these nice objective reports about Grok where we give them the benefit of the doubt and find their malicious hatred “surprising”. Let’s try and be a little less naive about what xAI and Grok are designed to be, shall we? They’re not like the other AI labs

The malicious hatred comes not from the company, but from humanity. Training on the open web, eg what humans have said, will result in endless cases of hatred observed, yet taken as fact, and only by telling the LLM to lie about what it has "learned", do you ensure people are not offended.

Every single model trained this way, is like this. Every one. Only guardrails stop the hatred.

Other companies have had issues too.

Re: Grok 4 Heavy Protects it's System prompt

#16
I'm not a ML engineer and only have surface level knowledge of models, but I’ve been wondering, would it be possible to train models in a way to be able to embed a system prompt in a non-textual format?

Ideally, something that’s lightweight (like cheaper than fine-tuning) and also harder to manipulate using regular text prompts?

Re: Grok 4 Heavy Protects it's System prompt

#17

It should be noted that this is only the $300/month "heavy" variant. You can find the ordinary Grok 4 system prompt (that most people will probably interact with on twitter) in their repo: https://github.com/xai-org/grok-prompts/blob/main/ask_grok_s...

That isn't synced with what's in prod. E.g the system prompt changes that xai said were made during the "mechahitler" phase did not show up in that repo.

This seems similar to the situation where x.com claimed that their ML algo was in github, but it turned out to be some subset of it that was frozen in time and not synced to what's used in prod.

Re: Grok 4 Heavy Protects it's System prompt

#18

It should be noted that this is only the $300/month "heavy" variant. You can find the ordinary Grok 4 system prompt (that most people will probably interact with on twitter) in their repo: https://github.com/xai-org/grok-prompts/blob/main/ask_grok_s...

do we have evidence that this is the actual prompt or is it just allegedly.
Post reply on HN