11–20 of 84 posts
Earlier quoted context omitted.
I would suspect during pre-training. Even before RLHF was a thing models exhibited this bias. My bet is that it has to do with the training data corpora being composed in large part of left leaning content, maybe from social media platforms like reddit.
Is it possible that facts and reality lean left? It's not a mathematical equation, there is no requirement for the average to be zero.
Any idea where this bias creeps in? During pre-training or RLHF?
Reality has a left wing bias. That's a quote from something. Not sure I agree necessarily, but a plausible explanation.
I wonder what they did to Grok. The bimodal distribution makes me think it was just a system prompt and not a completely different set of right-wing training data. A 4chan trained LLM would probably actually be auth right.
When you're looking at text that deals with small-scale phenomena like coding, next token prediction also leads to functionality prediction, because coding provides immediate feedback to those who are writing about it, so they generally provide correct commentary on it.
But the feedback loop between outcome and prediction totally breaks down when the phenomenon is very large and complex. People can have all sorts of ideas about religion and society and economics that are totally wrong and never grow any wiser because there is no obvious causal chain between one policy or action and one outcome in these kind of phenomenon.
Reality has a left wing bias. That's a quote from something. Not sure I agree necessarily, but a plausible explanation.