Earlier quoted context omitted.
I don't want to look for the source of analysis right now, but I recall reading a study demonstrating that a large part, if not most of the word frequency shift was caused by RLHF training done on data predominantly generated by people hired from lower income English-speaking countries which simply have a different dialect of English with a noticeably different frequency of certain phrases and expressions, so e.g. at…
There wasn't a study or analysis. It was just lazy speculation that felt good because it could be bound up in a "evil white countries exploiting the developing world" narrative. Where exploiting was "paying to do a job". It was submitted as https://news.ycombinator.com/item?id=40623629 Again, there is effectively zero real data showing this. Further, RLHF isn't likely to reinforce such word selection regardless. A mo…
typical people prefer to pretend this is simply "order" and "progress"; seemingly blind to their own ideological baggage like fish in water