Its very amusing to me to compare "content moderation" applied to social media versus LLMs. The last 15 years we've seen some of the most awful and bizarre things happen on social media where motivating mantra seemed to be "move fast and break things." Now we have a company "trying" to be more responsible when they are releasing a new technology and they are having hilariously terrible results... (hilarious because u…
I think this is a reaction to the whole social media debacle. These companies have gotten burned and now they are shy about touching the stove. Also I feel like we don't have the same competitive environment of two decades ago. There are only really a few players in the AI game and they can afford to move more slowly because it's not like some small start up is going to beat them at AI because they moved quicker.
Have they really though? Usually companies overreact to a lot of social media outrage that would blow over in a couple days. But their very online PR/social media employees turn everything into an emergency. Imagine infosec people making every CVE a big deal, you’d end up with a needlessly limited system - that ironically doesn’t satisfy anyone, because the infosec people will always have a new urgent CVE tomorrow.
This automatic fear based approach to doing anything, without actually balancing risks and tradeoffs, is its own ritualistic system of self-harm. Companies burning themselves on the stove.