Earlier quoted context omitted.
Couldn't "proving to them that the LLMs are far from perfect" be accomplished by showing a few examples of LLM hallucination? This does not seem very difficult.
A significant portion of the American population doesn't accept the results of the 2020 election. No amount of proof will change their mind. Everyone alive has been exposed for decades to both sci-fi tropes and media hype around AI, and the ideas that stick in their heads tend to be those repeated and reinforced by media, not by direct experience. When LLMs get rolled out to everyday users who aren't experts it will…
This is different. There's obvious bias here. Many people don't want to believe the election is legit because of team and group mentality. People tend to believe what they want. Additionally, people can't "see" the results. It can't fully be proven because there is always a layer of indirection here where you need to trust a potential compromised source. From the perspective of the public what happened during the election can only be ascertained through a network of indirect sources so it's convenient for people to assume any one of those sources is compromised in a way such that the conclusion is closer to the one they desire.
For chatGPT seeing is believing. You can see the thing hallucinates right in front of your freaking eyes. There is no layer of indirection. There is no room for someone to lie to themselves. Additionally, the bias for chatGPT is actually in the other direction. Nobody wants to believe that an AI can trivialize their skill set. People would rather believe chatGPT is garbage because that is what they prefer to believe.
In fact I would argue this exact bias is the thing effecting many people right now. The same type of biases that make people believe the trump votes are rigged are the same type of biases that prevent people from even considering the fact that an LLM is more than just a stochastic parrot. They don't want to believe it... So they don't.