My parents were tricked the other day by a fake youtube video of "racist cop" doing something bad and getting outraged by it. I watch part of the video and even though it felt off I couldn't immediately tell for sure if it was fake or not. Nevertheless I googled the names and details and found nothing but repostings of the video. Then I looked at the youtube channel info and there it said it uses AI for "some" of the…
I think people will eventually learn to not trust any videos or stories they see online. I think the much bigger issue will be what happens when the LLM providers encode "alignment" into the models to insist on certain worldviews, opinions, or even falsehoods. Trust in LLMs and usage of them is increasing. "Great question! No, we have always been at war with Eurasia. Can I help with anything else?"
If I just feed it to 10 pandas, today, they're all dead.
And I suspect that humanity's position in this analogy is far closer to the latter than the former.