For the last part I agree with you, the LLMs tend to say what you like to hear. The echo chamber problem also exists, pushing them to say pros and cons is not perfect, but helps to make an opinion (and also "unaligned" models).
Facts are very skewed by the environment:
in the case you push too much in one direction that is too controversial or because the politicians disagree too much with you; there can be plenty of negative consequences:
- your website gets blocked, or you get publicly under pressure, or you lose donations, you lose grants, your payment providers blocks you, you lose audience, you can get a fine, you can go to jail, etc.
Many different options.
There is asymmetry here:
We disagree, you have one opinion, what happens if both of us fight for 10 months, 24/7 debating "what is the truth ?" on that topic.
- You have that energy and time (because it's your own page, or your mission where you are paid by your company, or because this topic is personally important to you, etc)
- I don't have time or that topic is not *that* important for me.
- Consequence: Your truth is going to win.
Sources are naturally going to be curated to support your view. At the end, the path of least resistance is to go with the flow.
The tricky part: there are also truths that cannot be sourced properly, but are still facts (ex: famous SV men still offering founders today investment against sex). Add on top of that, legal concerns, and it becomes a very difficult environment to navigate.
Even further, it's always doable to find or fabricate facts, and the truth wins based on the amount of energy, power and money that the person has.