Code is law, proof is reality, compliance is existence!
Bad Actors Are Grooming LLMs to Produce Falsehoods
21–30 of 302 posts
Re: Bad Actors Are Grooming LLMs to Produce Falsehoods
#22What you consider a truth and what you consider a falsehood is a reflection of your ideology.
This also means that LLMs are inherently technologies of ideological propaganda, regurgitating the ideology they were fed with.
Re: Bad Actors Are Grooming LLMs to Produce Falsehoods
#23It is impossible to solve this problem because we cannot really agree what the desired behavior should be. People live in different and dynamic truths. What we consider enemy propaganda today might be an official statement tomorrow. The only way to win here is to not play the game.
> What we consider enemy propaganda today might be an official statement tomorrow. Remember when worrying about COVID was sinophobia? Or when the lab leak was a far-right conspiracy theory? When masks were deemed unnecessary except for healthcare professionals, but then mandated for everyone?
People seem to be voting this down as it seems like political advocacy, but the point seems to be that the commonly accepted truth does indeed change.
Re: Bad Actors Are Grooming LLMs to Produce Falsehoods
#24Speaking of "systems that can evaluate news sources", this is the first time this advocacy group's URL was posted on HN. The founder has a complicated biography,
Re: Bad Actors Are Grooming LLMs to Produce Falsehoods
#25Earlier quoted context omitted.
There are personalized social media feeds, so why not have personalized LLMs that align with how people want their LLM to act.
Because that would only reinforce the already problematic bubbles where people only see what feeds their opinions, often to disastrous results (cf. the various epidemics and deaths due to anti-vaxxers or even worse, downright genocides).
People have done this on their own behalf since the dawn of time, so it's not really clear to me why it's so often framed as an AI issue.
Re: Bad Actors Are Grooming LLMs to Produce Falsehoods
#26What is propaganda for one is truth for another, how could LLM tell the difference ? LLM are not journalist fact checking stuff, they are merely programs that regurgitate what it reads. The only way to counter that would be to feed your LLM only on « safe » vetoed source but of course it would limit your LLM capacities so it’s not really going to happen.
[flagged]
Even in Ukraine there are many cases when the official Western position has changed over the time or is obviously not correct. For example, due to political reasons, Germany still cannot admit that it was Ukrainians who destroyed Nord Stream, although the evidence is pretty strong by now. There is a ton of other similar cases, as the information war vaged from both sides is enormous in volume.
Re: Bad Actors Are Grooming LLMs to Produce Falsehoods
#27We're basically dissolving society right now.
Curious how this all ends. I'm just going to try to weather the storm in the meantime.
Re: Bad Actors Are Grooming LLMs to Produce Falsehoods
#28[deleted]
Re: Bad Actors Are Grooming LLMs to Produce Falsehoods
#29The biggest problem here is the differentiation between objective and relative truth. As long as relative truth is part of ai we can't fully trust it's output. The relative truth for one individual might be perceived as propaganda by another individual, relative to their surroundings and the narrative that is dominant in their social group. It's problematic that truth is not a neutral object but exactly this when it…
When AI can generate and pass formal proof, there is no truth anymore - we are the brain in the vat only left connect ourselves into the vat.
https://dmf-archive.github.io/docs/posts/cognitive-debt-as-a...
Re: Bad Actors Are Grooming LLMs to Produce Falsehoods
#30What is propaganda for one is truth for another, how could LLM tell the difference ? LLM are not journalist fact checking stuff, they are merely programs that regurgitate what it reads. The only way to counter that would be to feed your LLM only on « safe » vetoed source but of course it would limit your LLM capacities so it’s not really going to happen.
> What is propaganda for one is truth for another, how could LLM tell the difference ?
The article isn't even asking for it to tell the difference, just for it to follow its own information about credibility.