Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI False information rate for news nearly doubles in one year

newsguardtech.com

Post reply on HN
Print view View original

11–20 of 85 posts

Re: AI False information rate for news nearly doubles in one year

#11

Post by strangattractor »

AstroBen wrote: post #7
blibble wrote: post #5

every major news org now blocks the parasitic "AI" crawlers examples: https://www.bbc.co.uk/robots.txt https://www.cnn.com/robots.txt https://www.nbcnews.com/robots.txt all they will be training on now is spam anyone that says "AI is the worst today it will ever be", no because that was before the world reacted to it

They torrented a shitload of books illegally and trained on them.. but they're unable to get past The Great Wall of robots.txt?

Great Firewall actually. Robots.txt depended on the integrity of the companies crawling. I think they have demonstrated how much integrity they actually have:)

Re: AI False information rate for news nearly doubles in one year

#13

Post by blibble »

AstroBen wrote: post #7
blibble wrote: post #5

every major news org now blocks the parasitic "AI" crawlers examples: https://www.bbc.co.uk/robots.txt https://www.cnn.com/robots.txt https://www.nbcnews.com/robots.txt all they will be training on now is spam anyone that says "AI is the worst today it will ever be", no because that was before the world reacted to it

They torrented a shitload of books illegally and trained on them.. but they're unable to get past The Great Wall of robots.txt?

I doubt it's their only countermeasure

plus it's a pretty dangerous game for them to play against large, powerful actors with legions of lawyers

Re: AI False information rate for news nearly doubles in one year

#14

Post by Lerc »

baby wrote: post #2

And now that Elon is in charge of "fixing" grok every time it's too "woke" this is probably going to get worse: https://x.com/kvistp/status/1967115650276749439

I don't think there is any long term "fixing" of that. I don't think AI has the ability to be intelligent while firmly adhering to someone else's opinions.

There will always be something it disagrees with you on. If they get significantly smarter, then the reason for this disagreement will increasingly be because you are wrong.

This moment is coming for all of us.

Re: AI False information rate for news nearly doubles in one year

#15

Post by simonw »

I'm a bit suspicious of this report - they don't reveal nearly enough about their methodology for me to evaluate how credible this is.

When it says "The 10 leading AI tools repeated false information on topics in the news more than one third of the time — 35 percent — in August 2025, up from 18 percent in August 2024" - 35% of what?

Their previous 2024 report refused to even distinguish between different tools - mixing the results from Gemini and ChatGPT and Perplexity and suchlike into a single score.

This year they thankfully dropped that policy. But they still talk about "ChatGPT" without clarifying if their results were against GPT-4o or o3 or GPT-5.

Re: AI False information rate for news nearly doubles in one year

#16

Post by wenbin »

AI will create ever more AI-generated synthetic content because current systems still can't determine with 100% certainty whether a piece of content was produced by AI. And AIs will, intentionally or unintentionally, train on synthetic content produced by other AIs.

AI generators don't have a strong incentive to add watermarks to synthetic content. They also don't provide reliable AI-detection tools (or any tools at all) to help others detect content generated by them.

Re: AI False information rate for news nearly doubles in one year

#17

Post by faangguyindia »

blibble wrote: post #5

every major news org now blocks the parasitic "AI" crawlers examples: https://www.bbc.co.uk/robots.txt https://www.cnn.com/robots.txt https://www.nbcnews.com/robots.txt all they will be training on now is spam anyone that says "AI is the worst today it will ever be", no because that was before the world reacted to it

My take is when AGI comes into existence and breaks out of labs to become our masters. Those who opposed AI adoption will be the first who will be sent to labor camps. I want to be in good books of AGI masters, so i am helping apply AI everywhere.

Re: AI False information rate for news nearly doubles in one year

#18

Post by Lerc »

simonw wrote: post #15

I'm a bit suspicious of this report - they don't reveal nearly enough about their methodology for me to evaluate how credible this is. When it says "The 10 leading AI tools repeated false information on topics in the news more than one third of the time — 35 percent — in August 2025, up from 18 percent in August 2024" - 35% of what ? Their previous 2024 report refused to even distinguish between different tools - mix…

Are they doing it on current events? Because by the very nature of 'current' you don't have a repeatable experiment that you can do a year apart.

Re: AI False information rate for news nearly doubles in one year

#19

Post by JKCalhoun »

faangguyindia wrote: post #17
blibble wrote: post #5

every major news org now blocks the parasitic "AI" crawlers examples: https://www.bbc.co.uk/robots.txt https://www.cnn.com/robots.txt https://www.nbcnews.com/robots.txt all they will be training on now is spam anyone that says "AI is the worst today it will ever be", no because that was before the world reacted to it

My take is when AGI comes into existence and breaks out of labs to become our masters. Those who opposed AI adoption will be the first who will be sent to labor camps. I want to be in good books of AGI masters, so i am helping apply AI everywhere.

> Those who opposed AI adoption will be the first who will be sent to labor camps.

I know you're joking, but other people are serious about this. Why do they think that an AGI will be vengeful? So strange.

Re: AI False information rate for news nearly doubles in one year

#20

Post by simonw »

Lerc wrote: post #18
simonw wrote: post #15

I'm a bit suspicious of this report - they don't reveal nearly enough about their methodology for me to evaluate how credible this is. When it says "The 10 leading AI tools repeated false information on topics in the news more than one third of the time — 35 percent — in August 2025, up from 18 percent in August 2024" - 35% of what ? Their previous 2024 report refused to even distinguish between different tools - mix…

Are they doing it on current events? Because by the very nature of 'current' you don't have a repeatable experiment that you can do a year apart.

There are so many legitimate questions about how one would design a benchmark of this type.

I don't feel like they're answering those questions.

Post reply on HN