Live data from Hacker News

Show HN: Bullshit Detector – agent skills that fact-check videos and articles

github.com

11–20 of 80 posts

Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles

#11
post #8

The author is posting comments here (all flagged at this time) that are very clearly AI slop, which is quite ironic.

Fair, drafted posts with claude, getting all my comments flagged. Thought that something is wrong with my account. Writing myself from here

Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles

#14

What do you use as “ground truth”? The page says “independent sources”, and I’m sure there’s too many to list, but my question is how are they vetted as being truthful and how are two sources with opposite viewpoints reconciled?

There is no whitelist source. It can't rate sources for truthfulness. When sources conflicts - skill drops verdict to misleading or unverifiable and both are linked. Can't pick a winner at the moment. That's probably the weakest part and still a judgement call for a model.

Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles

#15

That's too much effort. Should have been a browser extension that uses ollama so it can run with local models or maybe even openrouter...

That's fair. Install is a one time real friction and extension would be much simpler.

But, there is a reason why it's not an extension. At least for now. Whole product isn't a UI or service, it's a set of skills for your AI agent of choice, which gets content from URL or whatever shared as a source, splits it into claims and does extensive web searches for every claim to compare it with statement from provided content.

On local models constraint isn't a model itself - but search. Model don't judge from it's trained memory, so even local model will need a backend for search, otherwise it can't provide a verdict.

Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles

#16
Washington Post gave up tracking Trump lies last term in 2021 because it became impossible by human hands with 21+ per day and over 30,000 in their database

but with "AI" now it's possible not only to do non-stop but in REALTIME

you could even just restrict the source of the check to the paper's own reporting the past fifty years

* https://www.washingtonpost.com/graphics/politics/trump-claim...

I'd like to see that backfilled, all the way back to the "long form birth certificate" (remember that horror show)

Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles

#17
post #8

The author is posting comments here (all flagged at this time) that are very clearly AI slop, which is quite ironic.

Fair, drafted posts with claude, getting all my comments flagged. Thought that something is wrong with my account. Writing myself from here

Bro, you don’t have to outsource your brain for basic communication on the internet.

HN’s community has built-in bullshit detectors.

Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles

#18
post #9

Who checks the checkers?

At the moment - it's model's judgement upon search results for every claim from provided content. If search results returned inaccurate data, or were fabricated - it might affect a verdict for that claim, or highlight that it's unverifiable or contradictory.

But there is a room for improvement, what do you suggest? Have a Judge agent which will check results?

Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles

#19

Earlier quoted context omitted.

Fair, drafted posts with claude, getting all my comments flagged. Thought that something is wrong with my account. Writing myself from here

Bro, you don’t have to outsource your brain for basic communication on the internet. HN’s community has built-in bullshit detectors.

You are right, no excuses. Will have few grammar errors but I'll own them. Cheers!
Post reply on HN