Earlier quoted context omitted.
You are right, no excuses. Will have few grammar errors but I'll own them. Cheers!
Sounds like AI reply to me, lmao
SMH I don't get it
Show HN: Bullshit Detector – agent skills that fact-check videos and articles
71–80 of 80 posts
Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles
#72Funny, I recently pasted output from Gemini into Claude, and it said it was total nonsense generated by an overconfident AI. Apparently the "AI-generated bullshit" detection is already part of LLMs.
but have Claude actually fact-checked it or just provided an opinion?
Actually it was Fabel, and it totally tore apart Gemini's response.
Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles
#73Earlier quoted context omitted.
but have Claude actually fact-checked it or just provided an opinion?
Actually it was Fabel, and it totally tore apart Gemini's response.
What if you use OpenAI as a judge and check both responses? Not defending Gemini, just curious if it was that wrong, or Fable - that aggressive.
Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles
#74this - if trustworthy - would be great for social media and "news" sites
Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles
#75this - if trustworthy - would be great for social media and "news" sites
exactly, that is one of the use cases I see for these skills
Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles
#76What do you use as “ground truth”? The page says “independent sources”, and I’m sure there’s too many to list, but my question is how are they vetted as being truthful and how are two sources with opposite viewpoints reconciled?
Something I've found surprisingly effective is telling ChatGPT to "use credible sources" - you can then watch its thinking trace and see it do things like ruling out random blogs, considering media publications with a good reputation for fact checking, and double-checking information that seems unlikely.
Hi, ran the experiment with "credible sources". Results we unexpected but not less interesting. Few things worth noting:
- same search query ran minutes apart return different sources, sometimes with only 1-2 overlaps.
- 16 high-credibility news outlets are rejecting agent's access to a content. (like Reuters, NYT, Guardian), but all .gov, dedicated fact-checkers are working.
Detailed report, if you are interested: https://github.com/SerhiiKorniienko/bullshit-detector/blob/m...
Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles
#77What do you use as “ground truth”? The page says “independent sources”, and I’m sure there’s too many to list, but my question is how are they vetted as being truthful and how are two sources with opposite viewpoints reconciled?
There is no whitelist source. It can't rate sources for truthfulness. When sources conflicts - skill drops verdict to misleading or unverifiable and both are linked. Can't pick a winner at the moment. That's probably the weakest part and still a judgement call for a model.
[flagged]
Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles
#78this - if trustworthy - would be great for social media and "news" sites
exactly, that is one of the use cases I see for these skills
startup idea: a social media platform where illogical or false statements are rejected with an annotated refutation
it would be a very quiet place...
Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles
#79[deleted]
Re: Show HN: Bullshit Detector – agent skills that fact-check videos and articles
#80[flagged]