Loki: An open-source tool for fact verification
1–10 of 74 posts
Re: Loki: An open-source tool for fact verification
#2[flagged]
Re: Loki: An open-source tool for fact verification
#3That seems like something unlikely to do well at being automated, and not that at least current-gen ai is capable of.
Does it...work?
Re: Loki: An open-source tool for fact verification
#4Very cool! I’ve toyed with an idea like this for a while. The scraping is a cool extra feature, but tbh just breaking down text into verifiable claims and setting up the logic tokens is way cooler.
I imagine somebody feeding a live presidential debate into this. Could be a great tool for fact checking
Re: Loki: An open-source tool for fact verification
#5It’s a bit misleading to call it open source tool when it relies on proprietary LLMs for everything.
Re: Loki: An open-source tool for fact verification
#6So only thing they open sourced is the prompts [1] and code to call LLM APIs? There are plenty of such libraries out there. And the prompts seem to be copied from here [2]?
[1] https://github.com/Libr-AI/OpenFactVerification/blob/main/fa...
[2] https://github.com/yuxiaw/Factcheck-GPT/blob/main/src/utils/...
Re: Loki: An open-source tool for fact verification
#7Isn't this similar to the Deepmind paper on long form factuality posted a few days ago?
https://arxiv.org/abs/2403.18802
https://github.com/google-deepmind/long-form-factuality/tree...
Re: Loki: An open-source tool for fact verification
#8[flagged]
[deleted]
Re: Loki: An open-source tool for fact verification
#9> This tool is especially useful for journalists, researchers, and anyone interested in the factuality of information.
Sorry, I think an individual who is not only aware of reliable sources to verify information, and who is not familiar enough with LLMs to come up with appropriate prompts and judge output should be the last person presenting themselves as the judger of factual information.
Re: Loki: An open-source tool for fact verification
#10It’s a bit misleading to call it open source tool when it relies on proprietary LLMs for everything.
Presumably the LLMs are swappable -- today the proprietary ones are very powerful and accessible, but the landscape may yet change.