Live data from Hacker News

SlopStop: Community-driven AI slop detection in Kagi Search

blog.kagi.com

121–130 of 271 posts

Re: SlopStop: Community-driven AI slop detection in Kagi Search

#122
post #121

releasing the AI slop dataset seems dangerous, any bad actor could train against it. at the very least, there should be some KYC restriction

that being said, it is valuable for researchers. i requested access for safety research, just saying you should be careful with who gets access :P

Re: SlopStop: Community-driven AI slop detection in Kagi Search

#124
post #25

Though I'm still pissed at Kagi about their collaboration with Yandex, this particular kind of fight against AI slop has always striked me as a bit of Don Quixote vs windmill. AI slop eventually will get as good as your average blogger. Even now if you put an effort into prompting and context building, you can achieve 100% human like results. I am terrified of AI generated content taking over and consuming search eng…

If you're concerned about money ending up at companies that are taxed by countries that mass murder people, you should be as pissed about Google, Microsoft, DuckDuckGo, Boeing, Airbus, Walmart, Nvidia, etc... there is almost no company you should not be pissed off by.

I would be happy that Google is getting some competition. It seems Yandex created a search engine that actually works, at least in some scenarios. It's known to be significantly less censored than Google, unless the Russian government cares about the topic you're searching for (which is why Kagi will never use it exclusively).

Re: SlopStop: Community-driven AI slop detection in Kagi Search

#125
post #73

Earlier quoted context omitted.

> Even now if you put an effort into prompting and context building, you can achieve 100% human like results. Are we personally comfortable with such an approach? For example, if you discover your favorite blogger doing this.

I don't care one bit if the content is interesting, useful, and accurate. The issue with AI slop isn't with how it's written. It's the fact that it's wrong, and that the author hasn't bothered to check it. If I read a post and find that it's nonsense I can guarantee that I won't be trusting that blog again. At some point there'll become a point where my belief in the accuracy of blogs in general is undermined to the…

Even if it's right there's also the factor of: why did you use a machine to make your writing longer just to waste my time? If the output is just as good as the input, but the input is shorter, why not show me the input.

Re: SlopStop: Community-driven AI slop detection in Kagi Search

#126

So we have two universes. One is pushing generated content up our throats - from social media to operating systems - and another universe where people actively decide not to have anything to do with it. I wonder where the obstinacy on the part of certain CEOs come from. It's clear that although such content does have its fans (mostly grouped in communities), people at large just hate arificially-generated content. We…

not exactly nothing to do with it, they still use generative AI to assist search

and saying 'it is no more'... sigh. such a weird take. the world's coming for you

Re: SlopStop: Community-driven AI slop detection in Kagi Search

#127

What about human slop? start with HN a significant number of comments are pretty dire.

This. There's just as many human commenters and content creators that generate plenty of human slop. And there are many AI produced content that is very, very interesting. I've subscribed to a couple of newsletters that are AI generated which are brilliant. Lot's of project documentation is now generated by AI which can, if well-prompted, capable of great docs that are deeply rooted in the code-as-primary-source and is eadier to keep up to date. AI content is good if the human behind it is committed to producing good content.

Hack, that's why I use Chatgpt and other LLM chat, to have AI generate content taylored for my reading pleasure and specific needs. Some of the longer generations of AI research mode I did lately are among my personal best reads of the year - all filled with links to its sources and with verified good info.

I wish people generating good AI responses would just feel free to publish it out and not be bullied by "AI slop detectors by Kagi" that promise to demote your domain ranking. Kagi: just rank the quality and veracity of the content, independently of if it's AI or not. It's not the em-dashes that make it bad, it's the sloppy human behind the curtain.

Re: SlopStop: Community-driven AI slop detection in Kagi Search

#128
post #34
post #33

Earlier quoted context omitted.

I think you're referencing https://kite.kagi.com/ In my view, it's different to ask AI to do something for me (summarizing the news) than it is to have someone serve me something that they generated with AI. Asking the service to summarize the news is exactly what the user is doing by using Kite—an AI tool for summarizing news. (I'm a Kagi customer but I don't use Kite.)

I'm just realizing that while I understand (and think it's obvious) that this tool uses AI to summarize the news, they don't really mention it on-page anywhere. Unless I'm missing it? I think they used to, but maybe I'm mis-remembering. They do mention "Summaries may contain errors. Please verify important information." on the loading screen but I don't think that's good enough.

"Kagi News reads public RSS feeds of thousands of (community-curated) world-wide news sources and utilizes AI to distill them into one perfect daily briefing."

https://news.kagi.com/about

Re: SlopStop: Community-driven AI slop detection in Kagi Search

#129
post #31

Earlier quoted context omitted.

Been using Kagi for two years now. Their consistent approach to AI is to offer it, but only when explicitly requested. This is not that surprising with that in mind.

> Their consistent approach to AI is to offer it, but only when explicitly requested. Kagi News does not disclose AI even.

"Kagi News reads public RSS feeds of thousands of (community-curated) world-wide news sources and utilizes AI to distill them into one perfect daily briefing."

https://news.kagi.com/about

Re: SlopStop: Community-driven AI slop detection in Kagi Search

#130
Definitely anecdata but an eye opener for me:

I've been using Anthropic's models with gptel on Emacs for the past few months. It has been amazing for overviews and literature review on topics I am less familiar with.

Surprisingly (for me) just slightly playing with system prompts immediately creates a writing style and voice that matches what _I_ would expect from a flesh agent.

We're naturally biased to believe our intuition 'classifier' is able to spot slop. But perhaps we are only able to stop the typical ChatGPTesque 'voice' and the rest of slop is left to roam free in the wild.

Perhaps we need some form of double blind test to get a sense of false negative rates using this approach.

Post reply on HN