Live data from Hacker News

Ask HN: Add flag for AI-generated articles

news.ycombinator.com

41–50 of 500 posts

Re: Ask HN: Add flag for AI-generated articles

#41
Most parsimonious explanation IMV: site staff can't see most AI slop. Reasons unimportant, but moderation systems are guaranteed to break down when the moderators themselves have poor classification ability.

A simple beneficial step that would lead to modest improvements and little downside: partner with Pangram. Either adding it as an automated spam filter, or by simply attaching the detection % to all posts.

Re: Ask HN: Add flag for AI-generated articles

#42
We don't allow genai text on HN itself - see https://news.ycombinator.com/newsguidelines.html#generated and https://news.ycombinator.com/item?id=47340079. How to enforce it is a separate question, of course, but the rule exists.

We don't have a similar rule yet about article content but my sense is that the community mostly doesn't want to read it—or, to put it more conservatively, discounts it. This is why we see so many "just show me the prompt" responses, along with others like this: https://news.ycombinator.com/genai-pushback. I built that list so I have something to send to users who email about why their genai articles got flagged.

It's a fascinating arms race right now: the AIs are training on the humans but the human hivemind is also training on the AIs. Readers are developing allergic sensitivities to language that sounds like an LLM produced it. The AIs will adapt to this, but the humans will adapt in turn. Where it ends up is anyone's guess.

For the present, there is an emerging class distinction between writing (and writers) that use genai vs. writing that does not. As soon as the "this sounds like an LLM" allergy kicks in, the writing instantly gets relegated to a low-status bucket in the reader's mind. That doesn't mean it won't still get looked at - but it is now under a stigma.

(I was rather pleased with the originality of this until I remembered pg had come up with "writes and write-nots" in https://paulgraham.com/writes.html. Oh well, it's the point that matters.)

This has the happy flipside that anyone who would like readers to classify their article as high-status rather than low-status can apply the judo move of simply writing it themselves.

Now I need to add the disclaimer that none of this is a dismissal of LLM technology per se. We rely on it heavily, and there's no question that it's useful. The question is how to use it (pg again: https://x.com/paulg/status/2058871512451412457) and whether one should use it on writing that one publishes to other humans.

To turn to OP's questions:

> Should HN add the ability to flag articles as AI-generated? [...] it could just show up as an indicator

Flagging-as-just-an-indicator would be tagging, which we've always resisted adding to HN, but I wouldn't rule it out.

What I do think we'll (finally) add is a "please give a reason why you flagged this post" step, and "because I think it's genai" will be one choice among several (spam, offtopic, mean, etc.)

> Why is the regular voting system not enough?

The regular voting system is never enough. https://hn.algolia.com/?dateRange=all&page=0&prefix=false&so...

> Should HN change in response to the gen AI era?

To this I am tempted to reply with https://news.ycombinator.com/item?id=48887149 in homage to https://news.ycombinator.com/item?id=3742902.

Re: Ask HN: Add flag for AI-generated articles

#43

This is something that works better on paper in practice. Namely, there are a hell of a lot of false positives of AI use which frequently causes shitstorms on social media where someone says "AI?" in bad faith and now the OP has to defend themselves and in the case of writing a blog post there aren't as concrete ways to defend yourself. (no, demanding the edit history of the post is not reasonable) Hacker News adopti…

uBlock Origin users already filter a large portion of "AI" slop sites. Saves a lot of time when searching for something specific. =3

https://github.com/alvi-se/ai-ublock-blacklist

https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist

https://github.com/Stevoisiak/Stevos-AI-Blocklist/

Re: Ask HN: Add flag for AI-generated articles

#44

The recent rule addition to the Guidelines says this: "Don't post generated text or AI-edited text. HN is for conversation between humans." And I think that covers comments, but I'd be happy to see it also cover articles that are blatantly and primarily if not exclusively AI-generated. But how much AI is permitted? For instance: I'm writing a blog post now. It's all mine. If I include an AI-generated cartoon at the e…

How about if you did part of your research with AI, then typed the text yourself?

Re: Ask HN: Add flag for AI-generated articles

#45

The regular voting system is not enough because posts can't be downvoted and for some reason many people are not bothered by the notion of reading something no one bothered to write. The issue is complicated by the fact that there can be substantial effort invested in a process outside of the writing itself - and so AI written does not guarantee that the content will not valuable. But I'm inclined to punish it anyway…

I get annoyed when I see AI telltale signs too, but for example in my case I type 10x more than the final piece, is it really AI generated or just reworded? I don't use AI to fix my comments, just when I want to format article size pieces I post on my blog.

Re: Ask HN: Add flag for AI-generated articles

#46
how are we detecting AI gen text?

Humans? We're not particularly effective at this as a whole...

AI service ? We'd probably have to pay for that AI to detect that AI and well.. Its also not particularly effective

Effectiveness is important, because we dont want real human produced data to be accidentally removed from view, just as much if not more so than having AI gen data being left on the site.

Re: Ask HN: Add flag for AI-generated articles

#47
post #35

Earlier quoted context omitted.

Why do we need anything more than good/bad? If there is a great post on a topic and the author used AI when generating it, what’s so bad about that?

Different people weight the slop factor differently, which is the main source of pain at the moment. (For example, another top-level comment in this thread suggests banning AI-generated content outright)

What’s different between “slop” and “bad”

Re: Ask HN: Add flag for AI-generated articles

#48
Nobody wants to label their stuff as AI generated because they removed credibility. Communities can flag posts as AI generated based on speculation and telltales but it won’t be 100% and will take extra work.

I think the era of the blog is simply dead now and that’s mostly ok. Blogspam and corporate blogs had killed quality bogs ages ago even before AI was a thing. The real question is what replaces it.

Oh and of course the $64k question is this: if an AI generated article is indistinguishable from a human written article and it is accurate and interesting, do you care who wrote it? We want to avoid low quality, not AI generation, right?

Re: Ask HN: Add flag for AI-generated articles

#49
post #39
post #4

Considering YC invests in AI I doubt you’ll get anything of the sort. Too many people here also think you just have to give in and accept (abuser mentality IMO).

[flagged]

I don't think that's a very good comparison. People can drive a car without an expert but they can't build a car. People can use software without being an expert but still require an expert to build software.

AI could provided assistance with building both cars and software, but you still need a decent level of knowledge in either field to get a good result.

Re: Ask HN: Add flag for AI-generated articles

#50

This is something that works better on paper in practice. Namely, there are a hell of a lot of false positives of AI use which frequently causes shitstorms on social media where someone says "AI?" in bad faith and now the OP has to defend themselves and in the case of writing a blog post there aren't as concrete ways to defend yourself. (no, demanding the edit history of the post is not reasonable) Hacker News adopti…

uBlock Origin users already filter a large portion of "AI" slop sites. Saves a lot of time when searching for something specific. =3 https://github.com/alvi-se/ai-ublock-blacklist https://github.com/laylavish/uBlockOrigin-HUGE-AI-Blocklist https://github.com/Stevoisiak/Stevos-AI-Blocklist/

Just from looking at the sites in the BlockOrigin-HUGE-AI-Blocklist blocklist, it blocks anything tangent to AI such as Hugging Face and other model developers like Mistral/Z.ai, not sites that actually post AI slop.

That's a good example of the exact problem with such a broad stroke rule.

Post reply on HN