Live data from Hacker News

AI slop is killing online communities

rmoff.net

751–760 of 781 posts

Re: AI slop is killing online communities

#751

Earlier quoted context omitted.

The point is to have discretion but use it rarely. Reddit echo chambers use it way too often. It’s not contradictory but unfortunately impossible to fully explain, otherwise it would be explicit rules. When someone acts borderline, you must intuit when they’re acting in good or bad faith. Hence I think a first warning, then short ban, is necessary for anyone not obviously breaking a rule; because the former will be c…

>The point is to have discretion but use it rarely. "Let's give the president dictatorial powers, but it's OK, he'll only use it rarely." Famous last words. Please. Humans in positions of power are incredibly bad at exercising restraint. Humans are humans and make human mistakes, even judges in court give harsher sentences if they're hungry or ill or just having a bad day. Now imagine mods on a forum. That discretion…

I was wrong to imply that moderators should warn then ban users who haven’t broken a specific rule in a way that couldn’t be argued. To be clear, “borderline” means in one interpretation the user is already breaking a rule, but in a different interpretation they’re not breaking the rule. Rules aren’t formally defined, so there’s almost always a way to explain why the same thing both is and isn’t breaking a rule.

To clarify and responding to specific points:

> Humans in positions of power are incredibly bad at exercising restraint

Moderators (at least the admin) already have arbitrary control. You can make the site open or federated, but even then, you moderate your instance.

> Humans are humans and make human mistakes, even judges in court give harsher sentences if they're hungry or ill or just having a bad day. Now imagine mods on a forum.

Yes, but there’s no oracle that won’t make mistakes. The rules themselves aren’t formally defined, and the enforcers are humans (or AI automods trained to mimic or programmed by humans, who are generally less effective).

> That discretion always leads to selective enforcement 100% of the time, like saying "X are below Y", that's just freedom of speech, but saying "Y are below X", that's hate speech, BAN, and other such double standards stuff like that, which turns the platform/board into an echo chamber mirroring the mod's political and emotional views.

I believe free speech is important, but also free association. Not all forums should have free speech (excluding spam), because some people will leave if others are present.

Also, everyone has subconscious unintentional bias and double standards. A moderator will selectively apply the rules, because being human, they make mistakes. But that’s OK, because even among users who believe in “no double standards”, different users will subconsciously perceive the same treatment as fair or unfair.

The key to a good forum that’s not a moderator’s views echo chamber, but also keeps interesting people (not devolving into a troll and/or toxic-personality echo chamber), is to enforce double standards that most people agree with. e.g. often insulting a public figure is fine, insulting a specific forum user is not, or if a forum user is a famous public figure, mildly insulting them is fine outside of discussions they participate in.

The problem with most subreddits is that they’re too quick to dismiss users as bad faith, speech as hate speech and trolling, etc. Some speech that offends certain groups should be OK, because certain groups are too easily offended. But even the leftists I know say things that would get them banned on many left-leaning subreddits.

If you want a forum that allows hate speech, I think that’s fine, although your users will only be people who tolerate hate speech. Otherwise, I recommend banning hate speech but being more lenient than most subreddits, but also watching for trolls who abuse this lenience to make clear their hatred anyways. Either way, you’ll want to ban some users: at least spammers, probably those who harass specific other users, probably also those who are overly cynical and hurt the “vibe”.

> If someone managed to spot a pattern that can be repeat borderline, then your rules suck and you need to update them according to that pattern. He did you a favor for exposing a flaw in your rules.

Again: I concede that if the user hasn’t actually broken a rule in a way that can be clearly explained, the rules should be updated and they should be given a pass.

But there’s no way to update the rules so that a troll can’t “borderline” break them, except with a rule like “moderators have final discretion”.

e.g. a rule like “don’t insult various groups” can have the user vaguely allude to a characterization of a group that could be derogatory, but maybe you misunderstand and it wasn’t an insult, or maybe they weren’t referring to the entire group but a subset - until they do it again and again (in different ways), even after warnings.

Re: AI slop is killing online communities

#752

Earlier quoted context omitted.

>The point is to have discretion but use it rarely. "Let's give the president dictatorial powers, but it's OK, he'll only use it rarely." Famous last words. Please. Humans in positions of power are incredibly bad at exercising restraint. Humans are humans and make human mistakes, even judges in court give harsher sentences if they're hungry or ill or just having a bad day. Now imagine mods on a forum. That discretion…

I was wrong to imply that moderators should warn then ban users who haven’t broken a specific rule in a way that couldn’t be argued. To be clear, “borderline” means in one interpretation the user is already breaking a rule, but in a different interpretation they’re not breaking the rule. Rules aren’t formally defined, so there’s almost always a way to explain why the same thing both is and isn’t breaking a rule. To c…

> because some people will leave if others are present.

Great, they can create and move to their own echo chamber, like Bluesky. How's that going for them?

If you're on the anonymous on the internet, you should have some thick skin, and no community should cave in to accommodate the whims of a few sensitive users who want the entire internet be a sterilized comfort zone for them.

>The problem with most subreddits is that they’re too quick to dismiss users as bad faith, speech as hate speech and trolling, etc.

Same with HN. See how often green users get berated for having opinions that don't conform to the group think.

>e.g. a rule like “don’t insult various groups”

Why not "don't insult anyone" or "everyone is free to insult anyone". Why make some groups immune from criticism? Are they Pius saints? The moment you create this double standard where some animals are more equal than others, you lose all arguments of objectivity.

Re: AI slop is killing online communities

#754

I run a niche creative community, and we outlawed AI-generated content in 2022 as it was easy to see how corrosive it would be to the community. It hasn't been easy. We ban fake AI accounts daily and shrug off around 600 AI content creator accounts monthly. It's a lot of work, extra work that wasn't needed before AI content came around, and of course, that is an extra cost. I fear losing the battle.

High quality anecdata are exactly the reason why I love HN. Thanks for posting about it. > fake AI accounts First, how do you identify them? Is it strictly admins monitoring posts/server-side logs or do users report odd behaviour? Second, what is the purpose of these accounts? Are they basically running submarine adverts, or are they just trolling (to harm the community)?

We review all signups and their submitted content, and we have a fake account type "AI creator" which we record, so if they tried that first, it's a clue.

We also integrate a third-party AI detection tool that checks their uploaded content before they get access to the community, and we use a second third-party tool as a double-check, and if we still doubt ourselves, we'll ask for their workings-outs in some way that is relevant to their creative type.

We also ask them to prove they are the author of their work through various time-tested mechanisms.

I have no idea why people do the things they do. People are a mystery to me.

Re: AI slop is killing online communities

#755

Earlier quoted context omitted.

I was wrong to imply that moderators should warn then ban users who haven’t broken a specific rule in a way that couldn’t be argued. To be clear, “borderline” means in one interpretation the user is already breaking a rule, but in a different interpretation they’re not breaking the rule. Rules aren’t formally defined, so there’s almost always a way to explain why the same thing both is and isn’t breaking a rule. To c…

> because some people will leave if others are present. Great, they can create and move to their own echo chamber, like Bluesky. How's that going for them? If you're on the anonymous on the internet, you should have some thick skin, and no community should cave in to accommodate the whims of a few sensitive users who want the entire internet be a sterilized comfort zone for them. >The problem with most subreddits is…

> If you're on the anonymous on the internet, you should have some thick skin, and no community should cave in to accommodate the whims of a few sensitive users who want the entire internet be a sterilized comfort zone for them.

Some communities should be for users with thick skin, but there should be other communities (like BlueSky) for sensitive users. Users with thick skin are themselves a minority, so if only former existed, most people wouldn’t participate (or realistically, would create latter).

> Same with HN. See how often green users get berated for having opinions that don't conform to the group think.

HN’s (strong) echo chamber is more because of its older users than moderators. To clarify, moderators don’t entirely shape their community; dang seems to be lenient in his direct moderation (I’ve only seen him directly respond to obvious flamebait and personal attacks), so the users with reputation have more influence here.

I agree that users are downvoted and berated for expressing opinions against the groupthink, and I’d really like to see HN not hide user-flagged comments unless a moderator manually confirms that they break a specific rule. Although I don’t argue that HN is a perfect community, just that it’s decent and much better than Reddit: among other reasons, I still see way more contrarian, right-leaning, and occasionally high-quality comments.

> Why not "don't insult anyone" or "everyone is free to insult anyone". Why make some groups immune from criticism? Are they Pius saints? The moment you create this double standard where some animals are more equal than others, you lose all arguments of objectivity.

I agree with this. “Various” was bad wording on my part; I meant a rule like “don’t insult ethnic groups” as in any ethnic group, or “don’t insult religious groups” as in any religion, or “don’t insult all men or all women”. Ideally everyone belongs to a group and none get special treatment.

But note that even these rules nobody can enforce without bias and double standards; objectivity is already lost because there’s no formal definition for “insult” (or “… group”). For example, if I say “I prefer to hang out with men” am I insulting women? “I find women more attractive” am I insulting men? If someone thinks those weren’t insults, I can call one of the groups meaner or uglier, using hasher words, and especially if I do so consistently, eventually they’ll think I am insulting. If someone thinks those were insults, I can find milder ways to say the same thing (e.g. “most of my friends are men”, “I’m heterosexual”) until they don’t notice any insult. Where would you draw the line? Ultimately you’d have to keep drawing more and more lines, even for this one rule (“don’t insult all men or all women”), because there are unfathomably many ways to slightly alter the phrasing that alter the perceived level of insult, especially factoring context. And speaking of context, you must handle implicit insults: when is an insult implicit, when is it obvious and in bad faith vs. only apparent in an unintuitive interpretation and unintentional?

Re: AI slop is killing online communities

#756

Earlier quoted context omitted.

> That ship has sailed long time ago with zealot admins Where there are certainly strong examples of this, a lot of people mistake enforcing the rules as zealotry. Part of the point of SO was that if things don't change then there is a completed state for SO too - no need to ask duplicate questions like on platforms where a post is less long-lived. Unfortunately people take things like “this is a dup”, “provide more…

It's the deletionism that effectively ended my participation in stack exchange networks. Violated the rules with your question? Closed. Alright, I can deal with it. But they didn't stop, they just had to go and delete the goddamn post, along with all the useful comments and links that had built up on it, for literally no reason. There was actual content in there. Seriously, fuck that. Went all in on my own website af…

Their rules said duplicates should be deleted, at least most of the time, so they were. While it might be nice for extra useful content from the dup to be merged into the original page, that would be a lot of work and much of the time there isn't enough to make it worthwhile (or any).

> for literally no reason

Other than the reason that it was their site and that is what they chose to do.

While some criticism of SO is certainly valid, I find a lot of it boils down to "how dare they run their site the way they want instead of the way that I would prefer".

> Went all in on my own website after that. Can't delete my stuff now.

This is a good solution. Everything I've written on there that ended up being something I might want to preserve, and similarly useful answers to mine and others queries, I have archived for future reference too¹, in case the sites die, or that particular content does, or otherwise becomes inaccessible to me.

--------

[1] though in my case not online as I never got around to that, maybe I will one day, when I've been sacked for being inefficient because I refuse to have Claude do my job for me and I have plenty of time on my hands!

Re: AI slop is killing online communities

#757

Earlier quoted context omitted.

It's the deletionism that effectively ended my participation in stack exchange networks. Violated the rules with your question? Closed. Alright, I can deal with it. But they didn't stop, they just had to go and delete the goddamn post, along with all the useful comments and links that had built up on it, for literally no reason. There was actual content in there. Seriously, fuck that. Went all in on my own website af…

Their rules said duplicates should be deleted, at least most of the time, so they were. While it might be nice for extra useful content from the dup to be merged into the original page, that would be a lot of work and much of the time there isn't enough to make it worthwhile (or any). > for literally no reason Other than the reason that it was their site and that is what they chose to do. While some criticism of SO i…

> Other than the reason that it was their site and that is what they chose to do.

Welp, they can go to hell along with their site. AI is better than stack exchange anyways.

Everybody's got boundaries, and they managed to cross mine. I can deal with rudeness and toxicity just fine. I can deal with moderators enforcing the rules. Straight up deleting stuff is simply not acceptable though, and I couldn't care less how they justify it.

Re: AI slop is killing online communities

#758

Earlier quoted context omitted.

Reminds me when reality TV came a long. Many folks were convinced that it would be a passing fad and that within 12-18 months TV would return to the way it had been before hand. That because the quality was so low people would eventually bore of it, still waiting for that moment...

But we have more high quality non-reality TV than ever?

I don't know why this was downvoted. It is a genuine counterargument, even if it misses some of the context.

The problem isn't that there are alternatives. The problem is that this sort of vapid human zoo has flourished and spread globally.

The only major culture that seems to have avoided it is China. And that's because they got addicted to even more vapid mobile livestreams.

Re: AI slop is killing online communities

#759

Earlier quoted context omitted.

High quality anecdata are exactly the reason why I love HN. Thanks for posting about it. > fake AI accounts First, how do you identify them? Is it strictly admins monitoring posts/server-side logs or do users report odd behaviour? Second, what is the purpose of these accounts? Are they basically running submarine adverts, or are they just trolling (to harm the community)?

A starting point for study; AI Deception: A Survey of Examples, Risks, and Potential Solutions - https://arxiv.org/abs/2308.14752 Deception Analysis with Artificial Intelligence: An Interdisciplinary Perspective - https://arxiv.org/abs/2406.05724

[deleted]

Re: AI slop is killing online communities

#760

Question for web devs - are captchas effective any more? If Reddit required a captcha on every comment, would it actually decrease bot comments?

Speaking from experience hosting a MediaWiki with a ReCaptcha: Those were never effective, they didn't stop any bots. Switching to a personalized captcha with questions that have to be answered (that can mostly be answered from the Wiki itself) was more effective and stopped 100% of bots (of course it can be trivially bypassed when a site-specific bot is coded but no one does it and same is true for ReCaptcha).
Post reply on HN