Live data from Hacker News

AI slop is killing online communities

rmoff.net

151–160 of 781 posts

Re: AI slop is killing online communities

#151
post #30

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

I think it's going to effectively kill public chat communities without either proof of identity or attestation through a web of trust. Or rather turn them into little better than comment sections on news sites; thriving but worthless. I'm active in a number of online communities that are doing just fine but the difference is those all involve ongoing relationships, built over time and with engagement across multiple…

>I think it's going to effectively kill public chat communities without either proof of identity

How? I have an identity. A state driver's license, birth certificate, social security number. I've even considered getting a federal license before, never bit the bullet. If I wanted to run a bot, what stops me from giving it my identity? How do I prove I'm really me (a "me" exists, that's provable), and not something I'm letting pretend to be me? You can't even demand that I do that, because it's essentially impossible.

Is there even some totalitarian scheme that, if brutal and homicidal enough, could manage to prevent this from happening (even partially)?

I'm limited to a single identity only as a resource constraint. Others more wealthy than I (corporations or ad hoc criminal enterprises) could harvest thousands of real identities and use those. Consensually, through identity theft. The only thing slowing it down at the moment are quickly eroding social norms (and, as you point out, maybe they're not doing that and it's not even slow at the moment).

Re: AI slop is killing online communities

#152

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

> Online communities are definitely dying. I guess I hope that maybe IRL communities have a resurgence in this wake.

Would be super fascinating to watch play out. I grew up before the internet so, historically, I know how to seek out external communities, but by early high school I was deeply entrenched in online life - so I'm very rusty with finding new IRL clubs, cliques, etc. Fortunately my life is full of many friends and I go out frequently, regardless. For those younger people that never had life without the internet, I wish them luck on their search but at the same time I'm very curious to witness their journey.

Re: AI slop is killing online communities

#153

I run a niche creative community, and we outlawed AI-generated content in 2022 as it was easy to see how corrosive it would be to the community. It hasn't been easy. We ban fake AI accounts daily and shrug off around 600 AI content creator accounts monthly. It's a lot of work, extra work that wasn't needed before AI content came around, and of course, that is an extra cost. I fear losing the battle.

What about charging $1 or $5 for an account? Seems like you could stem the tide pretty easily with something like that.

Re: AI slop is killing online communities

#154

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

> I am not quite there with Hacker News but I do know for a fact that many "users" here are LLMs.

This just makes me wonder...so what?

Some of the oldest posters here with the most karma continue to post absolute garbage takes on topics ranging from US healthcare to history of USSR, that are trivially disproven by learning the very basics from a Wiki article (e.g. not a high bar).

To be fair, this opinion slop is also present for new users and LLM bots, but is one kind really worse than the other, if both of them contribute to killing the community?

We already know what kills communities. It's the eternal Septembers. Infighting within leadership also doesn't help, but time and time again it's the influx of too many new users that nosedive and drown out quality contributions.

Re: AI slop is killing online communities

#156

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

Public* online communities are dying. Discord is thriving

If all you value is sub-IRC level irreverent discussion, maybe.

Re: AI slop is killing online communities

#157

Earlier quoted context omitted.

> I think it's going to effectively kill public chat communities without either proof of identity or attestation through a web of trust. This seems self evident to me too. It's another factor in why I think the tech community needs to get ahead of governments on the whole "prove your ID on the Internet" thing by having some sort of standard way to do it that doesn't necessarily involve madness in the loop.

I'd be interested in working on a problem like that. I have a strong preference for remaining anonymous or at least making it a reasonably high bar to tying my online identity to my personal identity I would love to be involved in helping to design a sort of "human verified" badge that doesn't necessarily make it possible or at least not easy for everyone to find your real identity I've been thinking about it a bunch…

I agree its a very, very interesting problem. Maybe one of the biggest problems of the coming decade.

I suspect it will be a long process: first there will be goverments that force people to use ID, but that will be abused, hacked and considerably restrict freedom of speech, so after that phase people will start to create better ids.

The problem is really pretty simple: You need an authoratitive source to say "This person is real" - and a way for that source to actually verify you're a person - but that source can be corrupted and hacked. Some people will say "Crypto!" but money != people, so I don't see how that works. Perhaps the creation of some neutral non-goverment-non-profit entity is the way, but I can see lots of problems there too, and it will probably cost money to verify someone is real - where does that come from?

Anyway, good luck on your work!

Re: AI slop is killing online communities

#158
post #141
post #81

Earlier quoted context omitted.

Don't do it anywhere. He's a jerk for doing it on reddit.

[flagged]

People live in and depend on that waterway. Just because it's beneath your standards doesn't mean it isn't vital.

You're giving "let them eat cake" energy.

Re: AI slop is killing online communities

#160

How would one build an online community free of LLM agents commenters and links to "slop" content? Strict invitation trees? Small signup fees? No SEO incentives?

I've always thought the "strict invitation trees" or vouch trees would be an interesting way to moderate a community, even before the LLM era. A user can vouch for an unlimited number of new accounts, but if more than 10% of the vouched accounts are banned or flagged down the line, the parent voucher acct is also banned/flagged.

Since it creates a tree structure, you can wipe out entire armies of bot/spam/otherwise accounts by following the vouches up the tree.

Post reply on HN