Live data from Hacker News

AI slop is killing online communities

rmoff.net

351–360 of 781 posts

Re: AI slop is killing online communities

#351

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

> I do know for a fact that many "users" here are LLMs. HN autokills comments it detects as LLM. I think maybe you're not giving HN enough credit. :)

HN front page is about 25% LLM written blog posts at any given time.

Re: AI slop is killing online communities

#352
post #189

Earlier quoted context omitted.

Private torrent trackers have been doing this for a while. If some number of your downstreams act like shitheads - you get nipped and so do your other downstreams.

Was it demonoid? That was like this way back in the day? Needed an invite and if you leeched you were cut.

This takes it a step further than what you describe. They keep track of who you’ve invited, who they’ve invited and so on and if there’s enough bad leaves on the tree they just cull the entire tree. It’s a somewhat common practice with private trackers

Re: AI slop is killing online communities

#353

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

For a while there were a lot of posts from people experimenting with ChatGPT to write anger bait posts on Reddit where they would later edit the post to say it was fake, written by ChatGPT. I assume they thought they'd be teaching people a lesson by making them feel foolish for responding to AI stories, most of which were too fake to be believable. However it did not matter. The posts remained popular and continued t…

>However it did not matter. The posts remained popular and continued to bring in comments even after the admission that they were fake

That's 90% of current Facebook pages and groups.

Re: AI slop is killing online communities

#354

Earlier quoted context omitted.

Reddit is known to fingerprint TLS and quickly shadowban accounts that don't have the fingerprints of browsers.

TLS fingerprinting and Cloudflare are easy to bypass. There are lots of libraries that do so. The application-layer stuff is harder. Each application can develop its own heuristics, and that's difficult to automate in a cross-cutting fashion. Reddit doesn't do anything about that? That seems stupid.

[deleted]

Re: AI slop is killing online communities

#355

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

Did you ever introspect about who ruined Reddit?

We’re all trying to find the guy that did this

Re: AI slop is killing online communities

#356

Earlier quoted context omitted.

For a while there were a lot of posts from people experimenting with ChatGPT to write anger bait posts on Reddit where they would later edit the post to say it was fake, written by ChatGPT. I assume they thought they'd be teaching people a lesson by making them feel foolish for responding to AI stories, most of which were too fake to be believable. However it did not matter. The posts remained popular and continued t…

We do precisely the same thing here. Here's a relatively recent post that, to me, seems obviously LLM-written. It just rattles off some management platitudes: https://news.ycombinator.com/item?id=47913650 It had 639 comments and 866 upvotes. And that's not a one-off.

I wish there was an internet-wide "don't show again" button for such slop pages

Re: AI slop is killing online communities

#357
post #189

Earlier quoted context omitted.

Private torrent trackers have been doing this for a while. If some number of your downstreams act like shitheads - you get nipped and so do your other downstreams.

Was it demonoid? That was like this way back in the day? Needed an invite and if you leeched you were cut.

It's tons of them doing this...

Re: AI slop is killing online communities

#358
post #327

Earlier quoted context omitted.

Note that "attestation through a web of trust" means something like needing an invite from an existing user. It doesn't have to mean mass surveillance.

Then how can you have a community that is welcoming to people who are not part of the ingroup? I want to create a community for immigrants. How would I make it welcoming to recent immigrants for whom no one can vouch? A web of trust is a wonderful tool, but it's exclusive by design. This is a problem for some communities, even though it makes others much better.

>Then how can you have a community that is welcoming to people who are not part of the ingroup?

Being welcoming to every random person is by definition not a community, it's a free-for-all mess.

A community means communal interests and values, it's in the name. And to guard those you can't just be accepting everyone without vetoing them. That's how it turns to a shit of spammers and trolls and people who want to hijack it and don't share the original cause/spirit. Has happened to forum after forum...

Re: AI slop is killing online communities

#359

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

Reddit sold it's data to AI companies for training[1]. They could have refused, but companies like OpenAI likely would have harvested that data anyways. As such, it should not be surprising that AI models are pretty good at generating reddit posts. They were specifically trained to do that.

This is sad, because Reddit remained one of the final bastions of human content on the internet. For several years, appending "site:reddit.com" to a google search was a valid way to get something usable out of a google search. Doing that is still an improvement over raw-dogging Google's ranking algorithms with an unfettered search, but AI slop increasingly is the result.

This is one of my great disappointments in the current rise of AI. LLM's can give good search results when dealing with a topic they've been specifically trained on by human experts, but they're not good at separating human-produced signal from AI slop noise. We've done nothing to prevent a sea of AI slop from being dumped on top all the human signal that's out there. When AI companies enter their enshittification phase and stop investing in expert human trainers, the search results LLM's produce are going to fall off a cliff. Search is a bigger problem than ever.

_____

[1]https://9to5mac.com/2024/02/19/reddit-user-content-being-sol...

Post reply on HN