Live data from Hacker News

AI slop is killing online communities

rmoff.net

211–220 of 781 posts

Re: AI slop is killing online communities

#211
post #189

Earlier quoted context omitted.

Note that "attestation through a web of trust" means something like needing an invite from an existing user. It doesn't have to mean mass surveillance.

Private torrent trackers have been doing this for a while. If some number of your downstreams act like shitheads - you get nipped and so do your other downstreams.

Was it demonoid? That was like this way back in the day? Needed an invite and if you leeched you were cut.

Re: AI slop is killing online communities

#212

Earlier quoted context omitted.

That's definitely the most insidious use, but I think the larger portion is advertisers and karma farmers (who later sell to advertisers).

https://www.npr.org/2024/09/05/nx-s1-5100829/russia-election... If Russia is willing to spend cash like that, then of course they're willing to run massive bot farms to pollute any forums they can. I'd be shocked if the US was not doing the same in any way they can. You have to ask why Trump killed Radio Free America as well when it was clearly not an big expense.

> Trump killed Radio Free America as well

Not sure how this relates to the subject in a direct way. Radio Free America was a outlet explicitly created and utilized to spread US propaganda, but kinda sorta barely disguised as a journalistic enterprise (not really, if you were listening to RFA you knew what you were listening to.) Shutting it down seems to be a counterpoint to all of the covert participation of US intelligence on the web which has done nothing but escalate.

Re: AI slop is killing online communities

#214
post #30

Earlier quoted context omitted.

I think it's going to effectively kill public chat communities without either proof of identity or attestation through a web of trust. Or rather turn them into little better than comment sections on news sites; thriving but worthless. I'm active in a number of online communities that are doing just fine but the difference is those all involve ongoing relationships, built over time and with engagement across multiple…

> I think it's going to effectively kill public chat communities without either proof of identity or attestation through a web of trust. I'm happy to verify my identity as an honest-to-god sack of meat if it's done in a privacy-protecting way. That probably is where things are gonna go, in the long run. Too hard to stop bots otherwise.

That is effectively impossible though. There's data centers of stripped down phones, so "it's actually a phone" doesn't do it.

Re: AI slop is killing online communities

#215

Earlier quoted context omitted.

I agree its a very, very interesting problem. Maybe one of the biggest problems of the coming decade. I suspect it will be a long process: first there will be goverments that force people to use ID, but that will be abused, hacked and considerably restrict freedom of speech, so after that phase people will start to create better ids. The problem is really pretty simple: You need an authoratitive source to say "This p…

*You need an authoratitive source to say "This person is real"* Does that even accomplish much? It may cut down on mass fake account creation. But, real people can then create authenticated account, and use an LLM to post as an authenticated real person.

If there's only 1 or just a handful of verifiers, then a human can at most go through a few of those credentials before they run out. The risk is of course getting someone else's credential but that isn't as big an issue, especially for smaller online communities.

Re: AI slop is killing online communities

#216
post #30

Earlier quoted context omitted.

I think it's going to effectively kill public chat communities without either proof of identity or attestation through a web of trust. Or rather turn them into little better than comment sections on news sites; thriving but worthless. I'm active in a number of online communities that are doing just fine but the difference is those all involve ongoing relationships, built over time and with engagement across multiple…

> I think it's going to effectively kill public chat communities without either proof of identity or attestation through a web of trust. I'm happy to verify my identity as an honest-to-god sack of meat if it's done in a privacy-protecting way. That probably is where things are gonna go, in the long run. Too hard to stop bots otherwise.

I guess it would have to be something like a service which confirms whether a person already has an account on the site but doesn’t have to track which particular account it is.

I’m not sure if that would work for account deletions though.

Re: AI slop is killing online communities

#217

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

Do you have an example of comments people engaged with?

Re: AI slop is killing online communities

#218
post #30

Earlier quoted context omitted.

I think it's going to effectively kill public chat communities without either proof of identity or attestation through a web of trust. Or rather turn them into little better than comment sections on news sites; thriving but worthless. I'm active in a number of online communities that are doing just fine but the difference is those all involve ongoing relationships, built over time and with engagement across multiple…

Note that "attestation through a web of trust" means something like needing an invite from an existing user. It doesn't have to mean mass surveillance.

Which is, funnily (?) enough, how a lot of IRL organizations used to be. And basically don't be of the wrong ethnicity or religion.

It still happens more informally today, of course, but it used to be a pretty (if un-spoken) part of how a lot of WASPy organizations operated to a greater or lesser degree.

Re: AI slop is killing online communities

#219
post #24

I have largely written Reddit off and no longer visit it after an experiment I did where I had an agent karma farm for me and do some covert advertising. As I went through the posts it wrote I realized that as a reader I would have NO idea that these were just written by a computer. Many many people (or other bots) had full on conversations with it and it scared me a bit. I am not quite there with Hacker News but I d…

I've been on the Internet for decades at this point and one thing I've noticed is that communities that, for example, ban political topics actually mean "positions I don't like" as "political". This is somewhat related to the Overton window but really a bunch of (mostly conservative) ideas get normalized so aren't deemed "political". I see the same thing with "AI Slop". Yes, there is AI Slop but (IME) it's pretty eas…

> I've been on the Internet for decades at this point and one thing I've noticed is that communities that, for example, ban political topics actually mean "positions I don't like" as "political".

This happens on HN all the time. For a lot of downvoters and flaggers, there are two kinds of opinions: "Things I agree with" and "Too political for HN."

Re: AI slop is killing online communities

#220
post #30

Earlier quoted context omitted.

I think it's going to effectively kill public chat communities without either proof of identity or attestation through a web of trust. Or rather turn them into little better than comment sections on news sites; thriving but worthless. I'm active in a number of online communities that are doing just fine but the difference is those all involve ongoing relationships, built over time and with engagement across multiple…

> I think it's going to effectively kill public chat communities without either proof of identity or attestation through a web of trust. I'm happy to verify my identity as an honest-to-god sack of meat if it's done in a privacy-protecting way. That probably is where things are gonna go, in the long run. Too hard to stop bots otherwise.

In order to make this viable, wouldn't you have to verify identity repeatedly? What's to stop me from providing a valid identity and then handing my account over to an agent after I'm verified?
Post reply on HN