Live data from Hacker News

A peek into Reddit's anti-spam internals

lyra.horse

51–60 of 88 posts

Re: A peek into Reddit's anti-spam internals

#51

I cannot emphasize strongly enough just how deeply pervasive the spam is at Reddit. I'm a mod at the ecommerce subreddit, and I've only caught some of the AI-powered marketing operations because in one particular campaign that was making fictional claims about things I had direct knowledge about. Once I looked into the post history, and started to untangle the web of accounts that formed a self-supporting community o…

I'd be surprised if Reddit wasn't selling tools specifically aimed at seting up and managing operations like that

Re: A peek into Reddit's anti-spam internals

#52

I cannot emphasize strongly enough just how deeply pervasive the spam is at Reddit. I'm a mod at the ecommerce subreddit, and I've only caught some of the AI-powered marketing operations because in one particular campaign that was making fictional claims about things I had direct knowledge about. Once I looked into the post history, and started to untangle the web of accounts that formed a self-supporting community o…

The flip side of this is that for many years it's been basically impossible for a real person to convince Reddit to let them have an account. They track so many signals and if they don't like a single one or a combination, you get shadowbanned - I've tried it a few times since then on different computers on different networks with different email addresses, and I concluded they must have an extremely specific idea of…

Once Discord started taking off I was much happier returning to the chatrooms I started with (on IRC), without any algorithm attempting to maximize your engagement. It's much less useful as a resource that grows over time, but the value of something like that has been slashed and burned by LLM's anyway.

In the end the biggest hurdle to getting an account on Reddit at this point is why you'd bother.

Re: A peek into Reddit's anti-spam internals

#53
post #9

Earlier quoted context omitted.

There is some sort of wink wink nudge nudge agreement going on with certain spam accounts. You will see them post article spam with hidden history, and if you look up their posts either via google or any other reddit crawling tool, they are posting all over various subreddits that same article maybe dozens of times. If they comment it is really basic and formulaic and found all over their post histories as well. I fe…

There have been incidents where users who reported certain spambots were themselves banned for "report abuse". It's speculated the operators of those spambots pay money to Reddit to not be banned.

I have a 16 year old account and received my first account warning, ever, for reporting a user's comment (to reddit, not the sub) a single time and the admins disagreeing that it violated the guidelines.

I have screenshots somewhere, but it basically said if I continued to abuse the report feature my account would be banned.

Reddit is a publicly traded company and I sincerely doubt the company is taking some organized racket money on the side. But there is some serious conduct issues with admins, and I won't speculate about their motivations.

Re: A peek into Reddit's anti-spam internals

#54

Based on the current status of my shadowbanned account (I suspect a competitor in our space retaliating), it looks like `banall` only flags posts from the last 6 years. Of course, nobody can view my profile anymore anyway (I'm waiting on appeal), but on my account, only posts from the last 6 years have the "Sorry this post was removed by reddit filters" message.

[dead]

Re: A peek into Reddit's anti-spam internals

#55
post #51

I cannot emphasize strongly enough just how deeply pervasive the spam is at Reddit. I'm a mod at the ecommerce subreddit, and I've only caught some of the AI-powered marketing operations because in one particular campaign that was making fictional claims about things I had direct knowledge about. Once I looked into the post history, and started to untangle the web of accounts that formed a self-supporting community o…

I'd be surprised if Reddit wasn't selling tools specifically aimed at seting up and managing operations like that

I would be surprised if Reddit was selling tools like that directly. Rather than just look the other way - because uncovering modern bot operations is a thankless threadmill, and user engagement metrics from fake users are still user engagement metrics.

Re: A peek into Reddit's anti-spam internals

#56
some more information perhaps?

banned_by true is more accurate to say "admin or automatic". in "admin mode," you can see these although not sure the UX for these nowadays now that it is spewing a gazillion lines of text into them).

Anti-Evil Operations removals (nee Trust & Safety) are generally human(-assisted) actions (although these actions can be applied en masse). there's some more information nowadays in the API which was really nice. it also helped because people stopped blaming "the mods" for removals when the spam filter slopped all over the place. this was also annoying because previously you had to previously guess from the API how it was removed even if you were a mod.

the 3 ways to remove a post/comment (i.e. in reply to: train_spam):

- remove not spam: removes it but doesn't train the spam filter, obvious

- spam: removes it and trains the spam filter, obvious

- confirm spam: only happens when you remove after removing for any reason, *does not* train the spam filter

- reinforce spam: trains the spam filter even if the spam filter already caught it. *does* train the spam filter. you can do this by doing `action: spam` in automod. not sure if there have been any more in the last few years

also you can tell the legacy of "removals", back in the day stories were "banned" instead of "removed" by moderators and administrators.

also also also... you can see a lot of the stuff from this article in the `approved_by` side of it as well. if you hover over a checkmark of someone who has been unshadowbanned, you'll see it says "approved by Reddit (shadowban removed)"

if an admin manually unspams someones stuff (say someone who got accidentally shadowbanned and got hit with an overzealous spam filter multiple times >.>), it'll say "approved by (all)". there are some consequences to this. it approves stuff that has been "filtered" (as AutoMod filtering is a weird hack where it removes something but keeps in the modqueue).

> spammit

i believe this is the thing that is "pretty similar to a naive Bayesian classifier"[1][2] that reddit used. /u/Deimorz iirc was a reddit dev at the time and it was somewhat public info. i say somewhat because you kinda had to be both interested in the this and probably be around the metasphere

iirc from some other comments i pieced together there are also per-subreddit spam filters. in the olden days sometimes they'd get way out of whack and you could ask an admin to reset it for you... or something idk

> em

guessing em in this case btw refers to /u/hueypriest, who was reddit's GM at the time

> would’ve been catastrophic for Reddit’s spam issues

the thing that surprised me at the time was just how bad reddit's spam filtering is. i did a small little thing at the time where i'd just look at stuff following some basic spam filtering rules (like stuff you'd probably get out of an artisinal spamassassin ruleset) and even that deluge was amazing to see.

like the ML stuff is cool and all but seriously 90% of this could probably still be solved with some basic rules. the profile hiding stuff didn't help either but that was way after my time.

[1]: https://reddit.com/r/TheoryOfReddit/comments/10ko5h/comment/... (2012)

[2]: https://www.reddit.com/r/modnews/comments/6bj5de/state_of_sp...

Re: A peek into Reddit's anti-spam internals

#57

I cannot emphasize strongly enough just how deeply pervasive the spam is at Reddit. I'm a mod at the ecommerce subreddit, and I've only caught some of the AI-powered marketing operations because in one particular campaign that was making fictional claims about things I had direct knowledge about. Once I looked into the post history, and started to untangle the web of accounts that formed a self-supporting community o…

I remember reading years ago about some corrupt mod in one of the image subreddits - he or his friend had started some image hosting site and had six different Reddit accounts that he used to upvote posts that used his site and downvote all other posts. It took people a long while to notice what he was up to.

the Unidan incident?

iirc it only got noticed at the time because of an argument between him and Ecka6 which led to the somewhat famous "here's the thing you said a jackdaw is a crow" copypasta

Re: A peek into Reddit's anti-spam internals

#59

I cannot emphasize strongly enough just how deeply pervasive the spam is at Reddit. I'm a mod at the ecommerce subreddit, and I've only caught some of the AI-powered marketing operations because in one particular campaign that was making fictional claims about things I had direct knowledge about. Once I looked into the post history, and started to untangle the web of accounts that formed a self-supporting community o…

The flip side of this is that for many years it's been basically impossible for a real person to convince Reddit to let them have an account. They track so many signals and if they don't like a single one or a combination, you get shadowbanned - I've tried it a few times since then on different computers on different networks with different email addresses, and I concluded they must have an extremely specific idea of…

For the last several years, I’ve created a new Reddit account, posted heavily, and then deleted it when I felt I needed a social-media break. Rinse and repeat. I’ve never had problems creating those new accounts or having them banned. You just need to verify your signup with some new email address, at some domain that isn’t already a known throwaway-email domain, and accept that some subs won’t show your comments until your account is a couple of weeks old.

But I definitely agree with you that the platform is finished now, even smaller subs that aren’t drawing so much surreptitious spam. The problem is that even if one uses Old Reddit, the vast majority of other posters are using the app. That tends to discourage substantial discussion or community, in favour of daft 140-character shit comments.

Re: A peek into Reddit's anti-spam internals

#60

I cannot emphasize strongly enough just how deeply pervasive the spam is at Reddit. I'm a mod at the ecommerce subreddit, and I've only caught some of the AI-powered marketing operations because in one particular campaign that was making fictional claims about things I had direct knowledge about. Once I looked into the post history, and started to untangle the web of accounts that formed a self-supporting community o…

I'm sure you love Reddit's decision to allow users to hide their post history.

I hate that change. arctic-shift.photon-reddit.com still works, at least with comments before the change. Not sure about current comments.
Post reply on HN