Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

You either die an MVP or live long enough to build content moderation

mux.com

Post reply on HN
Print view View original

141–150 of 429 posts

Re: You either die an MVP or live long enough to build content moderation

#141

Post by Alir3z4 »

nothrowaways wrote: post #106
Alir3z4 wrote: post #17

Around 1 year ago we got hit badly on our [blogging platform][0] by people/groups submitting fake customer support description of other big companies, either being Microsoft, Facebook, Comcast etc. Rolled out a machine learning model and trained it on the database. 99% of them vanished. Next day, the machine didn't work and success rate was around 5%. Found out, they have learned the trick and now using symbols from…

I would recommend you a different approach, such as using metadata like their location etc.

It was a coordinated attack from many different locations and IPs.

The IP blocking was in place on application level and later into Cloudflare blacklist. Still they would flood in with different IPs and browsers.

Re: You either die an MVP or live long enough to build content moderation

#142

Post by teddyh »

phkahler wrote: post #133

Here's a thought. Have a platform where identity is verified. Users can post publicly or within their circle. Any illegal or fraudulent content can be handled by the legal system due to the lack of anonymity. Beyond that, let users form groups for topics like reddit. Where does this fall down?

Laws are not the same for all people within a circle.

Re: You either die an MVP or live long enough to build content moderation

#143

Post by mfrye0 »

While not a site with user generated content, our version of this was a huge increase in spam accounts.

We offer an API with a free tier. So naturally people would create multiple accounts to avoid having to pay.

It's been a huge lesson in rate limiting, IP blocking, and verifying accounts.

Re: You either die an MVP or live long enough to build content moderation

#144

Post by NavinF »

infogulch wrote: post #77
Y_Y wrote: post #25

Earlier quoted context omitted.

If your eyes can "normalize" a unusual symbols to a common one to make an English word then so can a lookup table. I feel like this isn't a case where you'd reach first for a neural net.

If you can identify text written with mixed glyphs just ban it outright. Normal users don't use text like this, the pure binary presence of such "homomorphic" text at all is probably a better signal for spam than whatever your neural net when running it after normalization.

> Normal users don't use text like this

Sounds like you live in a filter bubble.

(╯°□°)╯︵ ┻━┻

(ﾉ◕ヮ◕)ﾉ*:･ﾟ

Re: You either die an MVP or live long enough to build content moderation

#145

Post by sneak »

Really the future for content moderation are feeds published by site operators and volunteer moderators that individual readers can opt in or out of for filtering.

Relying simply on a central authority to decide what you should be allowed to read is a system with utterly predictable failure modes (not the least of which is too much volume for the centralized mods).

Re: You either die an MVP or live long enough to build content moderation

#146

Post by 8note »

wanderingstan wrote: post #114
airstrike wrote: post #97

Earlier quoted context omitted.

You should post this to Show HN. Also you have a typo on your README ("characgters")

Thanks, I've fixed the typo! It was such a simple project, hardly seems worthy of a "Show HN".

Test for the library: would it catch that that typo still refers to characters?

Re: You either die an MVP or live long enough to build content moderation

#147

Post by PragmaticPulp »

commandlinefan wrote: post #102
dkh wrote: post #81

It drives me absolutely nuts when I encounter a video platform upstart that has not adequately prepared (or prepared at all) for the inevitable onslaught of undesirable and illegal content that users will soon start uploading if the platform has really any traction at all. No UGC site/app is immune. Even when prepared, it is an eternal, constantly-evolving battle as users find more clever ways to try to hide their up…

> It was a year before the resulting back-and-forth with federal agencies You're blaming lack of content moderation and not a law enforcement system that holds you responsible for something you had no control over when it actually failed to do its own job in this case?

> a law enforcement system that holds you responsible for something you had no control over when it actually failed to do its own job in this case?

Investigating these issues is their job. They don’t show up assuming the site operator is the guilty party, but they do need their cooperation in collecting evidence so they can pursue the case.

It’s analogous to a crime being committed on your property. They don’t show up to charge the property owner for a crime someone else committed, but they do need access to the property and cooperation for their investigation.

Re: You either die an MVP or live long enough to build content moderation

#149

Post by [deleted] »

Alir3z4 wrote: post #17

Around 1 year ago we got hit badly on our [blogging platform][0] by people/groups submitting fake customer support description of other big companies, either being Microsoft, Facebook, Comcast etc. Rolled out a machine learning model and trained it on the database. 99% of them vanished. Next day, the machine didn't work and success rate was around 5%. Found out, they have learned the trick and now using symbols from…

[deleted]

Re: You either die an MVP or live long enough to build content moderation

#150

Post by ronsor »

chefandy wrote: post #101
infogulch wrote: post #77

Earlier quoted context omitted.

If you can identify text written with mixed glyphs just ban it outright. Normal users don't use text like this, the pure binary presence of such "homomorphic" text at all is probably a better signal for spam than whatever your neural net when running it after normalization.

> Normal users don't use text like this I think that depends on the users. People copying and pasting bits of text that was in English or another common language— think documentation, code, news articles, tweets, etc.— with a different character set could be problematic. Also, 𝒮ℴ𝓂ℯ 𝒜𝓅𝓅𝓈 marketed as "𝔽𝕠𝕟𝕥𝕤 𝕗𝕠𝕣 𝕤𝕠𝕔𝕒𝕝 𝕞𝕖𝕕𝕚𝕒" would be ℭ𝔞𝔲𝔤𝔥𝔱 𝔲𝔭 𝔦𝔫 𝔱𝔥𝔦𝔰. (math symbols) A user base with…

I can especially echo the "social media fonts" trend. They're quite popular on certain Discord guilds at least.

Minor nitpick, but ツ is the katakana tsu.

Post reply on HN