Live data from Hacker News

Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

wired.com

81–90 of 293 posts

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#82

36 million CSAM media removed in 2025? Why aren't millions of people in jail? Wtf?

In most western countrys, is often more than 50% from CSAM from underaged teenagers, like selfies etc. And then are cases like some overmotivated parents post nude baby pictures. I guess such pictures also get flaged. But even if its just 50%, 18 million, your point still standes. Why are not more people in jail.

The US is already among the highest incarceration rate countries in the world. https://en.wikipedia.org/wiki/Comparison_of_United_States_in...

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#83
post #38

What's crazy is how long it takes to report something like this to a big company and actually have them take action on it. I remember 10 years ago I reported a Giphy ad for the same thing, and it took them months to take action.

Meta doesn't have to give a shit, because they're huge.

Tiny providers have to scramble, because they'll be destroyed by a single failure to handle it fast enough.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#85
post #38

What's crazy is how long it takes to report something like this to a big company and actually have them take action on it. I remember 10 years ago I reported a Giphy ad for the same thing, and it took them months to take action.

Out of curiosity, I've ran some experiments on Facebook for stuff like this.

Results:

- Reporting a message does nothing no matter how much the content breaks their terms of use. 100% of messages I reported bounced back in a matter of minutes with "no action"

- However, using the "request another review" function, which is available after the initial "no action" response, actually seems to work. How quickly this works seems to vary, I've had actions taken as result of this from 1 day to multiple weeks.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#86

I've noticed on YouTube I see a lot of adult sexual ads. Things like home cleaning ads that have an unmistakable wood-grain image of fellatio. I've always wondered "how are these getting past the moderators?". I guess the answer is the obvious one: no one is moderating anything.

There have been Youtube ads that are undeniable scams for years, so it's no surprise it's compleatly unmoderated.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#88

Somewhat related: open YouTube in an incognito window. Search something rather innocuous like "news". Click the first thing then go back to the main page. You have to watch through the ad. The amount of slop you will get suggested as soon as the algorithm warms up is nuts. The ad you are first served might also be slop. I mean AI generated video advertising overt bogus cures (a memorable one recently - "did you know…

Part of me would like to stop paying for a youtube premium family subscription because they keep raising the price, but my mom watches it a lot and I don’t want her to see (or have to see) those ads. They’re so unbelievably bad. It can’t be good for your brain to watch, the few times I’ve seen them on my work computer I can’t help but watch part of them.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#89
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

The entire world has social standards that people generally abide by in private residences -- set by the owners of those residences. Just because something is happening everywhere, doesn't mean another thing can't happen too.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#90
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

tbf they generally don't even try with moderation. A few years back they made a multimillion pound settlement with a UK consumer finance guru who was sick his face being used to fake endorsements of scam products promoted mainly via Facebook ads

So you'd think that a sophisticated tech company that had paid that financial penalty would find it pretty easy to have a simple text filter for "Martin Lewis" and perhaps even an image filter for his very distinctive face which pushed those ads into a moderation queue, particularly if they both appear together in the scam-ridden investment opportunity category and the advertiser is a new one (that's probably not going to stick around under that name for very long). But no, they remained a common theme for years afterwards...

And, as the sibling ad points out, if you report stuff that's obvious scams you get told they've reviewed it and found it to be OK. Plus you get more of it promoted into your feed because hitting the report button is a form of interaction with it...

I actually had some sympathy for Facebook when they were condemned for not moderating fake news from Myanmar they have no real capacity to moderate, or condemned for daring to slap the gentlest of content warnings on antivax stuff in contexts they understand perfectly well... but when it comes to ads they get paid for, which is a much smaller fraction of Facebook content that is unambiguously not protected speech or a matter of opinion, their lack of effort is quite something to behold.

Post reply on HN