Live data from Hacker News

Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

wired.com

61–70 of 293 posts

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#61
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

[deleted]

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#62
post #23

Earlier quoted context omitted.

Don’t they have like an 80% gross margin?

the amount of content posted per second to facebook is unfathomable . a quick google (just for a rough order of magnitude) says ~65,000 posts per second . add in instagram (which is worse for CSAM) and its gotta be at least double that. it would require millions on millions of employees, spread across ~every country. between the payroll, buildings and property, equipment, etc. i just dont think its possible at that s…

I would think that they can classify most posts as safe with very high accuracy.

Certainly it’s not unreasonable to have them disprove that

And the scope could be further reduced by looking at posts with more then a few views.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#63

> but as Wired notes, it relies on "automated tools" as part of the process, which may have been how the more than 50 ads TTP discovered made it through. Again, and again, and again, these technologies have proven ineffective to moderate content. User posted and otherwise. Until we have a legal mechanism in place to hold these companies meaningfully liable for this, it will not stop. Every single one of these has the…

More specifically, these were for ads. They received compensation to distribute this matierial.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#64
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

AI is generating ads that will be reviewed by AI that will then be pushed to humans largely to ignore.

Ad pipeline is malware at this point.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#65

I've noticed on YouTube I see a lot of adult sexual ads. Things like home cleaning ads that have an unmistakable wood-grain image of fellatio. I've always wondered "how are these getting past the moderators?". I guess the answer is the obvious one: no one is moderating anything.

Reported an obvious sexual ad the other day and got a very AI generated response that started with "Dear Username" stating that they reviewed the ad and found nothing wrong with it.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#66

Somewhat related: open YouTube in an incognito window. Search something rather innocuous like "news". Click the first thing then go back to the main page. You have to watch through the ad. The amount of slop you will get suggested as soon as the algorithm warms up is nuts. The ad you are first served might also be slop. I mean AI generated video advertising overt bogus cures (a memorable one recently - "did you know…

Youtube is pushing a lot of AI features without creators' consent. Some of it can be turned off but others cannot. It's becoming a major problem. Can't wait till they lose so much money on the infrastructure that they have to remove it all.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#67

All their fines are merely a cost of doing business, and they won't change their ways until the fines hurt.

This is so true. When you have a billion users, you can literally lose hundreds of millions of users and it wouldn't make a dent. The only way is to get the government involved and regulate this and just keep hammering them with massive fines that really make a dent in their bottom line.

For a lot of people, government regulation of this sort is not desirable, but at what point does someone need to drop the hammer to stop this?

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#68

36 million CSAM media removed in 2025? Why aren't millions of people in jail? Wtf?

Does their definition of CSAM exclude material that's not unlawful in the US? People can be (let's say) tactical about its inclusion from case to case. But I can't say if it's the case here, nor how much it explains the 36 million not explained by other better replies.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#69
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

It's not everyone else's fault that executives etc. decided to grow their userbase/business/profits at all costs, i.e. with no concerns for the harms they've been causing. It's similar to how adding more and more code, more and more features, more and more stuff into software increases technical debt. Apparently "growth at all costs" for a business equates to ethical/moral debt, quite obviously in this case. Which shouldn't be surprising to anyone who understands/recognises the mechanisms of greed.

For software, sometimes paying off that debt means getting rid of some of your features/code/stuff. i.e. there's another alternative to "let's AI the AI".

scale the business down. shrink the number of users. make less money.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#70
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

Human moderators? Sure, but Meta products have approximately half the worlds population using them.

It doesn't matter how many people are consuming the ads, it matters how many companies are placing the ads.

Let's not invent excuses for the trillion-dollar tech companies. Meta has plenty of money to put humans in the loop. It just chooses not to because some upper manager needs to buy a fifth house, or a third private island.

Post reply on HN