Live data from Hacker News

Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

wired.com

101–110 of 294 posts

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#101
post #38

What's crazy is how long it takes to report something like this to a big company and actually have them take action on it. I remember 10 years ago I reported a Giphy ad for the same thing, and it took them months to take action.

It’s not crazy when you consider that their customers are the advertisers, not you. They want to keep their customers happy and buying more ads.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#102
Meta will do whatever it can to run any and all ads.

Meta knowingly runs scam ads, they just charge more to run them: https://www.reuters.com/legal/litigation/consumer-watchdog-g...

> Reuters also reported that Meta internally projected in 2024 that it would earn about 10% of its overall annual revenue – or $16 billion – from running ads for scams and banned goods, internal company documents show.

At $employer we're CONSTANTLY fighting fake ads cloning our brand. Their various brand protection features seem deliberately inept and ineffective.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#103
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

To my mind the simplest answer is that if it isn’t possible to do it safely then you shouldn’t be able to do it.

Is this firehose of social media actually a societal benefit? I’m less and less convinced that it is.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#104
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

What a terrible outlook. “It’s not possible to do this thing safely at Meta’s scale” is an apologist cop-out. First of all, yes it is, Meta makes tens of billions of dollars of pure profit every year. They were that profitable while blowing tens of billions on the Metaverse debacle! They are not resource-constrained in any meaningful sense.

Secondly, if I’m wrong and it’s not possible, then you stop providing the dangerous service! There’s no reason Meta has to exist in its current form. If it can’t meet basic standards of human dignity in its product offerings, then it should change or cease to exist.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#105
post #20

36 million CSAM media removed in 2025? Why aren't millions of people in jail? Wtf?

That's a really common reaction to people first hearing about the delta between how society talks about the subject vs what they actually do about it. Its a bit like the fiction of the social safety net or strong institutions. The truth is impunity is the rule, victims especially of CSA and CSAM, or revenge porn, or of Mark or Musk's companies generating naked images of their body have basically no power, and its an…

I think AI should the point where companies take some responsibility for the content produced with their tools. When the entire purpose of a machine is a form of thinking there should be some responsibility for what it thinks. It is nothing like a general purpose tool that the user just invokes.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#106
post #65

I've noticed on YouTube I see a lot of adult sexual ads. Things like home cleaning ads that have an unmistakable wood-grain image of fellatio. I've always wondered "how are these getting past the moderators?". I guess the answer is the obvious one: no one is moderating anything.

Reported an obvious sexual ad the other day and got a very AI generated response that started with "Dear Username" stating that they reviewed the ad and found nothing wrong with it.

The Dead Internet Theory is real!

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#107

I've noticed on YouTube I see a lot of adult sexual ads. Things like home cleaning ads that have an unmistakable wood-grain image of fellatio. I've always wondered "how are these getting past the moderators?". I guess the answer is the obvious one: no one is moderating anything.

[deleted]

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#108
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

In many industries, if you can't do something safely, you simply can't do it at all. Maybe yeah, if you can't build a sufficiently strong automated system, then you need human moderators across a huge number of locations. Them's the breaks for running a wildly profitable service that half the world's population uses.

> In many industries, if you can't do something safely, you simply can't do it at all.

Absolutely!

Related story... my wife works in a regulated industry and she was running facebook ads for one of their new products. Facebook had just introduced Ai generated ad-copy and the ad agency didn't know that option was turned on by default so they uploaded all of the ad-copy that was approved by legal and then facebook was running all of these alternative ads that were actually illegal because the copy it wrote were all claims they are not allowed to make in that industry. They only caught it because one of the ads was served to my wife and she immediately noticed it was copy that was not approved and something they could not claim.

I always assumed these shady ads were created by shady people, and I think a lot are, but I wonder how many companies are unintentionally running shady ads because facebook generated those ads.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#109
post #10

Earlier quoted context omitted.

But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful. --- This is sarcasm, by the way. Most decent people make sure what they're abou…

> But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful. you say sarcasm, but i think this is literally true. this isn't a defense of…

"While remaining a going concern."

Well, tough. Maybe they should have to find a way. If that means requiring everybody to have to pay to afford the moderators then so be it. All the other companies would have to as well.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#110

If any of us did that clearly we’d be in jail for several years and put on the sex offenders register but when Meta appear to be hugely responsible for increases in teen suicide or crimes like these we get nothing. If corporations want the rights of individuals they equally should shoulder our shared societal responsibilities as well. I honestly don’t get how they can just pretend they aren’t responsible somehow beca…

Our regulatory framework is so asleep at the wheel. It is as if there is this unpierceable veil if you operate as a corporate entity, as if multiple people's combined transgressions are less than a single person doing it.

Move fast and break literally everything. I am so depressed by what the internet has become. Such potential only to become monopolist behemoth bullshit.
Post reply on HN