Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

wired.com

Post reply on HN
Print view View original

141–150 of 294 posts

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#141

Post by gs17 »

jhartikainen wrote: post #85
Kalanos wrote: post #38

What's crazy is how long it takes to report something like this to a big company and actually have them take action on it. I remember 10 years ago I reported a Giphy ad for the same thing, and it took them months to take action.

Out of curiosity, I've ran some experiments on Facebook for stuff like this. Results: - Reporting a message does nothing no matter how much the content breaks their terms of use. 100% of messages I reported bounced back in a matter of minutes with "no action" - However, using the "request another review" function, which is available after the initial "no action" response, actually seems to work. How quickly this work…

Interesting, I've kind of made a hobby of reporting scams and hate speech and watching it take a week to come back with "it's no violation", requesting another and getting the same response in another week. I've never seen them do anything no matter how obvious or awful it is.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#142

Post by anamexis »

ASalazarMX wrote: post #112
burningChrome wrote: post #67

Earlier quoted context omitted.

This is so true. When you have a billion users, you can literally lose hundreds of millions of users and it wouldn't make a dent. The only way is to get the government involved and regulate this and just keep hammering them with massive fines that really make a dent in their bottom line. For a lot of people, government regulation of this sort is not desirable, but at what point does someone need to drop the hammer to…

I guess you're used to standard billions (a million millions). A US billion would certainly suffer from losing hundreds of millions, you're talking about a double-digit percent.

I doubt they are saying any services out there have 1,000,000,000,000 users.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#143

Post by SwellJoe »

zakki wrote: post #130
EmbarrassedHelp wrote: post #125

Earlier quoted context omitted.

The other answer is that the people creating these ads have the resources to continuously try and bypass filters/moderation.

If there is filters/moderation.

There are, but only for using IP of large corporations. If you put 12 seconds of a major label song in your video review of an album, that video belongs to the major label now.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#144

Post by ben_w »

zakki wrote: post #130
EmbarrassedHelp wrote: post #125

Earlier quoted context omitted.

The other answer is that the people creating these ads have the resources to continuously try and bypass filters/moderation.

If there is filters/moderation.

There are basically always filters of some kind, though not necessarily the ones we want. The bigger the target that filter represents, the more effort is spent breaking it.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#145

Post by ben_w »

meric_ wrote: post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

> I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number.

It's Facebook's problem if Facebook can't do the things Facebook is required to do. "Oh no it is hard"? Tough. Either they find a way or find they're no longer allowed to do this business.

> This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopefully detection and moderation will catch up

AI *might* solve this, or Meta's AI may be trapped in an arms race with advertisers trying to get around it for whatever reason has driven them to do this in the first place; but fully automated mass-generation of personalised ads was never a mandatory part of their business plan, so it was a problem they never needed to have.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#146

Post by [deleted] »

meric_ wrote: post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

[deleted]

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#147

Post by uncletammy »

ryanjshaw wrote: post #135
craftkiller wrote: post #60

I've noticed on YouTube I see a lot of adult sexual ads. Things like home cleaning ads that have an unmistakable wood-grain image of fellatio. I've always wondered "how are these getting past the moderators?". I guess the answer is the obvious one: no one is moderating anything.

Google Play Store showed my child an ad of a bloody body on a bed for a murder mystery game. The game was rated 18+ and the account had my daughter’s correct single digit age. I reported the ad and a week later it was still there. I switched to Apple.

How did that work out for you? Safer? What was the experience switching, for you and for your kid?

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#148

Post by sandcat_ »

meric_ wrote: post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

Posts? Fair. But adverts? There is literally no reason they cannot all be human moderated. Every single one. People are paying to have their adverts placed. Put a small fee on each ad, if they must, for the initial review. Done.

Don’t buy into Meta’s narrative that there’s nothing that can be done while they continue to make money hand over fist.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#149

Post by ryanjshaw »

uncletammy wrote: post #147
ryanjshaw wrote: post #135

Earlier quoted context omitted.

Google Play Store showed my child an ad of a bloody body on a bed for a murder mystery game. The game was rated 18+ and the account had my daughter’s correct single digit age. I reported the ad and a week later it was still there. I switched to Apple.

How did that work out for you? Safer? What was the experience switching, for you and for your kid?

Haven’t seen any bloody bodies advertised to my child… yet.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#150

Post by PostOnce »

meric_ wrote: post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

They make 200 billion dollars a year, 60 billion of which is profit, so they could afford to hire a million more moderators at first world wages (50k/yr) and still be making 10 billion dollars a year in profit, and that's assuming nothing else changed, if they stopped spending money on VR, AI, and other horseshit, they'd have even more money for moderators.

They can also choose to show fewer ads, i.e., only show manually human reviewed ads, and if there are too many to review, charge more per ad until there aren't too many.

Post reply on HN