Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

wired.com

Post reply on HN
Print view View original

121–130 of 294 posts

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#121

Post by carljungslabtek »

otherayden wrote: post #116
godwinson__4-8 wrote: post #45

Somewhat related: open YouTube in an incognito window. Search something rather innocuous like "news". Click the first thing then go back to the main page. You have to watch through the ad. The amount of slop you will get suggested as soon as the algorithm warms up is nuts. The ad you are first served might also be slop. I mean AI generated video advertising overt bogus cures (a memorable one recently - "did you know…

I tried this experiment out and it is right on the money. The ad I got was AI generated video with AI script & audio selling fake 16TB SSDs. Wonder if anybody has some insider info on how these ads are produced at scale / who's behind them

There is a whole dark ecosystem now for “UGC” (user generated content) and that includes services trying to disrupt it with AI. Ironically, (or fittingly?) the best research I’ve seen was via youtube videos.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#122

Post by cucumber3732842 »

andy_ppp wrote: post #95

If any of us did that clearly we’d be in jail for several years and put on the sex offenders register but when Meta appear to be hugely responsible for increases in teen suicide or crimes like these we get nothing. If corporations want the rights of individuals they equally should shoulder our shared societal responsibilities as well. I honestly don’t get how they can just pretend they aren’t responsible somehow beca…

>If any of us did that...

You don't have Metas legal team nor does the power structure find your valuable to have helping them out nor can you harm them if you don't like them.

There was, quite famously, a man who got away with these sorts of things for quite some time. He owned an island. I can't recall his name....

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#123

Post by Dylan16807 »

mplewis wrote: post #78
Ajedi32 wrote: post #71

Earlier quoted context omitted.

As it should be. If the cost of fixing the problem is greater than the amount of harm the problem is actually causing to society, then it shouldn't be fixed. Set fine amounts accordingly. (Whether we actually do set fines this way is, of course, questionable. And probably this particular problem would get fixed even if there were no fine merely because of the reputational damage it's causing, but I'm speaking in gene…

you don't think one of the world's biggest media platforms disseminating CSAM is causing meaningful harm to society?

First let's not use an unqualified label of "CSAM" when talking about generated images.

But if a thousand people see some ad then the amount of damage is not much compared to their overall business. I'd go for a healthy penalty on top, and adding in more transparency to make sure they don't hide the real extent of the problem, but it's still probably small to them.

Getting Facebook to put in a reasonable amount of blocking effort is good. But it wouldn't fully fix the problem.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#124

Post by carljungslabtek »

olelele wrote: post #111
carljungslabtek wrote: post #88

Earlier quoted context omitted.

Part of me would like to stop paying for a youtube premium family subscription because they keep raising the price, but my mom watches it a lot and I don’t want her to see (or have to see) those ads. They’re so unbelievably bad. It can’t be good for your brain to watch, the few times I’ve seen them on my work computer I can’t help but watch part of them.

Install Brave Browser for your mom?

It’s mostly on her tv so I don’t really know how to get around that, at least not in a way that’s easier and more reliable than paying. I tell myself at least it’s cheaper than cable haha.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#125

Post by EmbarrassedHelp »

craftkiller wrote: post #60

I've noticed on YouTube I see a lot of adult sexual ads. Things like home cleaning ads that have an unmistakable wood-grain image of fellatio. I've always wondered "how are these getting past the moderators?". I guess the answer is the obvious one: no one is moderating anything.

The other answer is that the people creating these ads have the resources to continuously try and bypass filters/moderation.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#126

Post by carljungslabtek »

archildress wrote: post #98
andy_ppp wrote: post #95

If any of us did that clearly we’d be in jail for several years and put on the sex offenders register but when Meta appear to be hugely responsible for increases in teen suicide or crimes like these we get nothing. If corporations want the rights of individuals they equally should shoulder our shared societal responsibilities as well. I honestly don’t get how they can just pretend they aren’t responsible somehow beca…

Our regulatory framework is so asleep at the wheel. It is as if there is this unpierceable veil if you operate as a corporate entity, as if multiple people's combined transgressions are less than a single person doing it.

Is it really asleep at the wheel or is it that decades of intense lobbying have crippled it? I mean of course it’s both, but I think it’s important to point out that it’s not just negligence, it’s more nefarious and selfish than that.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#127

Post by croes »

giantrobot wrote: post #93
croes wrote: post #48

Earlier quoted context omitted.

Bots, good luck finding the people responsible for them. Also how much of the child exploitation material was created by the children themselves? Teenagers who send each other nude photos are creating child exploitation material but you hardly want to put them jail for that.

> Teenagers who send each other nude photos are creating child exploitation material but you hardly want to put them jail for that. Well rational thinking people wouldn't. A great many using CSAM as a wedge to de-anonymize the Internet or institute regressive "profanity" laws are often neither.

It’s hard to discuss that topic properly because many people see pedophile rings everywhere.

They forget most child abuse happens in the family.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#128

Post by duped »

john_strinlai wrote: post #18
duped wrote: post #10

Earlier quoted context omitted.

But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful. --- This is sarcasm, by the way. Most decent people make sure what they're abou…

> But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful. you say sarcasm, but i think this is literally true. this isn't a defense of…

The point I'm making is they're not entitled to scale a business if they can't scale responsibly

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#129

Post by golemiprague »

collinmcnulty wrote: post #80
meric_ wrote: post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

In many industries, if you can't do something safely, you simply can't do it at all. Maybe yeah, if you can't build a sufficiently strong automated system, then you need human moderators across a huge number of locations. Them's the breaks for running a wildly profitable service that half the world's population uses.

Then let's not have any infrastructure or services because some people use it to commit crimes. The car industry doesn't prevent accidents, the telecom industry doesn't prevent scams, the school industry doesn't prevent bullying, the nightlife industry doesn't prevent rape or drug use and i can go on and on. You can't have a perfect system, people will do what they do, all you can do is trying to prevent those crimes but don't expect 100% success rate and certainly you can't stop everything.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#130

Post by zakki »

EmbarrassedHelp wrote: post #125
craftkiller wrote: post #60

I've noticed on YouTube I see a lot of adult sexual ads. Things like home cleaning ads that have an unmistakable wood-grain image of fellatio. I've always wondered "how are these getting past the moderators?". I guess the answer is the obvious one: no one is moderating anything.

The other answer is that the people creating these ads have the resources to continuously try and bypass filters/moderation.

If there is filters/moderation.
Post reply on HN