Live data from Hacker News

Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

wired.com

71–80 of 294 posts

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#71

All their fines are merely a cost of doing business, and they won't change their ways until the fines hurt.

As it should be. If the cost of fixing the problem is greater than the amount of harm the problem is actually causing to society, then it shouldn't be fixed. Set fine amounts accordingly. (Whether we actually do set fines this way is, of course, questionable. And probably this particular problem would get fixed even if there were no fine merely because of the reputational damage it's causing, but I'm speaking in generalities here.)

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#72

> but as Wired notes, it relies on "automated tools" as part of the process, which may have been how the more than 50 ads TTP discovered made it through. Again, and again, and again, these technologies have proven ineffective to moderate content. User posted and otherwise. Until we have a legal mechanism in place to hold these companies meaningfully liable for this, it will not stop. Every single one of these has the…

We used to say computers can't make decisions because they can't meaningfully be held responsible for those decisions. Now the vibe seems to be that computers should make decisions because instead of anyone being held responsible we can just say "the computer made a mistake and it is very sorry" and effectively shield anyone from being responsible. But the thing is, machines don't do stuff. Not from a responsibility standpoint. My car doesn't drive, I do. It may provide the means, but I decide where we're going and how we're going there. Even with the active cruise on, the car didn't speed, I did. The car may have hit the wall, but I caused the accident. the car ran that person over, but I killed someone, not the car. The machine did what someone told it to do. If someone told it to do a bad thing, or someone did a bad job telling it not to a bad thing, that person is responsible.

When people started using Grok to make CSAM the platform's response was to paywall image generation. If we don't start making the driver responsible for what the car does, the coder responsible for what the code does, the CEO responsible for what the company does, they will continue to exploit people in increasingly horiffic ways.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#73
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

> At this scale it's pretty mind bogglingly difficult to moderate down everything.

no, it's just more work, and it's not like facebook could not afford to pay more people

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#74
post #10

Earlier quoted context omitted.

But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful. --- This is sarcasm, by the way. Most decent people make sure what they're abou…

> But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful. you say sarcasm, but i think this is literally true. this isn't a defense of…

I agree and the obvious solution is: Nothing should exist at that scale. In fact, "Able to effectively moderate your product," strikes me as an excellent standard to hold them to, then let their product find the natural usercount and price point they can manage.

Who ever said that companies should have the right to exploit network effects to dominate online communications?

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#75
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

Have you considered that some service just shouldn’t exist in their current form if they cannot be made to not offer illegal content representing minors?

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#76
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

Your right! We should also reduce food safety requirements for McDonalds and other large restaurants. At their scale it’s just too hard to keep everything clean.

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#78
post #71

All their fines are merely a cost of doing business, and they won't change their ways until the fines hurt.

As it should be. If the cost of fixing the problem is greater than the amount of harm the problem is actually causing to society, then it shouldn't be fixed. Set fine amounts accordingly. (Whether we actually do set fines this way is, of course, questionable. And probably this particular problem would get fixed even if there were no fine merely because of the reputational damage it's causing, but I'm speaking in gene…

you don't think one of the world's biggest media platforms disseminating CSAM is causing meaningful harm to society?

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#79
post #26

So that's why they are lobbying for age verification, i.e ID verification?

no age verification is not ID verification

through meta might have lobbied on both

but they lobby for specific (often pretty bad) forms of age verification to be able to

- spy on people better

- have a regulatory moat where due to beady designed laws new alternatives have a much higher hurdle/initial investments and in turn never get anywhere

Re: Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery

#80
post #57

I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number. This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopef…

In many industries, if you can't do something safely, you simply can't do it at all. Maybe yeah, if you can't build a sufficiently strong automated system, then you need human moderators across a huge number of locations. Them's the breaks for running a wildly profitable service that half the world's population uses.
Post reply on HN