Live data from Hacker News

UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

gizmodo.com

1–10 of 86 posts

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#6
I suspect part of the problem with this approach relates to data set construction. Even though models these days should theoretically be able to handle this task, there are clear ethical concerns and practical issues with making datasets of illegal imagery large enough for training. It really raises the question - is creating a dataset like that ethical, assuming the intentions are to stop further abuse and dissemination?

There might be work arounds (like training one model for nudity and another for age) but such approaches are almost certain to have "suboptimal" performance as compared to a single model trained on a relevant dataset. Maybe something like that is the cause for the performance issues discussed in the article.

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#7
> With the help of Silicon Valley providers, AI could be trained to detect abusive images "within two-three years", Mr Stokes said.

If the goal is to get something so high quality that the police won't ever have to look at it, I doubt it. You have Google and Facebook employing people to deal with user reports about this stuff, as well as ad companies manually checking websites.

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#8

There are some training techniques that rely on negative examples to improve classification, though I'm not sure they exist for images

Well, this can somewhat be accomplished by classifying exactly what an image isn't, but as you can imagine, that is (in the general case) a combinatoric nightmare.
Post reply on HN