Live data from Hacker News

UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

gizmodo.com

11–20 of 86 posts

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#11

There are some training techniques that rely on negative examples to improve classification, though I'm not sure they exist for images

Well, this can somewhat be accomplished by classifying exactly what an image isn't , but as you can imagine, that is (in the general case) a combinatoric nightmare.

You can just do binary classification. That makes the decision boundary a bit more complicated, but if you're using neural networks, that is solved by adding another layer at the end.

The "problem" here is probably not the lack of negative training data, but just that they want as few false negatives as possible, so they use a very sensitive model. That naturally increases the number of false positives. It's still a win if you only have to look at some desert pictures instead of literally every picture on someone's computer.

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#12

There are some training techniques that rely on negative examples to improve classification, though I'm not sure they exist for images

Well, this can somewhat be accomplished by classifying exactly what an image isn't , but as you can imagine, that is (in the general case) a combinatoric nightmare.

You don't do it for all of them, just for the ones that are getting confused

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#13

I suspect part of the problem with this approach relates to data set construction. Even though models these days should theoretically be able to handle this task, there are clear ethical concerns and practical issues with making datasets of illegal imagery large enough for training. It really raises the question - is creating a dataset like that ethical, assuming the intentions are to stop further abuse and dissemina…

Ethical is a tricky issue here. Not everyone agrees that mere possession of such pictures is unethical.

This still leaves the obvious legal problems of having a database of illegal pictures, but we already let law enforcement do otherwise illegal things (including use of illegal pictures in some contexts)

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#15

> With the help of Silicon Valley providers, AI could be trained to detect abusive images "within two-three years", Mr Stokes said. If the goal is to get something so high quality that the police won't ever have to look at it, I doubt it. You have Google and Facebook employing people to deal with user reports about this stuff, as well as ad companies manually checking websites.

There would be a significant benefit to just being able to reliably get rough numbers plus some examples of the worst pictures for an expert to grade rather than having the task of searching 10000 horrific pictures to see if any fall into certain categories.

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#16
post #14

A bigger question is why does the police spend time looking for pornography? What type of society is the UK developing into?

Isn't this specifically intended to identify images of child abuse though, rather than rifle through the average users pornhub cache?

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#18
post #14

A bigger question is why does the police spend time looking for pornography? What type of society is the UK developing into?

Not a great one, but that's not new. We've been getting incrementally more draconian surveillance and laws for some time.

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#19
post #16
post #14

A bigger question is why does the police spend time looking for pornography? What type of society is the UK developing into?

Isn't this specifically intended to identify images of child abuse though, rather than rifle through the average users pornhub cache?

Yes, but we are in fact getting a nation wide porn filter in the near future.

Re: UK Cops Want to Use AI to Spot Child Abuse But It Mistakes Desert Pics for Nudes

#20
post #10

Not unexpected. It's surprisingly difficult to tell your arse from your elbow: http://stupidstuff.org/ass_elbow/

But... I... I just want to know the answers. That reset quiz button... It’s... Why?

lol! The missing "submit" and only a "reset" button also drove me nuts!!! That page actually does some javascript code, which is not currently working. (you can see this when you click on one of the options while in console/devtools).
Post reply on HN