Live data from Hacker News

Ask HN: Any open source code/materials on predicting future crimes based on data?

news.ycombinator.com

31–40 of 61 posts

Re: Ask HN: Any open source code/materials on predicting future crimes based on data?

#31

I am currently writing my master thesis on predictive policing using machine learning. Working with local police in Norway. Got a bunch of papers and articles you might find interesting. Hit me up: michaedm@stud.ntnu.no

I hope you will be an innocent target one day.

Re: Ask HN: Any open source code/materials on predicting future crimes based on data?

#32
post #15

Earlier quoted context omitted.

All I want to predict is time periods/locations which are vulnerable. Nothing more than that.

Racism is morally wrong but not mathematically wrong. P(criminal|black) > P(criminal), but if you observe that someone has black skin and treat them poorly because of it, you've done a bad thing. It doesn't matter that you were just following Bayesian reasoning because you're still hurting someone on the basis of something they can't control. Lady Justice doesn't wear a blindfold as a fashion accessory. Discarding in…

> Lady Justice doesn't wear a blindfold as a fashion accessory

I never noticed that before. Thanks for pointing this out!

Re: Ask HN: Any open source code/materials on predicting future crimes based on data?

#33
post #16

In any case, you shouldn't neglect the subtle but important sources of bias those pre-crime models can have. Here's an interesting talk about it: https://www.youtube.com/watch?v=MfThopD7L1Y Basically, one instance of bias is the fact that many crime-prediction models are trained on police data, which means they will predict crime in places more often targeted by the police anyway. Then the model predictions even ampl…

So if the AI identifies insider trading at trading firms, banks, etc., we should beware that this would create a feedback loop to look more into the investment and banking sectors and will ignore the mom and pop insider traders? That they go where crime is rampant over where it isn't and that could be a bad thing?

Re: Ask HN: Any open source code/materials on predicting future crimes based on data?

#34
post #33
post #16

In any case, you shouldn't neglect the subtle but important sources of bias those pre-crime models can have. Here's an interesting talk about it: https://www.youtube.com/watch?v=MfThopD7L1Y Basically, one instance of bias is the fact that many crime-prediction models are trained on police data, which means they will predict crime in places more often targeted by the police anyway. Then the model predictions even ampl…

So if the AI identifies insider trading at trading firms, banks, etc., we should beware that this would create a feedback loop to look more into the investment and banking sectors and will ignore the mom and pop insider traders? That they go where crime is rampant over where it isn't and that could be a bad thing?

I think it's not inherently bad to have a bias, but it's bad if you don't recognize it. In your example:

If you train an AI on data that solely consists of trading firms & banks, you should recognize that it's an AI biased towards detecting activity at trading firms & banks, and that it might be lacking in other areas.

It becomes dangerous when such an AI is marketed and assumed as unbiased and the source of truth for detecting all insider trading activity.

Re: Ask HN: Any open source code/materials on predicting future crimes based on data?

#36
post #16

In any case, you shouldn't neglect the subtle but important sources of bias those pre-crime models can have. Here's an interesting talk about it: https://www.youtube.com/watch?v=MfThopD7L1Y Basically, one instance of bias is the fact that many crime-prediction models are trained on police data, which means they will predict crime in places more often targeted by the police anyway. Then the model predictions even ampl…

Cathy O'Neil wrote a book called "Weapons of Math Destruction" -- interesting read.

You can listen to an interview she does on econtalk -- interesting to learn more about the hidden biases.

http://www.econtalk.org/archives/2016/10/cathy_oneil_on_1.ht...

Re: Ask HN: Any open source code/materials on predicting future crimes based on data?

#37

Careful! Your crime predictor might unfairly conclude that men are more likely to commit crimes than women.

People might conclude the same thing, since more crimes are committed by males than females. Are you saying it's unfair because an innocent male could become a suspect by virtue of only being male? Or for a more subtle reason?

Statistics have been consistent in reporting that men commit more criminal acts than women.[1][2] Self-reported delinquent acts are also higher for men than women across many different actions.[3] Burton, et al. (1998) found that low levels of self control are associated with criminal activity.[4] Many professionals have offered explanations for this sex difference. Some differing explanations include men's evolutionary tendency toward risk and violent behavior, sex differences in activity, social support, and gender inequality.

https://en.wikipedia.org/wiki/Sex_differences_in_crime

Re: Ask HN: Any open source code/materials on predicting future crimes based on data?

#38
Inspired by a Kaggle competition (https://www.kaggle.com/c/sf-crime), one of my older blog posts involved predicting the type of arrest in San Francisco (given that an arrest occurred) using data such as location and timing and the relatively new LightGBM machine learning algorithm: http://minimaxir.com/2017/02/predicting-arrests/

The code is open-sourced in an R Notebook: http://minimaxir.com/notebooks/predicting-arrests/

The model performance isn't great enough to usher in precrime, even in the best case. There are likely better approaches nowadays. (e.g. since the location data is spatial, a convolutional neural network might work better.)

Re: Ask HN: Any open source code/materials on predicting future crimes based on data?

#39
There are much better ways to solve crime than to double down on enforcement that is already happening, which is likely all your model will tell you. “Police the neighbourhoods where people are poor” wow, thanks ML!

Palantir already does all this on a massive scale for the US govt. Want to affect future crime in a positive way? Solve the problems that contribute to it.

Not that you asked.

Re: Ask HN: Any open source code/materials on predicting future crimes based on data?

#40
This is an area that was explored some years ago, but ultimately determined to have civil rights pitfalls. Crime reporting is only as good (or biased) as the humans that report and input the crime data. Therefore, crime "training" data for AI systems can be very biased and it might only magnify those biases more so using AI - a sort of self-perpetuating negative feedback loop.

Having worked in law enforcement at various levels (state and federal) in a prior professional life, I can attest to the differences in what gets reported and how based upon who was working or supervising and where they were assigned. Humans are simply not reliable reporters for this kind of data. No matter how hard we try to make the reports plain and standardized our biases, one way or another, will always seep in.

Post reply on HN