Live data from Hacker News

Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

breakermag.com

101–110 of 388 posts

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#101

It’s more clear to me than ever now that the left and the right do not use the word “racist” the same way. The left thinks of racism in terms of outcome and the right thinks of racism in terms of intent. We could benefit from better language around these concepts, and honest dialogue about them too.

There's a severe problem forming in today's outrage climate, and I'm not really sure how to even address it.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#102

Earlier quoted context omitted.

> "This is because of the regretful (but understandable) decision to censor discussion of it on Less Wrong, which backfired spectacularly." Can you explain the (understandable) rationale behind Less Wrong censoring discussion of Roko's Basilisk? I've been lead to believe it was censored out of fear that discussing it could somehow inspire its actual creation. Honestly from a distance Less Wrong has always struck me a…

Cults don't write about how to avoid being a cult, while the LW crowd has reams of texts and blog posts about how they are purposefully avoiding trying to become a cult.

Cults do talk quite a bit about why they're not a cult.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#103
post #74
post #65

Earlier quoted context omitted.

> There is no design of AI that can be simultaneously utilitarian, procedurally fair, and representatively fair. AI is just tools of humans. Any system that can be achieved with humans can also be achieved with AI. These AIs take us backwards from our existing human systems in addition to being much harder to correct later. The supermarket theft example in the slides you linked to is a prime example. In what store in…

> Any system that can be achieved with humans can also be achieved with AI. I hope you meant it the other way around.

What I'm trying to say is that inasmuch as you consider the current legal and cultural environment of America to be utilitarian, procedurally fair, and representatively fair, any system that could be built using AI can achieve the same. I don't believe that they will a priori deliver an improvement. But there's no excuse for AI systems to show any discriminatory biases that have already been minimized in human systems via legislation, training, etc.

Don't misunderstand me; I'm not saying that discrimination doesn't exist or that we live in a society with no biases. I'm saying there is no valid reason why AI should take us backward in that regard.

Computers are extensions of the will of man. Our AI researchers and developers should ask themselves what kind of society they want to create. Whether they choose to turn a blind eye to discrimination and bias, or choose to actively combat it, then that will determine the result. Civil rights didn't just happen; there were people fighting for it actively. The same has to occur in the digital world if the same result is desired.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#104

Earlier quoted context omitted.

Thinking of racism in terms of the intent is a way to take the issue less seriously, to force the issue into the realm of opinions and beliefs. If the intent of the perpetrator is the deciding factor, then it is always arguable that perpetrator's intent was not specifically racist; perhaps it was driven by a misunderstanding, etc. Since it was informed by misunderstanding, it isn't racist. And so on. It's an old tact…

Racism is discrimination based on race, everything else is not racism.

I think it's important to note that there is no algorithm that can have an "intent". If we are to agree that racism is a feature of intent, then there will never be a racist algorithm. Yet the outcome will still be discriminatory.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#105

I thought we got over "the computer is never wrong" fallacy by the end of the 90s. Anyone involved with computing should know GIGO - Garbage In Garbage Out.

So you are saying any data for which any input feature is correlated with race or sex is garbage. That's going to make doing useful data science incredibly difficult with anything involving humans.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#106

Earlier quoted context omitted.

The problem here is, we don't even know what "fair" means. What do we mean by fair? Say we want to base fair on group outcomes, in which ways should we divide people into groups in order to perform some sort of balancing? Is hair color or texture a relevant way of subdividing people for instance? Are we being "fair" to red haired people? What if red haired people for some reason seem to be less likely to pay back loa…

The problem is the self-reinforcing, external factors that these algorithms don't take into account. If you feed a ML algorithm crime stats, it will conclude crime is directly correlated to being black, or being a former criminal. But this correlation only exists because of how we've chosen to conduct the policing of black communities and treatment of ex-cons upon release that produced the the training data in the fi…

> How'd you like paying more for insurance than your parents because some system decided men are bad drivers, and doubly so when they're young? Triply so when they happen to be driving a red car?

isn't this how it already works? young males cause a disproportionate amount of insurance claims so they get assessed higher rates. they'll even bump your premiums for driving the performance version of a given car. being a young male, I certainly don't like it, but I'm not sure I would call it unfair.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#107

Earlier quoted context omitted.

The problem here is, we don't even know what "fair" means. What do we mean by fair? Say we want to base fair on group outcomes, in which ways should we divide people into groups in order to perform some sort of balancing? Is hair color or texture a relevant way of subdividing people for instance? Are we being "fair" to red haired people? What if red haired people for some reason seem to be less likely to pay back loa…

Maybe don't split groups on genetics/biology/birth. Also make sure the data you use is not a proxy for the above criteria

Easier said than done.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#108
post #47

Earlier quoted context omitted.

The problem here is, we don't even know what "fair" means. What do we mean by fair? Say we want to base fair on group outcomes, in which ways should we divide people into groups in order to perform some sort of balancing? Is hair color or texture a relevant way of subdividing people for instance? Are we being "fair" to red haired people? What if red haired people for some reason seem to be less likely to pay back loa…

> Is hair color or texture a relevant way of subdividing people for instance? Are we being "fair" to red haired people? What if red haired people for some reason seem to be less likely to pay back loans? Machine learning is going to be very good at identifying proxies for features we don't like, even if we don't directly provide those features. Weighting red hair color could be a proxy for the Irish, targeting hair t…

"And we have to find a way to make sure that The Algorithm (tm) doesn't just find a way to machine-learn redlining or some other proxy for race or other protected characteristics."

This is not wrong, but it boils down to "don't make mistakes when optimizing functions". It's offensive because it's coming from someone who has nothing to contribute except "do your job better". It's like saying we have a problem with planes crashing, so engineers have a moral duty to build better planes. As though they weren't trying to build planes that stay in the air already. You can make serious sounding statements, or you can impose fines, or you can randomly pick people to publicly shame, but none of those things are positive contributions to hard problems.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#109

It’s more clear to me than ever now that the left and the right do not use the word “racist” the same way. The left thinks of racism in terms of outcome and the right thinks of racism in terms of intent. We could benefit from better language around these concepts, and honest dialogue about them too.

Thinking of racism in terms of the intent is a way to take the issue less seriously, to force the issue into the realm of opinions and beliefs. If the intent of the perpetrator is the deciding factor, then it is always arguable that perpetrator's intent was not specifically racist; perhaps it was driven by a misunderstanding, etc. Since it was informed by misunderstanding, it isn't racist. And so on. It's an old tact…

> If the intent of the perpetrator is the deciding factor, then it is always arguable that perpetrator's intent was not specifically racist; perhaps it was driven by a misunderstanding, etc. Since it was informed by misunderstanding, it isn't racist.

Are you saying that this is racism. Most people would define what you outlined as not rascist.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#110
post #11

There is no design of AI that can be simultaneously utilitarian, procedurally fair, and representatively fair. I'm going to repeat this again, since many people struggle with this. It is _literally impossible_ to achieve the best utilitarian outcome, the most procedurally fair outcome, and a representatively fair outcome. Anyone designing algorithms will have to make tradeoffs along this frontier. For a far better ar…

This sounds an awful lot like voting impossibility theorems (Arrow's and its generalizations)... are they related?

I don't think so. This is simpler, it's just stating that an optimization problem on a constrained information set must be weakly dominated by the full information set.

Arrow's theorem is a more domain specific and elegant proof regarding political properties that can be simultaneously held.

Post reply on HN