Live data from Hacker News

Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

breakermag.com

261–270 of 388 posts

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#261
It's just statistic.

How you collect your data can introduce bias and statistic have a whole range of topics on how to collect data without introducing bias and systematic techniques to sample data. Stratifying data if a certain group is under represented, random sample, etc... Survey analysis goes into hardcore details on how to sample a population to accurately do inference and it's an interesting statistic sub field if anybody is interested.

ML tends to be more here's the data already do something with it.

Statistic encompass everything about the data including how to sample, collect the data, and designing the experiment to collect the correct data to answer your hypothesis. Where as ML is usually here's the data, go figure out what you can get out of it.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#262
post #96

Earlier quoted context omitted.

Are Asians underrepresented at Harvard? Or if you’re referring to something else, can you elobarate?

As I understand it, Asians are "underrepresented" at Harvard relative to what they would be if Harvard judged candidates based on SAT scores, scholastic achievement, and other seemingly-objective-and-reasonably-sensible metrics. They're "underrepresented" relative to the pool of candidates who are qualified to be at Harvard. But they are "overrepresented" compared to the general population of the United States. Which…

> if Harvard judged candidates based on SAT scores, scholastic achievement, and other seemingly-objective-and-reasonably-sensible metrics

I think this type of statement represents the main problem that folks who run down the “Asians at Harvard” rabbit hole.

People assume that Harvard admissions is all just based on who is the biggest brainiac based on grades and SATs, and that’s simply not the case at Harvard or any other elite school.

Decent article on the topic:

https://www.washingtonpost.com/education/2018/10/21/dockets-...

High SAT and high grades gets you merely a 2 (1 being best) in one of four categories (academic, athletic, extracurricular, and personal/leadership). If you get a 2 in three of four categories, it still only gets you a 40% chance of admission.

That said, getting a 1 in any category gives the applicant a bump to anywhere between 48% and 88% chance of admission. Note that only about 100 people per year get a 1 on academic, and that still only gives them a 68% chance of admission if that’s their only 1. Standards are sky high.

To anyone who has high scores and great grades in a rigorous curriculum and wants to apply to an elite school, I advise them to differentiate themselves in ways other than academics — it’s a much easier path to acceptance. In my opinion, these non-academic selection criteria is one of the things that makes top schools amazing places.

Specifically:

- Great grades and great SAT scores (750+ in Math and Verbal) are a baseline for being considered.

- The more of the following list below an applicant can check off, the more likely they are to get admitted. If they have several high quality checks, the requirements for grades and scores can actually decrease to a surprisingly low level:

(rough order of importance... non-exhaustive list)

1. Recruited athlete.

2. Diversity candidate (race).

3. Notable academic achievement (e.g., publish a paper).

4. Demonstrate leadership via some verifiable and substantial project.

5. Be a skilled-but-not-recruited athlete (esp. in non-varsity sports), entertainer, or person of interest (e.g., children of famous or powerful people). Accolades or championships help.

6. Create a substantial and successful business or non-profit.

7. Diversity candidate (geographical).

8. Have an incredible personal narrative (e.g., Malala) — this might be more important... it’s hard to tell.

9. Be the child of an alum.

10. Be the child of a substantial donor (also hard to rate in importance... it really only comes into play if they aren’t admitted normally).

11. School/department applied to (depends on university).

It boggles my mind when someone (Asian or otherwise) points to great grades and great SAT scores and gripes about not getting into an elite school. Elite schools explicitly state that they are looking for well-rounded applicants or “multidimensional excellence”. Why is that person/applicant surprised when they only focused on one dimension and did that in a non-exceptional way (compared to other applicants)?

Anyway, this is a topic I know quite a bit about. Please feel free to ask follow-up questions.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#263

I really wish people would at least skim the wikipedia page to figure out the vocabulary of the field they're about to opine on. The left-progressive use of the word 'bias' is completely different than the way statisticians use the word. If bias increases accuracy/precision, it's not bias. The more interesting question is this - is it permissible for models to consider protected characteristics if those characteristi…

> If bias increases accuracy/precision, it's not bias. Yes it is. It's bias in your fitness function. Accuracy and precision are not handed down by the gods. We write the functions that evaluate our models, and it's our job to make sure that the values they promote match up with the real-world outcomes we desire, and to constantly monitor and re-evaluate those outcomes. Fancier machine learning techniques will never…

But our 'fitness functions' for social problems are normally pretty good or above reproach of the model. These tend to be easy to measure like 'did the person skip bail?'

If a model of 'likelihood to show up to court after making bail' can make better predictions with information about protected characteristics (e.g if the model used sex to predict likelihood to show up in court), that feature would reduce the bias of the model.

I think the issue progressives have with 'bias' is that some of society's prejudices ('bias') have an evidentiary basis. We already make decisions that progressives would tell us are prejudiced but we probably want to use those prejudices if they're useful.

Consider a group of young men standing outside of a Church. If they're all clean shaven, smiling, and 'appropriate' for the Church it's nothing concerning. If they're white guys with shaved heads / neo nazi haircuts, and they don't look nice, and they're standing outside of a black Church, the prejudiced among us might correctly decide to alert the authorities to it.

My personal opinion is that we should allow models to consider protected traits but we should ensure that models that make important decisions aren't prejudiced along those protected traits. The way to measure this is simply to ensure that the accuracy and precision of the classification decisions are comparable among protected traits.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#264

Earlier quoted context omitted.

If his studies basically equated liberal ideology with communism (equal outcomes), I think I'm a lot less inclined to read his book. You know, what I'd really like is for parties or candidates to identify what they think the appropriate GINI coefficient should be for the US.

>If his studies basically equated liberal ideology with communism (equal outcomes) It's an easy mistake to make, but Communism (at least as Marx and his contemporaries and Lenin envisaged it) does not have anything to do with the principle of equal outcomes except in a very narrow sense - this sense being equality of privileges to some portion of society.

I think the bigger issue is that I've never anyone other than conservatives characterize liberals as believing in "equal outcomes". That's a slanted frame from the getgo.

Among democrats and liberals, it's usually "equal opportunity" or "equal starting lines", language like that. That's very different than "equal outcomes" because it still believes in self-reliance, merit, diversity in outcomes, etc - it's just that it requires a level of fairness that applies to everyone.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#265

Earlier quoted context omitted.

Cults do talk quite a bit about why they're not a cult.

They even have an essay about _cultish countercultishness_: https://www.lesswrong.com/posts/gBma88LH3CLQsqyfS/cultish-co... I think some of the feeling of cultishness might stem from a homogeneity of expression, but it kinda makes sense for a community of people dedicated to being rational -- after all, two rational agents with identical priors cannot "agree to disagree" in the mathematical sense. The community would…

Have they ever addressed the criticisms of rationality, technological rationality and instrumental rationality of the Frankfurt School in the 50s and 60s? Or, more generally, the critique of positivism and the collapse of rationality to facts connected with formal logic? These are fairly big topics in philosophy, so it would seem really naive if they haven't covered them.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#266
post #107

Earlier quoted context omitted.

Easier said than done.

I know, this is why all this algorithms should not be hidden/proprietary. At least we have a chance to spot why/how the computer decided my fate.

The problem is that in many cases (especially with deep learning), "the algorithm" is essentially a black box. There often isn't a straightforward way to determine exactly what the algorithm is actually learning.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#267

Earlier quoted context omitted.

Are you saying that face recognition calling black people gorillas is a good thing that we should all be unconcerned about?

What makes you think that? No, of course not. I'm just saying having read that gorilla story doesn't imply any degree of technical understanding. Also, I have to say I considered it hyperbole to be outraged about the Gorilla. It seems pretty obvious that it was just a mistake with the data, not intentional. It is a good warning for things to watch out for, but there wasn't really anything racist about it. Iirc there…

> Iirc there are even physical reasons why it is more difficult to identify black faces than white faces. Is that then racist, if an algorithm struggles more with identifying black faces?

Unless there is some physics based reason it is orders of magnitude more difficult to do feature detection against black skin, then yes something racist is going on. The tools/cameras that we've designed have historically been metered and measured on their ability to detect white features/skin. This was a holdover from film that translated to digital photography. (Some info from an NPR interview https://www.npr.org/sections/codeswitch/2014/04/16/303721251...). The tools that perform this feature detection contain this same biases and reproduce it in the data that they collect. If an algorithm struggles more with identifying black skin, it's because the data that was used to the produce the algorithm contained unexamined racial bias that was never corrected for in a serious way.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#268
post #249

Earlier quoted context omitted.

In order to create a situation where people have equality of opportunity, it's often necessary to ensure that the individual had an equal outcome that creates the necessary starting state.

In theory I agree but in practice that often leads to racism. For example, some people support discrimination for blacks (& against whites) at e.g. college admissions, purportedly to offset their (statistically) worse family background (in terms of education and wealth). Clearly, that's a terrible and racist solution, with the better and obviously correct solution being... to support people from worse family backgrou…

The flaw with this argument is that if you recognize that for example, black people are generally worse off in family background than white people, then you end up back at the point where you on average offer more aid for black families than white ones which by your argument would be racist.

You're not solving the problem at all by attempting to sweep racism under the rug; quite the opposite in fact because it fails to address how race affects family background and discrimination in the first place.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#269
post #246

Earlier quoted context omitted.

Equality of outcome seems like a mechanistic concept of the industrial age of standardized mass production. Equality of opportunity seems much more organic/humanistic because it allows for the natural variation in people's values and personality

The problem is equality of opportunity is it's invariably applied in a way that ignores some very racist and uneven starting conditions and the effects of the past. Consider as a small example how schools are funded in the US, which is largely by local property taxes, so poorer places have poorer schools. These areas are heavily skewed towards minority populations because of some extremely racist issues in our past l…

>our opportunities are directly tied to the outcomes of the generation before us

They are related, but "directly tied to" seems hyperbolic and deterministic.

Frederick Douglass is an obvious exceptional example of a human being transcending the outcomes of previous generations.

Re: Alexandria Ocasio-Cortez Is Absolutely Right About Racist Algorithms

#270

I really wish people would at least skim the wikipedia page to figure out the vocabulary of the field they're about to opine on. The left-progressive use of the word 'bias' is completely different than the way statisticians use the word. If bias increases accuracy/precision, it's not bias. The more interesting question is this - is it permissible for models to consider protected characteristics if those characteristi…

> The left-progressive use of the word 'bias' is completely different than the way statisticians use the word. There's lots of words people use that don't match up with exact scientific definition. Infer from context which version applies, or ask, and you'll be fine. Also applies to: force, resistance, acceleration, etc. We know that startup accelerators help companies grow faster and not actually increase their phys…

> Infer from context which version applies, or ask, and you'll be fine.

Your solution is the correct one, yes. Except the 'progressives' in question are working very hard to selectively remove context (and intention) from language for an ever growing and arbitrary list of words/situations. Where simply speaking about it in a way which a [insert particular special interest group depending on the situation] view as 'incorrect' based on thier ideology/worldview, then you are instantly wrong and acting maliciously regardless of context/intention. You hear this often today. for example: "you can't ever joke about x" or "you can't talk about x historical event without also mentioning y" or having to preface any wide-ranging statement with 100x conditions so as not to offend any group loosely related to the topic.

We should fight to keep language from moving further in this direction because this alternative idealistic world, despite good intentions, is making the world a worse place, not a better one. We can't naively pretend that by creating a huge complicated system of no-go-words, ie not saying certain combinations of words out loud, will automatically makes peoples internal thoughts change for the better and ultimately change outcomes in society. This is merely hypothetical and far from proven method to be effective.

If anything it makes people resentful and creates ridiculous kafkaesque situations where you have to jump through hoops to engage in the most basic innocent dialogue and debate.

Which is ultimately anti-intellectual, inefficient, and irrational compared to how incredibly important context and intention are in a million other examples which they seem to have no problem with.

The worst part is how it incentivizes the worst behavior by giving small people "power" by allowing them to walk around correcting everyone's apparent "misuse" of "problematic" language (which is like crack to the social media outrage culture). Even despite situations where the given audience and in context it was totally harmless and the meaning fully understood by everyone involved.

Post reply on HN