Live data from Hacker News

Diversity quotas suck. Here’s why

blog.alinelerner.com

81–90 of 102 posts

Re: Diversity quotas suck. Here’s why

#81
post #56
post #4

Earlier quoted context omitted.

> But I can't wrap my head around what "diversity of thought" means, in any meaningful way. For that to be true, you'd have to be unaware of the fact that people can process data and reason through complex problems differently. > I assume 'diversity of thought' refers to expressed thoughts - our mind reading devices aren't that good. That is a poor assumption that requires the redefinition of the word "thought". Our…

> "people can process data and reason through complex problems differently" This was in the context of hiring, and I gave my operational definition - how does one apply 'diversity of thought' to the hiring process? > "Here is a complex problem that can be solved in more than one way - show your work." Presenting a solution, or an attempt at a solution, is an expression of one's thoughts. > "diversity of thought is ve…

> This was in the context of hiring, and I gave my operational definition...

That is actually a helpful reminder - the context of the conversation is a blog entry that struggles over the objectives of quotas and the utility of using race and sex as a proxy for diversity quality beyond... race and sex.

> Presenting a solution, or an attempt at a solution, is an expression of one's thoughts.

Yes... are you trying to defend your prior conflation of behavior and thought?

> Example 1 ... do you hire for more general diversity of thought and expect more overhead to train people in COBOL?

That depends entirely upon your organization's capabilities and priorities. Hypothetically lets say that the bank's long term objectives don't include a migration from COBOL, the IT department doesn't have a long history of successful inhouse training, and being a bank - is generally risk averse. First, filter for candidates that demonstrate an acceptable level of competency in COBOL. Second, filter for candidates that have skills and interests that are not organic to your team - but could feasibly be useful (in your mind, that is all we've got). Third, ask the candidates for examples of times that they've come up with novel solutions to difficult problems. Here is a personal example: I once accidentally landed a contract when I was having lunch with a friend and his boss, I was later told the clincher was my long exposition on fault tree analysis in ballistic missiles. The contract involved the integration of time management and security systems.

You seem to be struggling with the prioritization of diversity of thought over skills that are actually need to perform a job. Here is a hint: the first order of business is getting somebody who you imagine can do the job (skills, job history, etc). If you have more options that positions, of those people, select the one who demonstrates the ability to reason in a way unique to your team.

> Example 2.

You hire the guy who points out that you did a poor job of framing the problem. Not only did you describe it in a way that could be interpreted to demand an implementation that spits in the face of POSIX utility conventions (newlines as argument delimiters), but you also failed to establish a success metric (time, maintainability, performance, etc).

> Surely that's even more diverse thinking - and completely within the test protocol as given.

You described a bunch of potential implementations, not different ways of thinking. The protocol you gave wouldn't be useful to measuring diversity of thought, unless you modified it to include the possibility for interviewer-interviewee interaction, where you might get some clues about their thought process. "What is the success metric?", "Are the sorted values bounded?", "Is the source untrusted?", "How does this fit into the larger process flow?"

> That is, should I do something which I know is less maintainable simply because I know it's more obscure and thus shows my diversity of thought?

No, even in the cartoon funhouse of an example you provided - they might already have a Python weirdo running amuck, you'd add nothing. You don't know that ahead of time.

Re: Diversity quotas suck. Here’s why

#82

Earlier quoted context omitted.

I think what they were trying to also say is "make the process fair" isn't as simple as 4 words. It's a struggle for even the most ardent of believers in giving everyone a fair shot. The problem is defining what is fair.

Of course it's not simple or easy. It's not completely possible either, as life itself isn't fair. That's just the reality we live in. But that's why we should do the best we can, to make it as fair as possible , and while there is much progress to be made around the world, there are also some clearly wrong ways to go about it and diversity quotas are about as worse as it gets.

I guess quotas is such a vague term maybe it’s pointless to argue this. There can me more or less effective/fair implementations of a quota system. I’m not sure what better ideas are out there that don’t involve measuring the result in terms of diversity in a certain field, and optimizing to increase that result... which is in effect a quota.

Re: Diversity quotas suck. Here’s why

#83
post #81
post #56

Earlier quoted context omitted.

> "people can process data and reason through complex problems differently" This was in the context of hiring, and I gave my operational definition - how does one apply 'diversity of thought' to the hiring process? > "Here is a complex problem that can be solved in more than one way - show your work." Presenting a solution, or an attempt at a solution, is an expression of one's thoughts. > "diversity of thought is ve…

> This was in the context of hiring, and I gave my operational definition... That is actually a helpful reminder - the context of the conversation is a blog entry that struggles over the objectives of quotas and the utility of using race and sex as a proxy for diversity quality beyond... race and sex. > Presenting a solution, or an attempt at a solution, is an expression of one's thoughts. Yes... are you trying to de…

You wrote: "are you trying to defend your prior conflation of behavior and thought?"

Where do I do that?

You wrote: "You seem to be struggling with the prioritization of diversity of thought over skills that are actually need to perform a job."

First, I am struggling over how to identify 'diversity of thought' during the interview process. Is it something different than "can come up with innovative solutions" or "out of the box thinking" or "creative problem solver"?

Eg, freedomben writes that 'diversity of thought' can include "different socio-economic status ... different political views, different learning styles"

While your focus is only on "the ability to reason in a way unique to your team".

These seem like two different interpretations of that phrase, and I lean towards ubernostrum's down-voted comment that "diversity of thought" seems often used as a euphemism for "put up with assholes" (my interpretation).

You wrote: "You hire the guy who points out that you did a poor job of framing the problem."

Which means you end up biased towards rules lawyers. Which may be what you want, but bear in mind that you are presenting one performance goal while you have withheld a secret goal that you are actually looking for.

Here's a less secret goal: the test is meant to see if you know what modern C++ is like (and not simply the C-ish subset), and if you have a good idea of what the POSIX mindset is like (so you don't end up asking pointless rules-lawyer questions).

Which of these possible secret goals should the interviewee try to optimize?

You commented "unless you modified it to include the possibility for interviewer-interviewee interaction".

Well, yes. But no matter what scenario you come up with, the essential problem remains - does "diversity of thought" differ from "highly competent and creative problem solver"?

You wrote "newlines as argument delimiters". In my description, the first argument is a filename. The contents of the file are a set of lines, terminated by a \n. The goal is to sort those lines by byte value. Otherwise the desire to sort the contents makes no sense.

Re: Diversity quotas suck. Here’s why

#84

Earlier quoted context omitted.

The problem is that institutional bias and discrimination are unmeasurable. So dropping the quotas never seems like a reality. Quotas are inherently unfair and take opportunity away from others. Isn't it better to treat people as individuals?

We are very far away from the inherent limitations of measurement in this case though. Eventually we will hit those limits and have to throw up our hands and say “we’ve done our best”, but there are lots of big, well-documented effects of individual biases, which end up aggregated into systems and institutions in various ways, the effects of which are readily measurable. > Isn't it better to treat people as individua…

>> Isn't it better to treat people as individuals?

> This is an equally impossible goal.

For being such impossible goal it seem strange then that 21th century society is basically built around that exact concept. Banks lend out money based on it. Courts make judgement based on it. Government gives out social support based on it. Insurance rates and medical care is all about individual assessment. Even education here in Sweden is by law now individualized and each teacher must teach to the ability of each individual student (a new law since a decade ago).

A few hundred years ago that was not the case. If a person were of the lower class then they were treated as such. Government was not expected to operate on anything except category of people, and the idea of treat people as individuals was seen as indeed impossible. Education in particular was extremely bound by this idea, and a person worth was categorized and put in predefined box from a very young age.

However impossible it is to treat people as individuals, it is better to do so and fail rather then to return to the old ways. If you get a wave of low economic immigrants should we throw up our hands and say “we’ve done our best” with individual assessment in the legal system and just prosecute based on class, or should we double up on it and try to do better? The political winds here is swinging, and I honestly hope that treating people as individuals wins over any attempt of short-term gain from treating people based on class. A person born under low economic class should not have their life hindered because others before them of same low economical class had a higher rate of crime that higher economical classes. That would be a failure of society to treat people as individuals. History does not dictate the future and it doesn't create any benefits and drawbacks unless we treat people based on category and class rather then individuals.

Re: Diversity quotas suck. Here’s why

#85

> optics That word meaning "appearances" suddenly appeared and became all the rage a year ago. Writers and commentators think they're hip and cool using it, rather than what it actually is - camp-following and boring. Blech. Just use "appearances".

The word “appearances” has bad optics now. It’s called the euphemism treadmill.

Re: Diversity quotas suck. Here’s why

#86

Earlier quoted context omitted.

You do not have to remove opportunity from one person to grant it to another. They both can have the same opportunity, and then will compete between themselves naturally, which is as it should be.

Sure, I totally agree. In a perfect world, merit is enough and if you're black, gay, female, muslim, transgender, alt-right supporter or flat earther does not matter, as long as that does not pose a problem with what you're supposed to do (a flat-earther could be a great programmer, but I wouldn't hire him/her as an astronomer). Sad truth is, it does not work this way atm, and fixing it is painfully hard for multiple…

> how do you propose we fix prejudice and discrimination in this context

Discussion about equality usually don't get to this point, but in hope that it might someday get started I will try to give an proposed answer.

First we need to expand the context, and I will use Swedish numbers for that. 90% of the employed population work in a gender segregated profession, same for both men and women. It is a known phenomena (sometimes called a paradox) that the more a society works towards equality the more segregated society gets. The best theory I have heard for it is that people will self segregate when given multiple similar valued choices, as going with the group one identify with carries with it a higher self confidence level in that choice on average.

So one obvious fix is to address that very aspect. Understanding that people will have on average a lower self confidence when they decide to go into a group where they are a minority. Make the interview process or trial period better suited for low confidence participants and it will benefit minority groups more, while at the same time not being discriminate to the majority. A mentor program is a prime example which has shown good results in equality programs, and I would bet that is because it addresses this.

Less practical on a company level but possible on a national one would be to address how and when individuals make career choices, and what the influences are. If we expect that a 15 year old to make a critical decision to decide which path to study and later find a job in, it should surprise no one that friends make for a major influence. Look at the school yard and its clear how self segregated kids become based on gender, race, sexual orientation, economic class and so on. The school system could be designed to improve self confidence and self-esteem, and in times where suicide has risen to the most common cause of death for men between the age of 15 to 60 it seems it would also be a major health benefit.

Re: Diversity quotas suck. Here’s why

#87
post #83
post #81

Earlier quoted context omitted.

> This was in the context of hiring, and I gave my operational definition... That is actually a helpful reminder - the context of the conversation is a blog entry that struggles over the objectives of quotas and the utility of using race and sex as a proxy for diversity quality beyond... race and sex. > Presenting a solution, or an attempt at a solution, is an expression of one's thoughts. Yes... are you trying to de…

You wrote: "are you trying to defend your prior conflation of behavior and thought?" Where do I do that? You wrote: "You seem to be struggling with the prioritization of diversity of thought over skills that are actually need to perform a job." First, I am struggling over how to identify 'diversity of thought' during the interview process. Is it something different than "can come up with innovative solutions" or "out…

> Where do I do that?

"I assume 'diversity of thought' refers to expressed thoughts..."

> First, I am struggling over how to identify 'diversity of thought' during the interview process.

I think we've covered this pretty well, so your struggle isn't over the "how" - but the "why".

> Is it something different than "can come up with innovative solutions" or "out of the box thinking" or "creative problem solver"?

It is no different, with one exception: it is measured in relation to your existing organization. If all your programmers are proponents of the functional programming paradigm, hiring another Haskell programmer, while relatively novel to the rest of the industry - likely does little to increase your organizations diversity in thinking (without additional screening parameters).

> These seem like two different interpretations of that phrase...

They are: one is selecting for proxies, presumably as a shortcut. The other is directly addressing what is desired. I'm always amazed at how proponents for such selection mechanisms are totally oblivious to how ridiculously prejudice it is.

> ...I lean towards ubernostrum's down-voted comment that "diversity of thought" seems often used as a euphemism for "put up with assholes" (my interpretation).

Clearly.

> Which means you end up biased towards rules lawyers. Which may be what you want, but bear in mind that you are presenting one performance goal while you have withheld a secret goal that you are actually looking for.

Boom, point proven. You have at that point learned something about that candidate's way of thinking, select on it or don't. If that was a hidden goal then it worked, if it wasn't then disregard.

> Here's a less secret goal: the test is meant to see if you know what modern C++ is like...

Not a diversity of thought test.

> ...and if you have a good idea of what the POSIX mindset is like (so you don't end up asking pointless rules-lawyer questions).

That is a diversity of thought test. Is the candidate willing to, in the face of ambiguity, insert his own opinion instead of speaking up?

> Which of these possible secret goals should the interviewee try to optimize?

As I said earlier: the one that, in your experience, indicates an ability to do the task that the candidate is hired for. Should there be a tie, the one that arrived at a solution that you did not anticipate. And no, that doesn't mean you should hire a guy who insists on sorting files using Node.js, just because he was the only one... you can't determine rationale based only on language selection. If he does it in shell script, ask why. You may learn that binary compatibility concerns are higher on his priority list due to some past experience that you wouldn't have considered.

> ...the essential problem remains - does "diversity of thought" differ from "highly competent and creative problem solver"?

Yes, but first I'll point out that "highly competent" is an unrelated concept. Because effectively nobody has unbounded useful creativity over an entire problem domain, you want to select individuals who's constraints overlap as little as possible - thereby covering more of the problem domain. Personal example: I took over a database from the engineering department because the guy maintaining it retired. I was horrified when I looked inside, the architect was obviously a PLC programmer - using triggers and views to form a hellish logic ladder. I was trying to figure out how I'd be able to untangle everything into a more tradition normalized database when I got a request from one of the engineers to insert a new trigger to account for some upcoming process change, I told him how much I didn't want to do that and asked if I could spend a day with him in order to get a better grasp on their problem domain - he was annoyed, but agreed. Well it turns out the old engineer wasn't totally insane, the problem domain was pretty much unbounded and constantly changing: new metrics, new datatypes, new requirements - totally normal for their department. Whereas I would have used a Domain-key normal form in that situation, he just created a new table and added a trigger. Both styles work, each has different weaknesses and strengths. Neither of us would have arrived at the other's solution. Diversity of thought.

> In my description, the first argument is a filename. The contents of the file are a set of lines, terminated by a \n.

Lol, even your attempt at clarification adds confusion. The ambiguity this time: is the set of lines terminated by \n, or is each line in the set terminated by \n, or is the file terminated by \n? Yes, I'm pretty confident that I know what you mean - but I have seen 0x1f used for stuff like this in production, bad things would have happened had I just made an assumption.

> Otherwise the desire to sort the contents makes no sense.

Sure it does: if instead of interpreting the explicit mention of '\n' to mean line termination within the file, one interpreted it as the termination of the first parameter. Again, one can guess the intent due to convention - but it is ambiguously phrased and immediately led to two competing possibilities of intent in my mind. Maybe that is because I think differently from you...

Re: Diversity quotas suck. Here’s why

#88

Earlier quoted context omitted.

The rule of thumb is not disclosing any identifiable info on the internet. :P The company is a big one, a named one, but with some age on it. As absurd as it sounds, the candidate is hired for a hotly sought after position, that supposedly requires production ready coding skills AND battle tested machine learning skills. Yet the candidate comes with no knowledge of Python or Linux.

Occam's razor. You're leaving some critical information out. No one gets hired for a competitive ML role without basic backend knowledge, let alone "python or linux".

That might be the point. After all the GP post is about how standards are lowered for diversity candidates, then they go on about how they're hired without necessary knowledge. How is this not lowering the bar ?

And, if your claim is that this doesn't happen: I have to say, I've seen people hired for many reasons. Because they're related to X (perhaps including that they can't find a job otherwise). Because they or someone in their immediate environment is disabled (which gets your boss a tax advantage). Because ...

So I would argue in Europe, it's almost the opposite. People are really treated as interchangeable, and hiring for ability is really more the exception in many companies. Hiring to make the boss look good, hiring fox tax reasons, ...

And before you say "that doesn't happen at fancy FANG company", I would like to remind you that all of Google, Microsoft, Amazon, Apple and Facebook have LARGE Irish offices, and I've visited the Facebook one: not many Irish (like 30% of the office at most, and they apologize during the interview for trying to get you to Ireland, so it's not like they like it. I'd bet good money the other companies are similar).

How much do you want to bet that the "dutch Irish sandwich" tax avoidance scheme requires a minimum headcount in Ireland ?

So let's just state this as a fact: ALL the FANG companies hire less competent people because of location (this must be the tradeoff) in trade for tax advantages in Europe.

Every last one of them.

Every last one.

And if they do it, which are these mythical companies that hire because of the bar, wherever ? We complain a lot, but when it comes to employees, nobody really doubts that FB, GOOG, MSFT, AMZN are the top, la creme de la creme. Who is this mythical company that does not lower the bar ? And if they do lower the bar, why would they not lower it below whatever you consider a reasonable level, especially for positions where they can't really hire well anyway ?

Re: Diversity quotas suck. Here’s why

#89
post #84

Earlier quoted context omitted.

We are very far away from the inherent limitations of measurement in this case though. Eventually we will hit those limits and have to throw up our hands and say “we’ve done our best”, but there are lots of big, well-documented effects of individual biases, which end up aggregated into systems and institutions in various ways, the effects of which are readily measurable. > Isn't it better to treat people as individua…

>> Isn't it better to treat people as individuals? > This is an equally impossible goal. For being such impossible goal it seem strange then that 21th century society is basically built around that exact concept. Banks lend out money based on it. Courts make judgement based on it. Government gives out social support based on it. Insurance rates and medical care is all about individual assessment. Even education here…

> Banks lend out money based on it. Courts make judgement based on it. Government gives out social support based on it. Insurance rates and medical care is all about individual assessment.

... these are all examples of places where bias is rampant. Banks, courts, government assistance, insurance premiums, and even medical care are not delivered to all individuals equally. Not at all. Not remotely.

Through activism and lawsuits that these areas have made strides towards fairness... but you seem to be holding them up as an example of treating people as individuals “done right” or “done successfully”.

To briefly take these one by one:

> Banks lend out money based on it.

- banks had to be forced to do this.

> Courts make judgement based on it.

- this is laughable. The legal system in the US punishes African Americans more strongly that Caucasians for the same crimes.

> Government gives out social support based on it.

- maybe?

> Insurance rates and medical care is all about individual assesment

- doctors provide more medication for pain at the same level to white patients vs black patients. Proxies for race are all over insurance. Women had to pay more for healthcare until very recent.

Without active efforts that were made over many years to tip the scales and correct these bad outcomes, all of this would be much much worse.

> History does not dictate the future and it doesn't create any benefits and drawbacks unless we treat people based on category and class rather then individuals.

I respectfully suggest that the above statement is completely incoherent with reality, and represents weird wishful thinking.

Re: Diversity quotas suck. Here’s why

#90

Earlier quoted context omitted.

Mathematically its hard to select a higher percentage of anything than the population of applicants without picking inferior players. I know its challenging to rank people in real world jobs compared to say scores on a test but humor me here. Say you score people on an objective metric from 100 to 0 and you have 5 times more applicants than jobs. One logical way to hire than is to hire the top 20% of the population.…

Companies don't pluck candidates out from an unbiased set at random. Companies that are attractive to women get top tier women to apply which means they're able to select their 50% from the top 5% of women. And guess what, a major factor in a company being attractive to women is a culture where women have a voice roughly equal to men. Increasing your percentage of women increases your candidate quality, not decreases…

Seems like this does not scale in any meaningful way. Got any companies with 50% women in jobs where the applicant pool is 20% with a large population of employees?

Hint hiring women in marketing to balance the male software developers wouldn't prove much.

Post reply on HN