Live data from Hacker News

U.S. regulators accuse Palantir of bias against Asians

reuters.com

371–380 of 415 posts

Re: U.S. regulators accuse Palantir of bias against Asians

#371

Earlier quoted context omitted.

Good point, that's always an important thing to remember. The average job applicant is much lower quality than the average developer.

Maybe. With a large enough population for either the job-hunters or the employed, you should regress to the mean for the total population and the deviation should also be similar. This assumes a normal distribution for the metrics that you are hired for, something that may not be in fact true, ie. Poisson or exponential distributions are reasonable. What you can take away from this: Your own developers may not be as…

IIRC Google said that their interview scores didn't correlate with how successful people were in the company. But you have to remember that obviously they're only talking about people who made the cut, so people who had at least moderately high scores to begin with.

Re: U.S. regulators accuse Palantir of bias against Asians

#372

I'm extremely disappointed by the vitriol and generalisations against Asians in this thread. Marginalising individual candidates because there are trends in the community is the textbook definition of racial profiling. I'm a dev from India. I work hard and always try my best to stay as honest as I possibly can, and I think I'm fairly competent. For the last job offer I received, I had to take around 7 interviews (pho…

I too expected more from HN and I think it's because HN is generally more civil than other webs forums. I think the credit of this civility goes to the HN moderators and the enforcement of the policies, not because HN types are special. I used to think technical minded folks are more analytical and thus have less tendency for bias and generalizations but I've concluded that ultimately tech people are still people and subject to the same filters as "normals".

I hope you not discouraged from pursuing your specialization in the US.

Re: U.S. regulators accuse Palantir of bias against Asians

#373
post #12

Here's the actual government complaint, the allegations are listed in sections 10 and 11, https://www.dol.gov/sites/default/files/newsroom/newsrelease... My concerns, 1) why is the qualified candidate pool, whatever that is, so overwhelmingly Asian, 73-85%? Isn't the candidate selection process biased towards Asians? 2) The complaint is concerned about the use of employee referrals. Studies have shown that building t…

Yes. This has all kinds of alarm bells going off. I don't care who you are or what you look like. I don't care how old you are, your gender, sexual preferences, citizenship status, and so forth. I'm certain that having a large mix of these will make my work environment more productive and interesting, but for each candidate I have much more important things to think about. The job is to make technology do stuff for p…

Everybody shows up for a sprint or two and the rest of the team sees how it works out.

How do you hire people without 2 weeks vacay to burn on this process?

Re: U.S. regulators accuse Palantir of bias against Asians

#374

Earlier quoted context omitted.

Good point, that's always an important thing to remember. The average job applicant is much lower quality than the average developer.

Maybe. With a large enough population for either the job-hunters or the employed, you should regress to the mean for the total population and the deviation should also be similar. This assumes a normal distribution for the metrics that you are hired for, something that may not be in fact true, ie. Poisson or exponential distributions are reasonable. What you can take away from this: Your own developers may not be as…

> With a large enough population for either the job-hunters or the employed, you should regress to the mean for the total population and the deviation should also be similar.

You're right that the actual population of all job applicants over time is equally qualified to the employed developers.

However, the data that I have available to me as a hiring manager is the sample of developers who actually applied to my job. In that sample, incompetent developers are much more likely to be present because a competent developer only sends out At any given moment, a competent developer is more likely to be employed than an incompetent one. Hence the incompetent ones are constantly generating job applications at a much higher rate than their actual presence in the population would suggest.

For the record, this isn't merely theoretical. The last time I was looking for a job, I was able to get an offer from the second company I applied to. Meanwhile a friend of mine with barely any experience had to apply to about 50 places before getting a single offer. If you were to pull a random sample of our applications, his would be way over-represented.

> think Google came out a while ago and said that their initial hires had no correlation to the really successful people in the company after...5(?)... years.

Sure, but Google still spends a lot of time and money on interviewing because anyone they hire has to be better than the average applicant. They get huge numbers of job applicants, the majority of whom are grossly unqualified.

> The interviewing process is known to be broken, so trying to extrapolate to say that the job-seekers are less good at these metrics than the employed is erroneous.

There are lots of problems with the interview process, but I'm really including anyone who managed to get to an interview (past the phone screen) in the "competent" category. There are seriously huge number of job applicants who can't program a basic loop without extensive help.

Re: U.S. regulators accuse Palantir of bias against Asians

#375

Earlier quoted context omitted.

some have a similar hiring experience to what Palantir did ... which is completely irrelevant to whether Palantir is on the right side of this issue. If a police department was reported as displaying bias against blacks or muslims, would it be reasonable to respond with "I've had issues with blacks and muslims in law enforcement too"? Now consider the fact that Palantir does a lot of work for intelligence agencies...

> If a police department was reported as displaying bias against blacks or muslims, would it be reasonable to respond with "I've had issues with blacks and muslims in law enforcement too"? But this has no context. What kind of bias, what kind of issues. The example wrt asians has this context.

[deleted]

Re: U.S. regulators accuse Palantir of bias against Asians

#376

Earlier quoted context omitted.

It's common practice, but that doesn't make it ok. In fact, afaik, those network-based hiring practices are a major obstacle to social mobility and to ending racial and gender inequality. Think of it this way: In the U.S. in 1950, white men[0] controlled access to resources like education and jobs, and shared them only with other white men, intentionally discriminating against non-white and non-male applicants. In th…

> Really it was Protestant, heterosexual white men, and maybe some other parameters applied too, but let's keep this simple. Really? You don't think Jews had good jobs in 1950?

Do you know otherwise?

If we are talking about the U.S.: Jews were widely excluded from society. I know an American man who is Jewish and went to college in the 1950s. His whole family changed their last name so he could get in; many colleges barred or put quotas on Jewish applicants. Jewish lawyers couldn't work in many leading 'white shoe' firms. Jewish people couldn't join the country clubs and other social organizations where serious networking and business took place. Remember also that the KKK and similar groups preached hate against Jewish people as much as against black-skinned people.

I don't know the answer in greater detail than that, and my impression is that a person had much more opportunity believing in Judaism than being black-skinned, but clearly there was plenty of discrimination and much more, I expect, in some areas of the U.S.

Even to this day, has any leader of a major country been Jewish? Any country besides Israel? (A quick search found a couple French Prime Ministers.)

Re: U.S. regulators accuse Palantir of bias against Asians

#377

Earlier quoted context omitted.

That seems like a lousy excuse to me. As a web developer, my entire job revolves around computing trees; and that is (as of now) the most common development environment in the world. My side projects (graphics demos/toys, a multiprocess text editor, various twilio SMS utilities, a high-performance pastebin server) end up using stacks, trees, hashmaps, and bloom hashes as logical responses to the problem descriptions.…

Not sure what do you mean by computing trees in this context, but I personally as a web dev for 15+ years have never-ever had to e.g balance a binary tree or do any other low level operation of that kind. It's important to learn it at some point to be able to understand how it all works, but afterwords you just don't write the low level stuff yourself, ever. If given enough time I'm pretty sure I could come up with s…

The solution to reversing a linked list should be self-evident to anyone who makes an attempt.

    #include 
    
    typedef struct Node Node;
    struct Node {
      int data;
      Node * next;
    };
        
    Node * reverse_linked_list (Node * node) {
      Node * prev = NULL;
      Node * next;
      do {
        next = node->next;  
        node->next = prev;   
        prev = node;
      } while ((node = next));
      return prev;
    }
    
    int main () {
      Node * node;
      Node nodes[3];
      nodes[0].data = 0;
      nodes[0].next = &nodes[1];
      nodes[1].data = 1;
      nodes[1].next = &nodes[2];
      nodes[2].data = 2;
      nodes[2].next = NULL;
    
      node = nodes;
      do {
        printf("%d", node->data);
      } while ((node = node->next));
    
      node = reverse_linked_list(nodes);
      do {
        printf("%d", node->data);
      } while ((node = node->next));
    
      return 0;
    }
Or something thereabouts.

Re: U.S. regulators accuse Palantir of bias against Asians

#378
post #345

Earlier quoted context omitted.

Surely college admissions procedures have changed significantly in the intervening 17 years, right? We're talking about the advent and removal of the 2400 point SAT, the rise of digital applications, and the rise of SAT subject tests, among other changes. Furthermore, this specific point system in question was ruled unconstitutional and is no longer in use. https://en.wikipedia.org/wiki/Gratz_v._Bollinger

It's possible that the same organizations which were found directly discriminating on race, and desperately resist any transparency (both before and after), have secretly reformed. It's also possible that admissions numbers didn't change a lot because "holistic" admissions discovered previously unmeasurable mitigating factors for blacks having low SAT/grades/etc. And in yet another major coincidence, these systems al…

I don't think it's really a secret, the "unmeasurable mitigating factors" are society-wide discrimination issues that make life in general harder for black people. You don't have to pretend there's a secret conspiracy, affirmative action colleges are openly trying to correct for the effects of structural racism that they have no control over. This is certainly a debatable idea, but you don't need to act like it's something colleges are trying to cover up.

Re: U.S. regulators accuse Palantir of bias against Asians

#379

Earlier quoted context omitted.

The same complaint is the basis of sexism in the tech industry. I haven't seen many resumes from women cross my desk. So it's not that I'M being sexist, but clearly there's a problem somewhere. And it could be the way I'm soliciting those resumes in the first place.

The same complaint is the basis of sexism in the tech industry No it's not. It's in fact the opposite. Sexism is systemic to the point where you're lucky to have 5% of your applicants be female.

You can't point to the "industry" when the industry is composed of individuals with distinct roles. The scope of influence of the average employer, for example, begins with the receiving of applications - they have less control of who chooses to study the subject.

Re: U.S. regulators accuse Palantir of bias against Asians

#380

Earlier quoted context omitted.

> If you ignore the terminology, DFS is basically just recursively walking a graph, something which actually happens all the time in most dev jobs. In ten years of full-time professional development I have never needed to recursively walk a graph. Hell, the only data structures in the software I worked on for the first six (real-time signal processing code) didn't use any data structures other than lists, arrays, and…

Do you think you've ever had to do something as algorithmically complex as recursively walk a graph? Sometimes these questions are used to probe the meta understanding of a candidate and using Graphs/Trees/DFS are universally understood concepts that make doing that easy.

Define "algorithm". In the broader definition, yes. Kalman filtering, motion compensation, track association, XY-mapping, and similar signal processing algorithms. For NLP it has been various forms of statistical modeling and general multithreaded architecture and coordination.

As for the algorithms typical of computer science, not really. Searching and sorting has not been much a part of what I have done. My experience is mainly in translating math into code, often into code with real-time deadlines.

Post reply on HN