Live data from Hacker News

Algorithmic Monocultures in Hiring

hai.stanford.edu

1–10 of 177 posts

Re: Algorithmic Monocultures in Hiring

#3

This is something I've been working on exposing to AI labs through my startup LatentEvals[1], and found similar results in other industries from lending to insurance claims. Happy to share some sample reports if anyone is interested! 1. https://www.latentevals.com/

Don't have much to add beyond being grateful for everyone working to call this out, with a hope some lawsuits drop and our SCOTUS doesn't decide racial bias in AI is fine because we can't prove the AI is racist in its heart.

Re: Algorithmic Monocultures in Hiring

#4
The European Union passed The Artificial Intelligence Act, which classifies:

High-risk – AI applications that are expected to pose significant threats to health, safety, or the fundamental rights of persons. Notably, AI systems used in health, education, recruitment, critical infrastructure management, law enforcement or justice. They are subject to quality, transparency, human oversight and safety obligations

That's a pretty common sense legislation to me.

Re: Algorithmic Monocultures in Hiring

#5
Some job application websites I've seen actually have a yes or no option to consent to AI review that they claim is to simply assist HR and not actually screen you. I always select no. There is no way that selecting yes would ever be in my interest. I'm sorry, I'm going to force a real human to look at my stuff if I still can.

Re: Algorithmic Monocultures in Hiring

#6
Its fucking crazy that people are using these systems for important tasks like hiring. They have zero understanding about how these systems work. And LLMs are absolutely not designed to do those sorts of jobs, they're designed to be chatbots and to fool a human conversing them that they are responding intelligently. Of course they're gonna be useless at other tasks.

(I assume they're just using a big LLM for this, it doesnt say, it just says "AI" when they say "AI like that they usually mean LLM".. A custom trained hiring ML system would be better)

Re: Algorithmic Monocultures in Hiring

#8
post #5

Some job application websites I've seen actually have a yes or no option to consent to AI review that they claim is to simply assist HR and not actually screen you. I always select no. There is no way that selecting yes would ever be in my interest. I'm sorry, I'm going to force a real human to look at my stuff if I still can.

My fear is that pressing "no" on stuff like that is going to become an auto-rejection in the vast majority of cases

Re: Algorithmic Monocultures in Hiring

#9
> To put this in perspective: If the AI had recommended Black and Asian candidates at the same rate as it recommended the most-favored group (typically white applicants)

Some people just can't help but put their biases on display at every opportunity, even when it comes to the most minute details.

Re: Algorithmic Monocultures in Hiring

#10

The European Union passed The Artificial Intelligence Act, which classifies: High-risk – AI applications that are expected to pose significant threats to health, safety, or the fundamental rights of persons. Notably, AI systems used in health, education, recruitment, critical infrastructure management, law enforcement or justice. They are subject to quality, transparency, human oversight and safety obligations That's…

The AI “safety” industry is lobbying for federal preemption so that states won’t have the power to enact these types of sensible regulations.
Post reply on HN