Well yeah, LLMs generate resumes (and other text) that they judge as superior to alternative plausible texts. Why would that judgement change just because a different instance hasn't seen it before? To anthropomorphize it, it's like having a hiring manager write a resume, get amnesia, and then have to judge it among other resumes.
AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
21–30 of 190 posts
Re: AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
#22Another way to phrase this might be that LLMs make better resumes no?
By one metric, yes!
If you are a candidate who wants to be hired, and your target employers use LLMs to filter resumes, then an LLM-generated resume that the employer LLM-powered resume filters favor is "better" — as in "more likely to get you the job".
Re: AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
#23I'll copy what I wrote on LinkedIn (note: I read roughly 25 pages, which is half the paper, and read it quickly)[0]:
"If I read the paper correctly, they don’t actually show that LLMs prefer resumes they generate.
Their actual method seems to be taking a human written resume, deleting the executive summary, having an LLM rewrite the executive summary based on the rest of the resume and then having another LLM rate the executive summary without the rest of the resume.
That’s likely to massively overstate any real impact, if you can even rely on it capturing a real effect.
I really wonder if I read that correctly, because I can’t come up with a justification for that study design."
[0] I couldn't help but mildly copy-edit before pasting here.
Edit: yes, the authors present a reason for their design, and an ideal version of my comment would've said that. I do not consider it much of a justification. See below: https://news.ycombinator.com/item?id=47987256#47987727.
Re: AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
#24This may lead to some interesting gamesmanship. For instance, if I am applying to a company, and I know they use a certain applicant tracking system, and I know that ATS uses a certain model provider for its filter, I should then use that model to write the version of my resume I send to the company.
Re: AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
#25Another way to phrase this might be that LLMs make better resumes no?
*for getting past ATS reviews.
Re: AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
#26Easy then. Apply N times, each time with a resume generated by a different LLM. No human is going to notice anyway. Or add a N+1 resume written by yourself in which you describe your strategy, just in case.
You don’t understand the problem. Companies are using AI / LLMs to pre-filter resumes. These AIs prefer their own slop resumes. Not just human vs LLMs, but Claude prefers Claude resumes over ChatGPT. Nothing good can come out of that, when resumes are pre-filtered like that. Unless, of course, you’re not being serious and just trying to be edgy on HN.
Why would I want to work for a company where all the employees made slop to get hired by slop to do slop? It’s slop all the way down!
Re: AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
#27> As artificial intelligence (AI) tools become widely adopted, large language models (LLMs) are increasingly involved ... [in] ... decision-making processes
That's the problem right there.
Re: AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
#28At this point, all these are becoming almost like comedy.
Re: AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
#29Earlier quoted context omitted.
You don’t understand the problem. Companies are using AI / LLMs to pre-filter resumes. These AIs prefer their own slop resumes. Not just human vs LLMs, but Claude prefers Claude resumes over ChatGPT. Nothing good can come out of that, when resumes are pre-filtered like that. Unless, of course, you’re not being serious and just trying to be edgy on HN.
Why would I want to work for a company where all the employees made slop to get hired by slop to do slop? It’s slop all the way down!
Because this is where the industry as a whole is moving towards, and you don’t want to be out of a job I presume.
Re: AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
#30We are without our consent introducing a party in between people. The models become the arbiters of who does and does not get a job. It feels problematic.