Live data from Hacker News

HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

danunparsed.com

221–230 of 463 posts

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#221

So sending my CV to every company three times should get me pass the ATS?

if i ever go back into the job market, will need three accounts: Peter J Smith, Peter Smith and PJ Smith. they live in #101, #102 and 103# 5607 Jane Street

Why stop there? vary everything that can reasonably be varied slightly across each resume

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#222

Earlier quoted context omitted.

What a inhumane way of looking at this. Hiring is deeply flawed, you know it, and yet you keep job postings open for weeks/months in case "the one" magically appears on your doorstep instead of just interviewing 10-20 people and just pick one... Corpo bullshittery at its finest.

What's the alternative? Everyones up in arms, but I see ZERO viable alternatives proposed. If you have 1000 applications for every job, and you know that a bunch of these applications are "a bad fit", to put it mildly, you have to filter. And you cannot realistically give every resume a good, human look. By the time HR would be done, the market has already moved on five times. So, what is the real difference between…

great question. The alternative is not accepting 1000 applicants. Nobody said you have to keep up your job posting for two weeks, or two hours for that matter. stop once you have enough. Enough is defined by whatever number you would have filtered to. In the rare case none of the first ten applicants were appropriate, just open it again until youve got another tranche.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#224
post #95

A better way to reformulate this problem is for the LLM to be tasked with making a _comparative_ judgement between two CVs. This should prove much more reliable, especially if you give it a third “too close to call” option. You can also ask for clear justifications of preference.

That's a good idea. The only drawback I see is that you should compare every pair of CVs for best results, and that grows quadraticly with number of CVs. Of course you can settle for fewer comparisons and not perfect results. But then I'm not sure if you can hit a good ratio of quality and token spend.

I'd just do a quick filter, probably deterministic, then perform a deeper comparison on the selected few.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#225
post #101

I see. > LLM is called six times to extract structured information Followed by > The default model is gemma3:4b, running at temperature 0.1 — low, supposedly nudging the model toward deterministic outputs. This is exactly why hiring is even more broken: Because the people looking for candidates are also just as unqualified if not, more. Using much weaker LLMs to replace the person in charge of the final judgement cal…

> an experienced person making the final judgement call in case the technology misses a critical detail.

That would fail to meet the objective of reducing the costs of hiring an experienced person - the entire point of outsourcing to a chatbot.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#226

This word (determinism) has a magical effect of warping any online posts it touches. Once you hear it you can almost guarantee it's going to be misguided. At least this time it's actual determinism (same input = same output), not arbitrary unrelated things. Determinism matters for reproducibility, but do you really want these outputs to be reproducible in this particular case? Making LLM outputs deterministic is rela…

This. Human judges and examiners are famously not deterministic even though we would wish it were so - we've probably all heard the thing of harsher sentences being given in the hour before lunch.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#228
post #22
post #16

This reminds me of my former CTO. He would take bunch of CVs and randomly throw some of them in a bin. He didn’t want to work with “unlucky” people.

I thought this was only an old urban legend; some people actually use this technique? Especially in a trade supposed to be led by people trained in sciences?

That'd be pretty gross for a CTO if it were real.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#230
post #130

Earlier quoted context omitted.

Test retest reliability is a thing in psychometrics.

[flagged]

There is evidence that children will oscillate between understanding and not understanding while learning topics. Philip Sadler at Harvard published about this but i can't find the paper im thinking of on his google scholar. too many papers!

but moreover, to verify a test item you need to make sure that peopel will select the same answers under teh same conditions at different times. people generally forget the specific questions they were asked if you ask them the same questions a month later so being able to get them to answer the same way each time is important. it is assumed the people have some static knowledge of a topic in this scenario.

If you want to consider a statistical examination of how people answer tests and how we assess knowledge and other things in people through surveying you can read about item response theory and rasch analysis.

Post reply on HN