I really dont understand this constant changing of numbers. I have tried a bunch of ATS reviewers and everytime on the same resume i get different numbers. Its weird and unreliable. I understand the need for doing this to filter through thousands of CVs but maybe there is a better way. Like a take home test at the beginning or a test of somekind.
I would say people that hink the LLM is doing a better job than they are in for a treat. I did expect the resulta to be of the same quality as if a human does the job - it averages out and has a big error margin.
HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
231–240 of 463 posts
Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
#232> I fail 65% of the time. Same exact resume, different luck. As someone who’s run hiring pipelines for technical roles in the past few years, that’s actually a fantastic number. I objectively hate saying that, but it’s true. 35% chance of elevating a technical individual to the next stage with no effort? I’ve seen as many as 100+ applicants an hour even when including a domain specific screener question. That’s 35 “s…
I wonder if you could solve this for programming specifically as follows: 1. Give them some easy leetcode questions. Nothing that a competent programmer would have any problem with. 2. If they pass, ask for a deposit of like $20. Shouldn't be an issue for people who are actually serious. 3. Do more simple leetcode questions but this time on zoom so you can tell if they are using AI. If they pass that they get the dep…
Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
#233Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
#234Earlier quoted context omitted.
[flagged]
The same person is not going to give you three different answers within span of minutes. Especially when nothing fundamentally has changed. People might or might not update their views depending on their biases.
Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
#235I think what's more worrying to me (if other systems work like this ATS) is that it seems to judge based on a bunch of factors that will probably disqualify a ton of decent to good participants. For example, 65 points are given for a mix of personal projects and open source contributions. Which is great if your one and only interest is in tech, and you don't have a family, dependents or a second/third job. If you hav…
[flagged]
Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
#236Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
#237Earlier quoted context omitted.
I have been at both side of the market. And it sucks so bad at both ends. Companies which deeply care about next hire are struggling to hire and actual great people looking out are outcompeted by AI slop and AI bulk applying. It is actually a very hard to solve problem.
The mind blower is that this spam and slop is just lowering the job market to the quality of every other capitalist market. Poor hiring manager has to look through 1000 applicants, 950 of which are spam? How many ads are shoved down your throat every day, and how many products are you actually looking for info on? Chickens coming home to roost.
Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
#238Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
#239>If your company’s cutoff sits at 85, I fail 65% of the time. Same exact resume, different luck. Your resume's reception is always affected by random factors, only now you are able to test, debug and technically critique the randomness.
Just roll the dice. I mean, it's not the worse you can do to narrow a subset.
Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
#240An alarming number of people don't understand that LLMs work via purely stochastic processes, so I'm happy to see in-depth pieces like this. I'm looking for a job and maybe this is why it's so hard to get a callback these days: resumes are just dumped in some LLM black hole and no one really knows how it works. The author says: > temperature 0.1 — low, supposedly nudging the model toward deterministic outputs This is…
In theory, temperature 0 does make the LLM deterministic. Well, in theory theory, temperature 0 doesn't really exist. Mathematically, as lim temperature->0, the distribution gets spikier and spikier, the most likely sample goes to almost-but-not-quite infinity and the rest go to almost-but-not-quite 0. In practice, temperature=0 is literally a separate branch of an if statement that just picks the most common sample…
That's not how limits work. As the temperature goes to 0, the rest goes to 0. That's it. The "almost-but-not-quite" is part of the "goes to".
Let's say f(x) = 3x+1. It's a continuous function. If we let x go to 10, f(x) goes to 31. Not "almost-but-not-quite 31". No, to 31. (If you don't have a continuous function then it's the same argument, but less intuitive to illustrate.)