Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

danunparsed.com

Post reply on HN
Print view View original

251–260 of 463 posts

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#251

Post by jarito »

RugnirViking wrote: post #222
LinXitoW wrote: post #127

Earlier quoted context omitted.

What's the alternative? Everyones up in arms, but I see ZERO viable alternatives proposed. If you have 1000 applications for every job, and you know that a bunch of these applications are "a bad fit", to put it mildly, you have to filter. And you cannot realistically give every resume a good, human look. By the time HR would be done, the market has already moved on five times. So, what is the real difference between…

great question. The alternative is not accepting 1000 applicants. Nobody said you have to keep up your job posting for two weeks, or two hours for that matter. stop once you have enough. Enough is defined by whatever number you would have filtered to. In the rare case none of the first ten applicants were appropriate, just open it again until youve got another tranche.

You are assuming quality applicants are evenly distributed in terms of time of application - they aren’t. If you cut off at 100, you will only get a sample of people spewing fully automated application bots which mostly aren’t what you want.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#252

Post by [deleted] »

addandsubtract wrote: post #202
latexr wrote: post #136

Earlier quoted context omitted.

Even assuming that was genuinely how luck works, the conclusion does not follow from the premise because it’s obvious not everyone “starts with” the same amount of luck to spend.

But assuming a random draw, you're more likely to select people with higher luck.

[deleted]

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#253

Post by quectophoton »

luckylion wrote: post #155
cs02rm0 wrote: post #151

I feel like hiring is all a bit broken. Roles get flooded with applications, it's chance whether your CV gets through, then there's hiring rounds that seem designed to make you quit the process before they have to filter you out. Is it working for anyone, on any level?

I'm on the other side, and my main tip (at least if there's people like me!) is: avoid the usual AI signs. For one role we got ~70 applications and all CVs looked obviously AI-written. I don't know whether the people did actually do any of the things mentioned and I don't have the time to find out, so the AI-written CVs are a discard-signal for me. (Either those people delegated a very important task to AI and didn't…

> For one role we got ~70 applications and all CVs looked obviously AI-written.

Were those ~70 applications all of them, or were those ~70 applications the result of an AI filtering from a larger amount?

If the latter, are you sure your AI is not filtering out the hand-written CVs and giving you the ones that have been AI-assisted or AI-written (with or without "the usual AI signs")?

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#254

Post by msdz »

miki123211 wrote: post #64
dvt wrote: post #6

An alarming number of people don't understand that LLMs work via purely stochastic processes, so I'm happy to see in-depth pieces like this. I'm looking for a job and maybe this is why it's so hard to get a callback these days: resumes are just dumped in some LLM black hole and no one really knows how it works. The author says: > temperature 0.1 — low, supposedly nudging the model toward deterministic outputs This is…

In theory, temperature 0 does make the LLM deterministic. Well, in theory theory, temperature 0 doesn't really exist. Mathematically, as lim temperature->0, the distribution gets spikier and spikier, the most likely sample goes to almost-but-not-quite infinity and the rest go to almost-but-not-quite 0. In practice, temperature=0 is literally a separate branch of an if statement that just picks the most common sample…

> However, due to things such as batching and even different kinds of floating point imprecisions for different algorithm implementations, the probability distribution itself often differs run-by-run, so what you sample from it also differs.

Exactly. While I’m assuming this won’t be news for most here, for those that are still new and/or curious about some more explanation on e.g. the floating-point imprecisions, see this nice article: https://thinkingmachines.ai/blog/defeating-nondeterminism-in...

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#255

Post by jackjd »

I've done similar things and used GitHub Copilot to scan a folder of 40 CVs and rate them -> I then review the top 10 CVs and comment on every rating whether I agree or disagree and why -> I then asked AI to re-rate all the CVs according to my comments. -> I then reviewed all the CVs against their ratings; the AI did a much better job for that 2nd round after its learnings.

It took more time than if I just reviewed the 40 CVs myself, but that was an experiment, and I think it shows the AIs can be trained on your comments. And if there is enough training and a good knowledge system that allows AI to apply the learning in those trainings, it can eventually become a lot more accurate at this task?

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#256

Post by chrisjj »

newswasboring wrote: post #192
chrisjj wrote: post #156

Earlier quoted context omitted.

> This despite the fact that we have lots of experience of programs running on computers that produces wildly inconsistent outputs. The average user has very little. A word processor with inconsistent pagination or a spreadsheet with inconsistent totals is rightly seen as faulty.

Yeah but daily tools have lots of complexity which appears as non determinism (if we are thinking only UX, not actual determinism). For example, try moving an image in the word doc. I have been using MS word my entire life it seems, still don't know what the rules are lol.

You're using a mouse? I have no problem getting reliable output from reliable input - through keyboard.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#257

Post by nekusar »

There's a whole lotta analysis and math and bar charts.

But the big question I want to know is "Why did I score that?" And these slop machines absolutely cannot explain anything. That's the root problem with LLMs as a whole. There is no way to describe WHY an llm makes a decision.

Was it because they are a woman? Does the woman's name have more pregnancies than other names? Was it because their job history make the person older (over 40)? Is the person black or black name? Is the name or address attributed to higher criminal tendencies?

But no, you font get to know ANY of that. Slop machine says 66/100 , if you're lucky to even get a number. Usually its a 30 second rejection, or rejection at GMT 0:00 when the batch is processed and you summarily failed.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#258

Post by lewispollard »

jkhdigital wrote: post #249
sp2hari wrote: post #241

HackerRank CTO & author of this repo here There's no better feeling than building something open source and watching it take off. Nine months ago, I built a simple hiring agent to solve one very real problem. Things it is not: It's not an ATS. We don't use it to screen our open roles. Our customers don't use it either. Here's what it is: Every year at HackerRank, we get 50,000 to 60,000 intern applications. No human…

Saw this comment at the top with 0 replies and thought “How is that possible??” and then saw the “0 minutes ago” timestamp. Only on HN can you stumble into the comments section just moments after a CTO, founder, author, etc. left unfiltered remarks about the exact topic of the post. Never change HN.

Depends how "unfiltered" you consider LLM output to be.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#259

Post by wodenokoto »

jerrythegerbil wrote: post #4

> I fail 65% of the time. Same exact resume, different luck. As someone who’s run hiring pipelines for technical roles in the past few years, that’s actually a fantastic number. I objectively hate saying that, but it’s true. 35% chance of elevating a technical individual to the next stage with no effort? I’ve seen as many as 100+ applicants an hour even when including a domain specific screener question. That’s 35 “s…

One of the first things you do when hiring is to set a period and randomize order of resume when reviewing because early application is not a strong signal.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#260

Post by orsorna »

sp2hari wrote: post #241

HackerRank CTO & author of this repo here There's no better feeling than building something open source and watching it take off. Nine months ago, I built a simple hiring agent to solve one very real problem. Things it is not: It's not an ATS. We don't use it to screen our open roles. Our customers don't use it either. Here's what it is: Every year at HackerRank, we get 50,000 to 60,000 intern applications. No human…

You know you're not writing for LinkedIn? So platitudes about drifting away, watching your project "succeed" by being really popular, is not relevant to the main concerns pushed by this piece. Particularly brushing off the non deterministic score calculation.
Post reply on HN