Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

danunparsed.com

Post reply on HN
Print view View original

181–190 of 463 posts

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#181

Post by sigmoid10 »

thaumasiotes wrote: post #171
sigmoid10 wrote: post #72

Earlier quoted context omitted.

>in theory theory, temperature 0 doesn't really exist. It does exist very much, even if you go to pure math. Look at the softmax function and take the limit as T->0. It becomes a dirac-delta function. I.e. in a discrete setting (like for LLMs with a finite set of output tokens), probability P becomes one for argmax and 0 for everything else. Only in coding practice it is easer to implement T=0 as a simple if check th…

> It becomes a dirac-delta function. I.e. in a discrete setting (like for LLMs with a finite set of output tokens), probability P becomes one for argmax and 0 for everything else. Only in coding practice it is easer to implement T=0 as a simple if check that directly chooses argmax instead of calculating the limit of some function that includes 1/T quotients. I don't understand the distinction you're drawing. A Dirac…

The point is that the case T=0 doesn't just "exist" as a special code branch - it is still well defined mathematically without any change to the output function. What the above comment refers to with the extra "if" check is just a limitation of computers not liking to divide anything by zero, even if the actual function exists and is well behaved at zero. It is not some weird or special theoretical construction.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#182

Post by cyanydeez »

gregates wrote: post #106
psalaun wrote: post #22

Earlier quoted context omitted.

I thought this was only an old urban legend; some people actually use this technique? Especially in a trade supposed to be led by people trained in sciences?

Given how often it's been mentioned here, it's likely that this is an urban legend that people are pretending to have first-hand knowledge of for karma. In a trade that's supposed to be led by people trained in sciences, no less! (A more charitable interpretation would be that aforementioned CTO was making a joke that didn't land.)

or its so old, people would make the joke and interns would repeat it unwittingly. no one has to consciously be lying for this type of meme to continue spreading.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#184

Post by nullc »

The true test of HackerRank is can you setup a system that combines a document editing / paraphrasing LLM with gradient descent on the HackerRank LLM to turn your arbitrary resume into a reliable 120 out of 100.

One of the weird properties of other people using LLMs is the potential of having oracle access to your opponent. Even if you don't have their exact LLM a good guess at it may be a better model of the opponent than you ever had before.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#186

Post by fluoridation »

make3 wrote: post #51
dvt wrote: post #6

An alarming number of people don't understand that LLMs work via purely stochastic processes, so I'm happy to see in-depth pieces like this. I'm looking for a job and maybe this is why it's so hard to get a callback these days: resumes are just dumped in some LLM black hole and no one really knows how it works. The author says: > temperature 0.1 — low, supposedly nudging the model toward deterministic outputs This is…

A more spikey distribution exactly makes the distribution closer to deterministic. That's not the point though. Even in greedy (deterministic) decoding, it is still a black box though that reacts in ways ways that are unpredictable to the inputs. Switching one word around might lead to different scores for example.

Yeah, this is the forest that the people arguing about math trees are missing. It doesn't matter that the algorithm is deterministic if the algorithm passes the input through a cryptographic hash function to make a yes/no decision. The result may be perfectly reproducible and still non-sensical in its distribution with respect to its input domain.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#187

Post by WhrRTheBaboons »

cyanydeez wrote: post #164
spwa4 wrote: post #58

Earlier quoted context omitted.

[flagged]

a studied example is sampling judicial decisions before lunch and after lunch. judges are more lenient on a full stomach.

how did they account for sampling bias? a judge might leave easier cases for after lunch. people with control over their schedules usually ease themselves back into it after breaks.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#188

Post by robertlagrant »

I tried this with my CV, and it somehow scored me bonus points for GSoC!

   BONUS POINTS: 5.0
  ------------------------------
     Google Summer of Code (GSoC) participation: +5
Even though I've never done this, and don't claim to have done it in my CV.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#189

Post by kasey_junk »

LinXitoW wrote: post #127
sevenzero wrote: post #27

Earlier quoted context omitted.

What a inhumane way of looking at this. Hiring is deeply flawed, you know it, and yet you keep job postings open for weeks/months in case "the one" magically appears on your doorstep instead of just interviewing 10-20 people and just pick one... Corpo bullshittery at its finest.

What's the alternative? Everyones up in arms, but I see ZERO viable alternatives proposed. If you have 1000 applications for every job, and you know that a bunch of these applications are "a bad fit", to put it mildly, you have to filter. And you cannot realistically give every resume a good, human look. By the time HR would be done, the market has already moved on five times. So, what is the real difference between…

If your hiring pipeline is employing a filter that a) is not better than a random chance and b) is expensive to implement get rid of the filter.

Instead of spending all those resources on resume filtering, hire resume blind. Instead of using llms for a thing they are bad at (subjective decision making) use them to build a deterministic process that isn’t.

Use work sample hiring as the filter. Make the work sample automatic to sign up for and judge.

Re: HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88

#190

Post by chrisandchris »

sleepynoodle wrote: post #177

I really dont understand this constant changing of numbers. I have tried a bunch of ATS reviewers and everytime on the same resume i get different numbers. Its weird and unreliable. I understand the need for doing this to filter through thousands of CVs but maybe there is a better way. Like a take home test at the beginning or a test of somekind.

I would say people that hink the LLM is doing a better job than they are in for a treat. I did expect the resulta to be of the same quality as if a human does the job - it averages out and has a big error margin.
Post reply on HN