Live data from Hacker News

Why do big companies ask unrealistic software engineering interview questions?

tomaszs2.medium.com

81–90 of 92 posts

Re: Why do big companies ask unrealistic software engineering interview questions?

#81
post #52

Earlier quoted context omitted.

> Small and startup companies where leadership is still involved in the interview process can gauge candidates based on their own technical intuition. So it's false to say NOBODY has a proxy for good software engineering skills. Is there any proof that this method actually works better though? I've heard plenty of stories of people in smallish (30 FTE or so) startups working alongside some really disastrous hires.

Sure. I built a team of ~35 this way and it worked out pretty well. There were very few dud hires, and of those that happened on investigation it was always because the process I put in place wasn't followed (on one occasion it wasn't followed by me!). It got noticed; we had customers telling us they had to deal with us because they couldn't match the talent we'd been able to attract. We had employees leave and come…

If it was highly standardized, was it really based on intuition as suggested by OP?

Re: Why do big companies ask unrealistic software engineering interview questions?

#82

Earlier quoted context omitted.

> nobody has found a more reliable proxy yet. Companies have not found a process at scale where they can train their employees to systematically gauge candidates. Small and startup companies where leadership is still involved in the interview process can gauge candidates based on their own technical intuition. So it's false to say NOBODY has a proxy for good software engineering skills. The founders can also look at…

> based on their own technical intuition That results in biased hiring based on "I like this person, they think/talk like me". > look at the candidate's public code contributions Also biased hiring on candidates who have the time & inclination to do extra-curricular coding at the required level. > Founders have a financial incentive to not hire bad candidates All companies have financial incentives to not hire bad ca…

All hiring is biased. That's the entire point of behavioral interview questions. To make sure the applicant acts/responds similar to how the company expects/wants. And I've yet to encounter a company which hires without at least one behavioral interview component.

Re: Why do big companies ask unrealistic software engineering interview questions?

#83
post #17

Earlier quoted context omitted.

I have a controversial, philosophical explanation why that is: Leet code is useless in the real world, everybody knows it. But one would find that people that are able to sit down and learn something useless and stupid only because their boss asked it makes for better employees. The modern corporate world does not like free thinkers, if not within easily controllable parameters. The solution for the ones that have be…

I don't think that's controversial at all - maybe only in the sense that people generally don't like hearing it, but I'm sure that anyone who has ever worked in a corporate environment knows this.

Well the vast majority of casual HN readers aren't actual bonafide geniuses nor are they super hard working. So of course they don't want to consider it and so these posts keep getting voted up.

Re: Why do big companies ask unrealistic software engineering interview questions?

#84
post #79

Earlier quoted context omitted.

That still doesn't say anything about the candidate besides the fact that he/she farmed algorithm questions. It's an extremely poor predictor of a candidate's quality. It should only be used in those companies where the number of applicants is way larger than the number of open positions where you can accept the trade off of losing few great applicants if you can also lose the many more bad ones.

It took me a while in life to realise that some people are just made to succeed. These people are typically good to great at anything they put their minds to. Just because you say those questions are an extremely poor predictor of a candidate’s quality doesn’t actually make it so. It might just be one of the best and most cost effective ways of finding good candidates.

You got it the other way around.

It's a way to get rid of many false positives even if you lose some false negative.

Again, companies like Google can afford to lose amazing devs that can't be bothered to farm leetcode if the trade off is getting rid of those that would not be able to farm those effectively.

Re: Why do big companies ask unrealistic software engineering interview questions?

#85

Earlier quoted context omitted.

> based on their own technical intuition That results in biased hiring based on "I like this person, they think/talk like me". > look at the candidate's public code contributions Also biased hiring on candidates who have the time & inclination to do extra-curricular coding at the required level. > Founders have a financial incentive to not hire bad candidates All companies have financial incentives to not hire bad ca…

All hiring is biased. That's the entire point of behavioral interview questions. To make sure the applicant acts/responds similar to how the company expects/wants. And I've yet to encounter a company which hires without at least one behavioral interview component.

> To make sure the applicant acts/responds similar to how the company expects/wants.

That's what "culture fit" is about, not behavioral questions.

Re: Why do big companies ask unrealistic software engineering interview questions?

#87
post #48

If you'd like an article giving an explanation for this that doesn't require upgrading to a paid Medium subscription, try this one I wrote a few years ago: https://blog.plan99.net/in-defence-of-the-technical-intervie... It is, natch, hosted on Medium, so you will see a banner, but unlike this paywalled article it's dismissable. Just click the X to make it go away and then you can read the whole thing for free. The su…

Claims 2 and 4 don't apply to the way these algorithmic questions are usually administered at large companies, which is pure whiteboard coding where you can't run any of the code you're expected to write.

I think whiteboard interviews for coding definitively went away with the COVID pandemic - everyone uses some kind of live editor, usually requiring you to run the code as well.

Re: Why do big companies ask unrealistic software engineering interview questions?

#88

Earlier quoted context omitted.

> based on their own technical intuition That results in biased hiring based on "I like this person, they think/talk like me". > look at the candidate's public code contributions Also biased hiring on candidates who have the time & inclination to do extra-curricular coding at the required level. > Founders have a financial incentive to not hire bad candidates All companies have financial incentives to not hire bad ca…

All hiring is biased. That's the entire point of behavioral interview questions. To make sure the applicant acts/responds similar to how the company expects/wants. And I've yet to encounter a company which hires without at least one behavioral interview component.

There's a difference between "I used my intuition to decide to hire them" (bias-driven) vs "I collected behaviorial examples that I compared to my company's values" (data-driven).

It's OK to say "we didn't hire this person b/c they gave an example of how they reacted to criticism that doesn't reflect our corporate values".

It's not OK to say "we didn't hire this person b/c I had a bad feeling about them".

Re: Why do big companies ask unrealistic software engineering interview questions?

#89
post #4
post #2

For largely the same reasons why graduating from top schools is given more credit than any old college, even if the level of teaching is similar. Getting in takes determination, intelligence, and discipline. Same with getting good at Leetcode.

This feels like a retcon. The real reason is most likely that Google started interviewing people this way and then that's the culture that developed in the industry. Once a culture develops, it's very hard to change.

Might be, although frankly we’ll never know.

Re: Why do big companies ask unrealistic software engineering interview questions?

#90
post #81

Earlier quoted context omitted.

Sure. I built a team of ~35 this way and it worked out pretty well. There were very few dud hires, and of those that happened on investigation it was always because the process I put in place wasn't followed (on one occasion it wasn't followed by me!). It got noticed; we had customers telling us they had to deal with us because they couldn't match the talent we'd been able to attract. We had employees leave and come…

If it was highly standardized, was it really based on intuition as suggested by OP?

Oh, rereading maybe I misunderstood the intent of the OP. What I meant is that small startups can also use highly standardised processes that avoid dud hires, you don't have to be big to do that.
Post reply on HN