Live data from Hacker News

Ask HN: Has there been any academic research into software interviewing?

news.ycombinator.com

1–10 of 129 posts

Ask HN: Has there been any academic research into software interviewing?

#1
Some common interview types are algorithm problems, pair programming exercises, take-home assignments, etc.

Has there been any research into the predictive power of such assessments? Is there any evidence that a particular type of question correlates well with job success?

Re: Ask HN: Has there been any academic research into software interviewing?

#4
I don't know of any academic research, but Triplebyte is trying to understand this better. Their interview process involves a little of algo problems and pairing on hangouts.

Also, there's no one size fits all theory. There are companies where every ms of time you save by writing a better algorithm makes a big difference and most where it doesn't matter. Take home assignments, pair programming have all been tried and is still used by some companies, but majority still rely on white boards and it seems to work fine.

Re: Ask HN: Has there been any academic research into software interviewing?

#6
post #2

To correlate with job success, you need to define and measure job success. A sub-question: How's the academic research into measuring programmer job success?

How about academic research into the value of academic research in programmer job success?

I figure that eventually it'll be similar to the Voight-Kampff test and kept on file forever while being shared with all potential employers.

Re: Ask HN: Has there been any academic research into software interviewing?

#7
post #2

To correlate with job success, you need to define and measure job success. A sub-question: How's the academic research into measuring programmer job success?

Easy: LOC / hour.

I really think this is best we got so far.

Re: Ask HN: Has there been any academic research into software interviewing?

#8
post #2

To correlate with job success, you need to define and measure job success. A sub-question: How's the academic research into measuring programmer job success?

Google publishes a lot of their work at https://rework.withgoogle.com/.

Also, Google's former head of people (Lazlo Block) founded a company that is focusing on that area: https://humu.com/.

While I wasn't always a fan of Google People/HR procedures while I was there, I did always appreciate the data-driven/research approach Lazlo and the People team took.

Re: Ask HN: Has there been any academic research into software interviewing?

#9
When I was self-studying social psychology I came across social facilitation theory and found it applicable to understanding interviewing. People have a hard time performing complex tasks while other people are watching because their working memory is monitoring the social situation. This varies for each individual. For tasks that have been rehearsed, like a musical or dance routine, they perform better. Politeness theory is applicable as well, people want to be liked and at the same time do not want their autonomy challenged. My pet theory is that the whiteboarding epidemic is a status hierarchy game essentially communicating "if you want to work here, you are going to do what I say."

Re: Ask HN: Has there been any academic research into software interviewing?

#10
Not software development, but professional schools (eg medical schools) have published research about which admission selection methods can have predictive value both in-school and as a clinician. Lots of long follow-up.

I’ve seen some programs do away with references, resumes and even interviews.

The programs that I’ve seen remove interviews usually did replace them with standardized stations with different scenarios.

E.g.: “Explain to someone how to wash their hands if they never have before”. If you can do that well, you can probably explain some health procedure you’ll later learn about and have to explain.

Post reply on HN