Live data from Hacker News

AI killed the tech interview. Now what?

kanenarraway.com

11–20 of 651 posts

Re: AI killed the tech interview. Now what?

#11
post #6

Earlier quoted context omitted.

the idea is sound. create a basic standardized test targeted at tech/engineering jobs. not actually SAT -- operated by a vendor like The College Board. There are plenty of standardized test operators

That’s what Triplebyte planned on. The truth is I don’t trust anyone else to run evals.

you're right there are quality issues, some probably deliberate.

but the screening cost for companies is eye watering so something should be done.

Re: AI killed the tech interview. Now what?

#12
post #2

I never understood why Big Tech never setup contracts with all the SAT and ACT test centers across the country. Even before Zoom with Codepads it would have made sense for the recruiters to send potential candidates to a test center to do a pre assessment rather than waste time with engineers sitting on prescreen calls all day.

I have done interviews with Karat which just outsources technical interviews to engineers elsewhere.

All of these technical interviews still suck though! I basically never code with someone watching me and find it very difficult to do in interviews. I also find it hard to find the time to actually practice this skill

Re: AI killed the tech interview. Now what?

#13
post #6

Earlier quoted context omitted.

the idea is sound. create a basic standardized test targeted at tech/engineering jobs. not actually SAT -- operated by a vendor like The College Board. There are plenty of standardized test operators

When I'm interviewing, I'm putting about 30% of the weight towards "would I enjoy working with this person on a daily basis?", but in the context of technical discussions. Standardized testing won't be able to replicate it.

you're not allowed to discriminate

Re: AI killed the tech interview. Now what?

#14
post #10

So there’s AI that’s really good at doing the skills we’re hiring for. We want you to not use AI so we can hire you for a job that we’re saying we’re going to replace with AI. Sounds like a great plan.

The article actually takes a stance that if you incorporate AI you can learn how the person is at doing things the AI cannot.

Re: AI killed the tech interview. Now what?

#15
post #6

Earlier quoted context omitted.

What exactly are you suggesting here? A standardized test that applies to all your job applications? Or, a candidate having to drive to a test center for every company they apply to? Or something else?

the idea is sound. create a basic standardized test targeted at tech/engineering jobs. not actually SAT -- operated by a vendor like The College Board. There are plenty of standardized test operators

Would certainly make it easy for employers to differentiate themselves by saying “well, at least we don’t do THAT”.

Re: AI killed the tech interview. Now what?

#16
post #9
post #6

Earlier quoted context omitted.

the idea is sound. create a basic standardized test targeted at tech/engineering jobs. not actually SAT -- operated by a vendor like The College Board. There are plenty of standardized test operators

This largely misses what an interview is all about, save for entry level positions.

given the in-person interview is at the end of the funnel by a factor of 500-1000, standardized testing might even open up opportunity for under represented candidates.

Think of how poor the screening process is at the recruiter & CTS (left side) of the funnel, and how many false negatives there are .

If you could offer standardized test at that level, you may be able to keep viable candidates in the funnel longer.

Re: AI killed the tech interview. Now what?

#17
post #4

Earlier quoted context omitted.

Standardized plus the ability for companies to do their own test after they pass the standard one. So go get prescreened at test center then use that test to apply for jobs. Company either flys you in for in-person or sends you back to test center to do live remote interview in controlled environment.

That was essentially triplebyte.

No, that was Triplebyte's marketing. Their actual product was completely different.

Re: AI killed the tech interview. Now what?

#18
Interestingly I find AI is actually better at that kind of CS whiteboard question (implementing a binary search tree) than that "connecting middlewares to API" type task. Or at least, it's more straightforward to apply the AI, when you want a set of functions with clearly defined interfaces written - rather than making a bunch of changes across existing files.

Re: AI killed the tech interview. Now what?

#20
post #6

Earlier quoted context omitted.

the idea is sound. create a basic standardized test targeted at tech/engineering jobs. not actually SAT -- operated by a vendor like The College Board. There are plenty of standardized test operators

That’s what Triplebyte planned on. The truth is I don’t trust anyone else to run evals.

> The truth is I don’t trust anyone else to run evals.

It's a common sentiment.

But compare https://www.cambridge.org/core/journals/judgment-and-decisio... . ("People predicting the future performance of college students state that interviewing the students aids prediction, although in fact the interviews make predictions less accurate.")

Post reply on HN