Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Don't ask if devs cheat with AI, test if they're good with it

tryevaluator.com

Post reply on HN
Print view View original

1–8 of 8 posts

Re: Show HN: Don't ask if devs cheat with AI, test if they're good with it

#4

Post by brookst »

Karthick81 wrote: post #3

Can this be used for non coding jobs too?

Yes for sure. I like asking candidates to pull up their favorite LLM and show me how they’d use it to do market research, using a real but irrelevant example like “suppose we’re looking at opening a design office in Belgrade, to get 24 hour coverage. How would you use an LLM to research this? Pull up your favorite and show me.”

I honestly think “oh I don’t use LLMs for anything” is disqualifying. I’ve had a couple of people say that. I would be open to “you know I’ve tried it and it never produced good results, let me show you how I’d use Google and …” but have never heard that.

And of the people who are game, I’ve seen a wide variety, including screen shares that include the STT of our conversation to date and suggested replies. And some genuinely smart, high-leverage AI use that’s impressed me.

Re: Show HN: Don't ask if devs cheat with AI, test if they're good with it

#6

Post by Karthick81 »

brookst wrote: post #4
Karthick81 wrote: post #3

Can this be used for non coding jobs too?

Yes for sure. I like asking candidates to pull up their favorite LLM and show me how they’d use it to do market research, using a real but irrelevant example like “suppose we’re looking at opening a design office in Belgrade, to get 24 hour coverage. How would you use an LLM to research this? Pull up your favorite and show me.” I honestly think “oh I don’t use LLMs for anything” is disqualifying. I’ve had a couple of…

I believe the statement "I don't use LLM for anything" should not be disqualifying. Many companies frown upon use of AI because of fear of hallucination, so not everyone is open about it in all settings.
Post reply on HN