Live data from Hacker News

Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

cnbc.com

31–40 of 348 posts

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#32
If you gave someone with no programming experience access to a search engine during the interview, they would likely be able to find the appropriate LC problem to copy/paste the solution.

If the interview were slightly modified so that the problem isnt googleable, a 2nd year CS major could probably map it to a problem that is LC searchable.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#33
post #7

That's odd because when I gave ChatGPT my icebreaker interview question that I used a lot at Google it fell right on its face. And this is a question I expect teenagers to ace in one minute.

Doesn't seem odd to me, in fact this is what I would've predicted in advance.

Intelligence in general, not just of the artificial kind, often comes with blind spots of one kind or another.

ChatGPT isn't even trying to replicate the structure of a human brain, so that it's failure modes are different to ours should not be surprising.

That it can even do this well given it has a network with a similar number of parameters as a (naïve estimate of a) rat's brain, is what's remarkable.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#35
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

> The rest of us aren't going to care that much.

If you don't adapt, you'll be out of a job in ten years. Maybe sooner.

Or maybe your salary will drop to $50k/yr because anyone will be able to glue together engineering modules.

I say this as an engineer that solved "hard problems" like building distributed, high throughput, active/active systems; bespoke consensus protocols; real time optics and photogrammetry; etc.

The economy will learn to leverage cheaper systems to build the business solutions it needs.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#36
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

Don’t understand this take. If it was easy to make an LLM that quickly parsed all of StackOverflow and described new answers that most of the time worked in the timeframe of an interview, it would have been done by now. ChatGPT is clearly disruptive being the first useful chatbot in forever.

While I think the jury is still out on whether ChatGPT is truly useful or not, passing an L3 hiring test is not evidence of that one way or another.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#38
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

Don’t understand this take. If it was easy to make an LLM that quickly parsed all of StackOverflow and described new answers that most of the time worked in the timeframe of an interview, it would have been done by now. ChatGPT is clearly disruptive being the first useful chatbot in forever.

You don't understand the take that just because ChatGPT can pass a coding interview doesn't mean the coding interview is useless or that ChatGPT could actually do the job?

What part of that take do you not understand? It's a really easy concept to grasp, and even if you don't agree with it, I would expect at least that a research scientist (according to your bio) would be able to grok the concepts almost immediately...

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#39
post #35
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

> The rest of us aren't going to care that much. If you don't adapt, you'll be out of a job in ten years. Maybe sooner. Or maybe your salary will drop to $50k/yr because anyone will be able to glue together engineering modules. I say this as an engineer that solved "hard problems" like building distributed, high throughput, active/active systems; bespoke consensus protocols; real time optics and photogrammetry; etc.…

> If you don't adapt, you'll be out of a job in ten years. Maybe sooner. Or maybe your salary will drop to $50k/yr because anyone will be able to glue together engineering modules. [...] The economy will learn to leverage cheaper systems to build the business solutions it needs.

I heard this in ~2005 too, when everyone said that programming was a dead end career path because it'd get outsourced to people in southeast Asia who would work for $1000/month.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#40
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

I think this is a huge demonstration of progress. Shrugging it off as "water is blue" ignores the fact that a year ago this wouldn't have been possible. At one end of the "programmer" scale is hacking basic programs together by copying off of stack overflow and similar - call that 0. At the other end is the senior/principal software architect - designing scalable systems to address business needs, documenting the com…

We don’t get junior engineers for solving problems we tend to get them because they grow into other roles.
Post reply on HN