Live data from Hacker News

Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

cnbc.com

281–290 of 348 posts

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#281
post #234
post #124

Earlier quoted context omitted.

Most candidates can, it's just a matter of how much free time they have to spend memorising.

Challenge. I can barely remember what I had for breakfast yesterday much less.. the entire knowledge base of chatgpt

I could bulshit well enough on the facts that I don't know same as chatgpt. Say it with confidence and you'll be fine

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#282
post #185

I think this says more about the Google interview process than about ChatGPT. That a machine learning model can "bullshit" its way through an interview that is heavily leaning on recall of memorized techniques, algorithms and "stock" problems that have solutions (of various quality) all over Internet is not exactly surprising. Machines will always be able to "cram" better than humans. In practice these questions are…

I see a lot of criticism towards modern software engineer interviewing techniques, but never a solution offered that would catch and reject BS. Your comment comes off as "hire a person because you get along with them, don't worry if they can't write a function that accomplishes a simple task".

You're literally a subject matter expert on whatever you work on. It's extremely troubling if you can't catch BS'ers with a deep technical conversation.

If you feel the need to separately establish that they can actually code, take your pick of GitHub, fizzbuzz, etc. You're probably doing one of these before the LC round anyway.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#283

Earlier quoted context omitted.

Don’t understand this take. If it was easy to make an LLM that quickly parsed all of StackOverflow and described new answers that most of the time worked in the timeframe of an interview, it would have been done by now. ChatGPT is clearly disruptive being the first useful chatbot in forever.

While I think the jury is still out on whether ChatGPT is truly useful or not, passing an L3 hiring test is not evidence of that one way or another.

> the jury is still out on whether ChatGPT is truly useful or not

I'd pay $100 a month for ChatGPT. It allows me to ask free-form questions about some open-source packages with truly appalling docs and usually gets them right, and saves me a bunch of time. It helps me understand technical language in papers I'm reading at the moment regarding stats. It's been useful to find good Google search terms for various bits of history I wanted to find out more about.

I don't think the jury is out at all on whether it's useful. The jury is out on the degree to which it can replace humans for tasks, and I'd suggest the answer is "no" for most tasks.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#284

Will humanity finally be liberated from memorization? Forcing school children to memorize and then regurgitate facts is barbaric, and so is using it as a measure in hiring.

Basically everything is some form of memorization.

The real question I think is how much entropy each memorized fact should contain.

Memorizing what the letter f does is much more valuable than memorizing the word floor. I don't need to know floor, the ai can know it for me

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#285
post #263

Earlier quoted context omitted.

Reading that I can only assume you’ve made really poor use of Jr developers. Which ok I get why you think ChatGPT is more useful.

You really think that Jr devs could crank out the same code faster than ChatGPT? I couldn’t crank out the same code and you couldn’t either. The most you can hope from JR devs (even the ones I have met at BigTech) is that they don’t eat the chalk during the first 3-6 months.

As for now, issue with ChatGPT is that it doesn't really crank anything. It instantly produces answer for given input. While programmer can crank things. For example I asked ChatGPT to write a function which returns UUID generated with some rules. It spewed the solution. It looked like a correct one but when I run it, it returned wrong answer. I worked with ChatGPT for some time and it corrected its code. But I would expect from junior developer to actually run his code and check output.

Now if ChatGPT would be able to actually work on the problem rather than returning generated text, that would be a completely different beast. And I think that this workflow will come in the near future because it's pretty obvious idea. Get task specification, generate tests, generate code, fix code until tests work, refactor code until it meets some standards, etc.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#286
post #272
post #260

We changed the URL from https://www.pcmag.com/news/chatgpt-passes-google-coding-inte... to the article it points to Submitters: " Please submit the original source. If a post reports on something found on another site, submit the latter. " https://news.ycombinator.com/newsguidelines.html

The new article doesn't match at all the topic of the previous article.

It partly does: the last section of the CNBC article is "ChatGPT would be hired as a level 3 engineer". Most of the CNBC article, and the title, are about other things though.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#287

Earlier quoted context omitted.

Ah, the good ol "A(G)I will arrive in 10 years!" --For the past 50+ years, basically. It's a cautionary tale to people who are working in ML to be not too optimistic on "the future", but in my opinion being cautiously optimistic(not on AGI though) isn't harmful by itself, and I stand by that. Well at least until we hit the next wall and plunge everyone into another AI winter(fourth? fifth?) again. As a plus, we do ac…

Kurzweil gets a lot of flack for this sort of thing, he's generally presented as the ridiculous hype man for AI. And yet, he bet in 2002 that an AI would pass the Turing test by 2029. (And this is actually a more conservative prediction than "we will have AGI by 2029.") And looking at GPT3 it seems like he is probably going to win that bet.

I think the big revolution of the last few years has been to recognize that we'll likely get robots that can pass the turing test well before we get full self driving vehicles that can run anywhere there are basically ordinary paved roads.

I think even three years ago, most people would have thought the reverse.

So Kurzweil was imagining the turing test as the capstone to a decade of more and more capable ai products, not as "kind of early interesting success that may (or may not) presage really useful AI."

("The Turing test" is a pretty hazy target. I have no doubt that a chatgpt that was not trained to loudly announce that it was an AI could convince lots of people that it's a real human, right now. I think it's also the case that people with some experience with it could pretty quickly find ways to tell what it is.)

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#288
post #16
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

If it helps, this likely is coming. I think we have a tendency to mentally move the goalposts when it comes to this kind of thing as a self-defense mechanism. Years ago this would have been a similar level of impossibility. Since all a codebase like that is is a kind of directed graph, then augmentations to the processing of the network to allow for the simultaneous parsing of and generation of this kind of code may…

So you've drank the industry kool aid.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#289
post #248

Earlier quoted context omitted.

Did I say I didn't "like" (I'd use the word "appreciate") it, or that I didn't think it should happen? If so, could you please highlight where? I just see, in what you're doing, a wild lack of self awareness. You're criticizing me for doing to someone else a milder version of what you're trying to do to me now; I'm genuinely confused how you can't see that, or how you could possibly stand the hypocrisy if you do unde…

I feel that you’re being dishonest if you are saying you’re confused or don’t understand my point.

I can't change how you feel.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#290
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

Did you used to be a graphic artist? Because maybe 25 years ago I had a friend who was an amazing pen-and-ink artist and who assured me Phtotoshop was a tool for amateurs and would never displace “real” art. This was in the San Diego area.
Post reply on HN