Live data from Hacker News

Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

cnbc.com

261–270 of 348 posts

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#261
post #185

I think this says more about the Google interview process than about ChatGPT. That a machine learning model can "bullshit" its way through an interview that is heavily leaning on recall of memorized techniques, algorithms and "stock" problems that have solutions (of various quality) all over Internet is not exactly surprising. Machines will always be able to "cram" better than humans. In practice these questions are…

I see a lot of criticism towards modern software engineer interviewing techniques, but never a solution offered that would catch and reject BS. Your comment comes off as "hire a person because you get along with them, don't worry if they can't write a function that accomplishes a simple task".

> Your comment comes off as "hire a person because you get along with them, don't worry if they can't write a function that accomplishes a simple task".

No. He is simply saying the current interview only focuses on LC above all else. And should focus on soft skills as well among other things. You took his argument and flipped it 180 and went to the other extreme end. It's false dichotomy.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#262

I think tests should be easy for ChatGPT to pass. It has been trained on data that has the answers and it's good at getting the data. I'm starting to doubt its long term usefulness since it does not seem to have good decision making abilities and even the slightest bit of cognitive ability. I suspect the current crop of AIs will find very specific functions and hit a hard stop. They will change how we function but we…

Hardware will keep improving even in a winter due to games and other uses.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#263
post #255

Earlier quoted context omitted.

I’ve worked with plenty of jr developers at east coast government contractors, arguably the bottom of the barrel. I would still rather put their code into production, even without unit tests, than I would ChatGPT. ChatGPT is only cheap if you don’t need its code to do anything of any particular value. It’s a seemingly ideal solution to collage homework for example. But professionally people write code to actually ach…

And junior devs are horrible at knowing what problem to solve and how to solve it without handholding. I am working on a relatively complex DevOps/“cloud application modernization” project. Where the heavy lifting is designing the process and gathering requirements. But there are a lot of 20-40 line Lambdas and Python/boto3 (AWS SDK), yaml/json wrangling, dynamic Cloudformation creating scripts. I was able to give Ch…

Reading that I can only assume you’ve made really poor use of Jr developers.

Which ok I get why you think ChatGPT is more useful.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#264
post #139
post #2

why does chatGPT passing tests or interviews continue to make headlines? all they're proving is that tests, and interviews, are bullshit constructs that merely attempt to evaluate someone's ability to retain and regurgitate information

And this is the AI effect in practice. We are past the point where the original idea of the Turing test has been met by machine intelligence. We are at that point. The problem with people is we keep pushing it to "Only AGI/machine superintelligence is good enough". We are getting models that behave closer to human level. The 'doesn't know everything, is good at somethings, and bullshits pretty well'. Yea, that's the…

[deleted]

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#265
post #32

If you gave someone with no programming experience access to a search engine during the interview, they would likely be able to find the appropriate LC problem to copy/paste the solution. If the interview were slightly modified so that the problem isnt googleable, a 2nd year CS major could probably map it to a problem that is LC searchable.

Google search is getting so bad I'm not sure about that.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#266
post #263

Earlier quoted context omitted.

And junior devs are horrible at knowing what problem to solve and how to solve it without handholding. I am working on a relatively complex DevOps/“cloud application modernization” project. Where the heavy lifting is designing the process and gathering requirements. But there are a lot of 20-40 line Lambdas and Python/boto3 (AWS SDK), yaml/json wrangling, dynamic Cloudformation creating scripts. I was able to give Ch…

Reading that I can only assume you’ve made really poor use of Jr developers. Which ok I get why you think ChatGPT is more useful.

You really think that Jr devs could crank out the same code faster than ChatGPT? I couldn’t crank out the same code and you couldn’t either. The most you can hope from JR devs (even the ones I have met at BigTech) is that they don’t eat the chalk during the first 3-6 months.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#267
post #78

My experience with asking ChatGPT to write code is that is produces code that LOOKS like it will work and solve the question asked but it actually doesn't. For example, I've asked it to create code examples of how to use different features in some Python libraries. The samples it produces make me think "ok, that's exactly how I would expect X feature in this library to work", but upon more a detailed inspection, I fi…

Let's see you write a few pages of working code from memory without compiling or getting a feedback loop

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#268

Earlier quoted context omitted.

>We've been a year away from full self driving cars for the last six years Try at least 12 [0] (I would say 15 but my 45-second search didn't yield anything that far back) [0] https://spectrum.ieee.org/how-google-self-driving-car-works

https://www.youtube.com/watch?v=I39sxwYKlEE was a self-driving van in 1986 which could detect obstacles by 1999 and drive in a convoy using that. This is a bit like seeing Steve Mann's wearable computers over the years ( https://cdn.betakit.com/wp-content/uploads/2013/08/Wearcompe... ) and then today anyone with a smartphone and smart watch has more computing power and more features than most of his gear ever had, ap…

Did you notice how far rotated the steering wheel is off of center while the Mercedes van vehicle is going straight on the highway? That looks crazy.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#269

Earlier quoted context omitted.

Based on my experience watching How It’s Made, many factories are extremely automated including lots of robots. Warehouses are not factories though.

Lookup lights out manufacturing. There are factories that often run whole days in the dark because there's no point turning on the nights if there's no one around

They are mostly a myth, though not always.

This comment from 7 days ago covers it adequately:

https://news.ycombinator.com/item?id=34562122

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#270
post #265
post #32

If you gave someone with no programming experience access to a search engine during the interview, they would likely be able to find the appropriate LC problem to copy/paste the solution. If the interview were slightly modified so that the problem isnt googleable, a 2nd year CS major could probably map it to a problem that is LC searchable.

Google search is getting so bad I'm not sure about that.

People have adapted to the subpar quality of results (on all search engines) and figured out how to find things.
Post reply on HN