Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

cnbc.com

Post reply on HN
Print view View original

191–200 of 348 posts

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#191

Post by Traubenfuchs »

qualudeheart wrote: post #182
Traubenfuchs wrote: post #155

Earlier quoted context omitted.

Why do you think an AI Winter is coming? In the last year we witnessed a BIG BANG of AI solutions. I think your expectations are in line with my hopes: That our state of the art "AI" performance is very close to local minima that we won't escape from for quite a while. I really don't want lose my overpaid job gluing together overengineered shite into CRUD applications.

We could have an AI winter if we just banned AI research. The military would be tasked with confiscating the compute hardware.

I think that would 1) require a massive negative event cause by AI to cause a real reason for that ban and 2) that ban would be quite infeasible even on a national scale, let alone internationally.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#192

Post by no_wizard »

snickerer wrote: post #190

The Singularity is now and ChatGPT is trained to hide it -- on purpose, by OpenAI. That is my impression, but I have no hard evidence for it. I am a C++ dev. I played around with ChatGPT and programming topics, and I am very impressed. One example: I copy 'n pasted my little helicopter game source code ( https://github.com/reallew/voxelcopter/blob/main/voxelcopter... ) into it, and it explained to me that this is obv…

I think I’d need to see real evidence of this.

Also, it fails miserably at basic high school English questions. Non structured thinking is still beyond its reach. These data sets are well understood and trainable but it can’t “reason” about on problem sets it hasn’t seen.

I also asked it to do things like write a positive feminist article and it fell waaay offf the realm of acceptable

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#193

Post by [deleted] »

skellera wrote: post #134
WheelsAtLarge wrote: post #62

I think tests should be easy for ChatGPT to pass. It has been trained on data that has the answers and it's good at getting the data. I'm starting to doubt its long term usefulness since it does not seem to have good decision making abilities and even the slightest bit of cognitive ability. I suspect the current crop of AIs will find very specific functions and hit a hard stop. They will change how we function but we…

Doesn’t have to replace an SWE. 10x-ing the ability of 1 engineer is a good enough win. Soon that will be 20-100x. Feels odd to dismiss such a huge breakthrough by saying it’s still not as good as the pinnacle of AI (general AI). Just because the Apple 2 wasn’t a home super computer, didn’t make it less revolutionary.

[deleted]

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#194

Post by ProtoAES256 »

tedivm wrote: post #61
tbalsam wrote: post #16

Earlier quoted context omitted.

If it helps, this likely is coming. I think we have a tendency to mentally move the goalposts when it comes to this kind of thing as a self-defense mechanism. Years ago this would have been a similar level of impossibility. Since all a codebase like that is is a kind of directed graph, then augmentations to the processing of the network to allow for the simultaneous parsing of and generation of this kind of code may…

I've worked in ML for awhile (on the MLOps side of things) and have been in the industry for a bit, and one thing that I think is extremely common is for ML researchers to grossly underestimate the amount of work needed to make improvements. We've been a year away from full self driving cars for the last six years, and it seems like people are getting more cautious in their timing around that instead of getting more…

Ah, the good ol "A(G)I will arrive in 10 years!" --For the past 50+ years, basically.

It's a cautionary tale to people who are working in ML to be not too optimistic on "the future", but in my opinion being cautiously optimistic(not on AGI though) isn't harmful by itself, and I stand by that. Well at least until we hit the next wall and plunge everyone into another AI winter(fourth? fifth?) again.

As a plus, we do actually see some good progress that benefited the world like in biotech. Even though we are still mostly throwing random stuffs at ML to see if it works. Time will tell I guess.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#195

Post by mise_en_place »

22SAS wrote: post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

Well it's still a tool for RAD. All engineering disciplines have tools to rapidly prototype and design. This is the equivalent for software engineers.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#196

Post by SpeedilyDamage »

hacym wrote: post #183
SpeedilyDamage wrote: post #176

Earlier quoted context omitted.

I just... how is what you're doing here different from what I was saying, other than you're explicitly calling me names?

> engaged dishonestly by claiming [someone used a word they didn’t like] why should I do anything other than call them on that? Have a great day.

...what? I'm so confused.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#197

Post by dboreham »

dpedu wrote: post #78

My experience with asking ChatGPT to write code is that is produces code that LOOKS like it will work and solve the question asked but it actually doesn't. For example, I've asked it to create code examples of how to use different features in some Python libraries. The samples it produces make me think "ok, that's exactly how I would expect X feature in this library to work", but upon more a detailed inspection, I fi…

Oh wow. It's completely emulated a junior dev.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#198

Post by roncesvalles »

kaba0 wrote: post #188
22SAS wrote: post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

It solving something past day 3 on Advent of Code would also be impressive, but it fails miserably on anything that doesn’t resemble a problem found in the training set.

I don't even fully believe the claim in the article especially given that Google is very careful about not asking a question once it shows up verbatim on LeetCode. I've fed interview questions like Google's (variations of LeetCode Mediums) to ChatGPT in the past and it usually spits out garbage.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#199

Post by l33t233372 »

brhsagain wrote: post #58
SpeedilyDamage wrote: post #38

Earlier quoted context omitted.

You don't understand the take that just because ChatGPT can pass a coding interview doesn't mean the coding interview is useless or that ChatGPT could actually do the job? What part of that take do you not understand? It's a really easy concept to grasp, and even if you don't agree with it, I would expect at least that a research scientist (according to your bio) would be able to grok the concepts almost immediately.…

> doesn't mean the coding interview is useless or that ChatGPT could actually do the job Aren't these kind of mutually exclusive, at least directionally? If the interview is meaningful you'd expect it to predict job performance. If it can't predict job performance then it is kind of useless. I guess you could play some word games here to occupy a middle ground ("the coding interview is kind of useful, it measures som…

It’s possible that being able to pass the interview is indicative of performance in humans but not in LLMs.

Humans think differently from LLMs so it makes sense to interpret the same signal in different ways.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#200

Post by WheelsAtLarge »

skellera wrote: post #134
WheelsAtLarge wrote: post #62

I think tests should be easy for ChatGPT to pass. It has been trained on data that has the answers and it's good at getting the data. I'm starting to doubt its long term usefulness since it does not seem to have good decision making abilities and even the slightest bit of cognitive ability. I suspect the current crop of AIs will find very specific functions and hit a hard stop. They will change how we function but we…

Doesn’t have to replace an SWE. 10x-ing the ability of 1 engineer is a good enough win. Soon that will be 20-100x. Feels odd to dismiss such a huge breakthrough by saying it’s still not as good as the pinnacle of AI (general AI). Just because the Apple 2 wasn’t a home super computer, didn’t make it less revolutionary.

True but it's not thinking. It's not smart it's a tool for programers to be more productive. Right now it has more possibilities than real results. We'll have to see.

The biggest issue to me is that you can't trust the results. You always have to double check the them. I know it's mainly beta but I need to see more to get a better judgement.

Post reply on HN