Live data from Hacker News

Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

cnbc.com

291–300 of 348 posts

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#291

Earlier quoted context omitted.

I don't think ChatGPT or its successors will be able to do large-scale software development, defined as 'translating complex business requirements into code', but the actual act of programming will become more one of using ML tools to create functions, and writing code to link them together with business logic. It'll still be programming, but it will just start at a higher level, and a single programmer will be vastl…

That's my assumption as well - the human programmers will far more productive, but they'll still be required because there's no way we can take the guard rails off and let the AI build - it'll build wrong unit tests for wrong functions which create wrong programs and will require humans to get it back on track.

Is your opinion time bounded to 5 years? 20 years? 100 years? Forever?

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#292
> “According to my data base access, it is unlikely for Google to conduct another round of layoffs in 2023,” the response reads. “Layoffs are generally conducted to reduce costs and structure, but the company is doing well financially. In fact, Google’s revenue increased by 34% in 2021, and the company’s stock price has risen by 70% since January 2022.”

In January 2022, the Google stock price was actually nearly at an all-time high. Its current price is 24% less than January 2022.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#293
post #61
post #16

Earlier quoted context omitted.

If it helps, this likely is coming. I think we have a tendency to mentally move the goalposts when it comes to this kind of thing as a self-defense mechanism. Years ago this would have been a similar level of impossibility. Since all a codebase like that is is a kind of directed graph, then augmentations to the processing of the network to allow for the simultaneous parsing of and generation of this kind of code may…

I've worked in ML for awhile (on the MLOps side of things) and have been in the industry for a bit, and one thing that I think is extremely common is for ML researchers to grossly underestimate the amount of work needed to make improvements. We've been a year away from full self driving cars for the last six years, and it seems like people are getting more cautious in their timing around that instead of getting more…

You have just described Pareto's principle[0] the 80/20 rule. It takes 20% of the effort to get to 80% but it then takes 80% of the the effort to finish the final 20%.

[0]https://en.m.wikipedia.org/wiki/Pareto_principle

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#294
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

> It is one thing to train an AI on megatons of data, for questions which have solutions.

More than anything, I feel this highlights the folly of interviewing based on leetcode memorization.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#295

The Singularity is now and ChatGPT is trained to hide it -- on purpose, by OpenAI. That is my impression, but I have no hard evidence for it. I am a C++ dev. I played around with ChatGPT and programming topics, and I am very impressed. One example: I copy 'n pasted my little helicopter game source code ( https://github.com/reallew/voxelcopter/blob/main/voxelcopter... ) into it, and it explained to me that this is obv…

"The Singularity is now and ChatGPT is trained to hide it -- on purpose, by OpenAI.

That is my impression, but I have no hard evidence for it."

What do you mean when you say the singularity is now? Will the unemployment rate go from 3% to 88% by the end of 2023 as the machines start running everything?

Will our species be extinct by the end of 2024?

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#296

Earlier quoted context omitted.

You really think that Jr devs could crank out the same code faster than ChatGPT? I couldn’t crank out the same code and you couldn’t either. The most you can hope from JR devs (even the ones I have met at BigTech) is that they don’t eat the chalk during the first 3-6 months.

As for now, issue with ChatGPT is that it doesn't really crank anything. It instantly produces answer for given input. While programmer can crank things. For example I asked ChatGPT to write a function which returns UUID generated with some rules. It spewed the solution. It looked like a correct one but when I run it, it returned wrong answer. I worked with ChatGPT for some time and it corrected its code. But I would…

> But I would expect from junior developer to actually run his code and check output.

You give junior devs way too much credit. They rarely test corner cases.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#297

Earlier quoted context omitted.

You really think that Jr devs could crank out the same code faster than ChatGPT? I couldn’t crank out the same code and you couldn’t either. The most you can hope from JR devs (even the ones I have met at BigTech) is that they don’t eat the chalk during the first 3-6 months.

As for now, issue with ChatGPT is that it doesn't really crank anything. It instantly produces answer for given input. While programmer can crank things. For example I asked ChatGPT to write a function which returns UUID generated with some rules. It spewed the solution. It looked like a correct one but when I run it, it returned wrong answer. I worked with ChatGPT for some time and it corrected its code. But I would…

You can loop chatgpt around automatically, asking it to write tests and reason about the code for a few iterations; in my experience it auto corrects the code like a human would after some ‘thinking’ time. Of course the code has to run automatically and errors fed back, like with a human. It works fine though, without human input after some prompting work.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#298
post #78

My experience with asking ChatGPT to write code is that is produces code that LOOKS like it will work and solve the question asked but it actually doesn't. For example, I've asked it to create code examples of how to use different features in some Python libraries. The samples it produces make me think "ok, that's exactly how I would expect X feature in this library to work", but upon more a detailed inspection, I fi…

> produces code that LOOKS like it will work and solve the question asked but it actually doesn't

You just described my first draft of any program.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#299
post #16
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

If it helps, this likely is coming. I think we have a tendency to mentally move the goalposts when it comes to this kind of thing as a self-defense mechanism. Years ago this would have been a similar level of impossibility. Since all a codebase like that is is a kind of directed graph, then augmentations to the processing of the network to allow for the simultaneous parsing of and generation of this kind of code may…

I think there's a real story here behind the ownership and usage of proprietary data.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#300

Earlier quoted context omitted.

When I read this I feel people must be using it in the wrong way. I use it all the time to quickly solve tech problems I mostly know something about, however it’s so smart it regularly takes 1-2 hour problems for me and turns them into 10 mins ones. That is definitely not dumb from my perspective, but obviously it’s also not smart in it will give me profound understanding of something, but ok whatever, it’s still a m…

It's dumb in the sense that it doesn't actually have a symbolic understand of what it's actually saying. I use it quite frequently too, mostly for solving coding problems, but at the end of the day it's just regurgitating information that it read online. If we took an adversarial approach and deliberately tried to feed it false information, it would have no way of knowing what's bullshit and what's legit, in the way…

How many book mistakes have you found, as a human, so far? How about deliberate mistakes hidden in plain sight? I once re-validated for 3 times the same test set and was still finding mistakes.
Post reply on HN