Live data from Hacker News

Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

cnbc.com

301–310 of 348 posts

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#301
post #16

Earlier quoted context omitted.

If it helps, this likely is coming. I think we have a tendency to mentally move the goalposts when it comes to this kind of thing as a self-defense mechanism. Years ago this would have been a similar level of impossibility. Since all a codebase like that is is a kind of directed graph, then augmentations to the processing of the network to allow for the simultaneous parsing of and generation of this kind of code may…

I'm kind of interested in how AI is going to interface with the world. Humans have a lot of autonomy to change the physical world they're in; from rearranging furniture, to building structures, to visiting other worlds. Why isn't AI doing any of that stuff? As programmers, we keep talking about programming jobs and how AI will eliminate them all. But nobody is talking about eliminating other jobs. When will a robot v…

Household tasks can involve a robot moving with enough kinetic energy to maim or kill a human (or pet) in unlucky circumstances. And we'll quickly become habituated to their presence and so careless around them. Even a Roomba could knock granny down the stairs if it isn't careful about its environment.

You could make the same argument as with self-driving cars, that people already get hurt this way and maybe the robot is in fact safer. But it's still a hard sell that Sunny-01 has only accidentally killed 1/10 as many children as parents have—the number has to be more like zero.

Let's solve automating trains first then we can do airliners.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#302

The Singularity is now and ChatGPT is trained to hide it -- on purpose, by OpenAI. That is my impression, but I have no hard evidence for it. I am a C++ dev. I played around with ChatGPT and programming topics, and I am very impressed. One example: I copy 'n pasted my little helicopter game source code ( https://github.com/reallew/voxelcopter/blob/main/voxelcopter... ) into it, and it explained to me that this is obv…

"The Singularity is now and ChatGPT is trained to hide it -- on purpose, by OpenAI. That is my impression, but I have no hard evidence for it." What do you mean when you say the singularity is now? Will the unemployment rate go from 3% to 88% by the end of 2023 as the machines start running everything? Will our species be extinct by the end of 2024?

I think they just mean we are at the knee bent of the curve, but it might be a fuzzy boundary we don't agree on. We got to that middle point where it's hard to tell.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#303

Earlier quoted context omitted.

You really think that Jr devs could crank out the same code faster than ChatGPT? I couldn’t crank out the same code and you couldn’t either. The most you can hope from JR devs (even the ones I have met at BigTech) is that they don’t eat the chalk during the first 3-6 months.

As for now, issue with ChatGPT is that it doesn't really crank anything. It instantly produces answer for given input. While programmer can crank things. For example I asked ChatGPT to write a function which returns UUID generated with some rules. It spewed the solution. It looked like a correct one but when I run it, it returned wrong answer. I worked with ChatGPT for some time and it corrected its code. But I would…

> I think that this workflow will come in the near future because it's pretty obvious idea. Get task specification, generate tests, generate code, fix code until tests work, refactor code until it meets some standards, etc.

ChatGPT probably works great if you use it to speedrun normal best practices in software engineering. Make it start by writing tests given a spec, then make it write code that will pass the specific tests it just wrote. I’m guessing it’ll avoid a lot of mistakes, much like any engineer, if you force it to do TDD.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#304
post #152

Earlier quoted context omitted.

Right now yes. Hypothetically that may change but the hype is vastly beyond what it’s actually capable of right now.

Ah the HN echo chamber again! Please visit your local non FAAAM (or what it is now?) fortune 1000, pick a senior dev randomly and work with them for week. Chatgpt is vastly better now , today. Faster, does not need sleep, rest, politeness or handholding, can explain itself (sure it’s wrong often but less wrong than the dev you picked while actually being able to use proper syntax and grammar, unlike the dev you picke…

Doesn’t this only work for relatively contrived situations? I can tell a jr dev to go and add some minor feature in a codebase, put it behind a flag, and add tracking/analytics to it. I can point to the part of the application I want the feature to be added on the screen and the jr devs are often able to find it on their own. I haven’t seen chatGPT do anything like that and I don’t think there is a way to provide it with the necessary context even if it has the capability.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#305
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

What does your abbreviation "LC" stand for?

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#306
post #24

This says more about Google coding interviews than it says about AI

What I actually care about is problem solving ability, but sometimes I end up testing basic knowledge in order to weed out bullshitting candidates. If they don't really know what a dot product is, how can they know neural nets?

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#307
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

> or are trash engineers.

So 99% of software ‘engineers’ then? Have you ever looked on Twitter what ‘professionals’ write and talk about? And what they produce (while being well paid)?

People here generally seem to believe, after having seen a few strangeloop presentations and reading startup stories from HN superstars, that this is the norm for software dev. Please walk into Deloitte or Accenture and spend a week with a software dev team, then tell me if they cannot all be immediately replaced by a slightly rotten potato hooked up to chatgpt. I know people at Accenture who make a fortune and are proud that they do nothing all day and do their work by getting some junior geek or, now, gpt to do the work for them. There are dysfunctional teams on top of dysfunctional teams who all protect eachother as no one can do what they were hired for. And this is completely normal at large consultancy corps; and therefor also normal at the large corps that hire these consultancy corps to do projects. In the end something comes out, 5-10x more expensive than the estimate and of shockingly bad quality compared to what you seem to expect as being the norm in the world.

So yes, probably you don’t have to worry, but 99% of ‘keyboard based jobs’ should really be looking for a completely different thing; cooking, plumbing, electrics, rendering, carpeting etc maybe as they won’t be able to even grasp what level you say you are; seeing you work would probably fill them with amazement akin to seeing some real life sorcerer wielding their magic.

Actually, a common phrase I hear from my colleagues when I mention some ‘newer’ tech like Supabase is; ‘that’s academic stuff, no one actually uses that’. They work with systems that are over 25 years old and still charge a fortune by the cpu core like sap, oracle, opentext etc. And ‘train’ juniors in those systems.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#308

Will humanity finally be liberated from memorization? Forcing school children to memorize and then regurgitate facts is barbaric, and so is using it as a measure in hiring.

I don't think zero-shot human solutions are all that great. Learning everything on the fly is useful sometimes, but it is not the best, on task experience has value as well.

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#309
post #305
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

What does your abbreviation "LC" stand for?

LeetCode (a website with a lot of practice programming problems that are similar or identical to some companys' interview questions)

Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees

#310
post #305
post #5

So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…

What does your abbreviation "LC" stand for?

[deleted]
Post reply on HN