Earlier quoted context omitted.
Most candidates can, it's just a matter of how much free time they have to spend memorising.
Challenge. I can barely remember what I had for breakfast yesterday much less.. the entire knowledge base of chatgpt
Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
281–290 of 348 posts
Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
#282I think this says more about the Google interview process than about ChatGPT. That a machine learning model can "bullshit" its way through an interview that is heavily leaning on recall of memorized techniques, algorithms and "stock" problems that have solutions (of various quality) all over Internet is not exactly surprising. Machines will always be able to "cram" better than humans. In practice these questions are…
I see a lot of criticism towards modern software engineer interviewing techniques, but never a solution offered that would catch and reject BS. Your comment comes off as "hire a person because you get along with them, don't worry if they can't write a function that accomplishes a simple task".
If you feel the need to separately establish that they can actually code, take your pick of GitHub, fizzbuzz, etc. You're probably doing one of these before the LC round anyway.
Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
#283Earlier quoted context omitted.
Don’t understand this take. If it was easy to make an LLM that quickly parsed all of StackOverflow and described new answers that most of the time worked in the timeframe of an interview, it would have been done by now. ChatGPT is clearly disruptive being the first useful chatbot in forever.
While I think the jury is still out on whether ChatGPT is truly useful or not, passing an L3 hiring test is not evidence of that one way or another.
I'd pay $100 a month for ChatGPT. It allows me to ask free-form questions about some open-source packages with truly appalling docs and usually gets them right, and saves me a bunch of time. It helps me understand technical language in papers I'm reading at the moment regarding stats. It's been useful to find good Google search terms for various bits of history I wanted to find out more about.
I don't think the jury is out at all on whether it's useful. The jury is out on the degree to which it can replace humans for tasks, and I'd suggest the answer is "no" for most tasks.
Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
#284Will humanity finally be liberated from memorization? Forcing school children to memorize and then regurgitate facts is barbaric, and so is using it as a measure in hiring.
The real question I think is how much entropy each memorized fact should contain.
Memorizing what the letter f does is much more valuable than memorizing the word floor. I don't need to know floor, the ai can know it for me
Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
#285Earlier quoted context omitted.
Reading that I can only assume you’ve made really poor use of Jr developers. Which ok I get why you think ChatGPT is more useful.
You really think that Jr devs could crank out the same code faster than ChatGPT? I couldn’t crank out the same code and you couldn’t either. The most you can hope from JR devs (even the ones I have met at BigTech) is that they don’t eat the chalk during the first 3-6 months.
Now if ChatGPT would be able to actually work on the problem rather than returning generated text, that would be a completely different beast. And I think that this workflow will come in the near future because it's pretty obvious idea. Get task specification, generate tests, generate code, fix code until tests work, refactor code until it meets some standards, etc.
Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
#286We changed the URL from https://www.pcmag.com/news/chatgpt-passes-google-coding-inte... to the article it points to Submitters: " Please submit the original source. If a post reports on something found on another site, submit the latter. " https://news.ycombinator.com/newsguidelines.html
The new article doesn't match at all the topic of the previous article.
Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
#287Earlier quoted context omitted.
Ah, the good ol "A(G)I will arrive in 10 years!" --For the past 50+ years, basically. It's a cautionary tale to people who are working in ML to be not too optimistic on "the future", but in my opinion being cautiously optimistic(not on AGI though) isn't harmful by itself, and I stand by that. Well at least until we hit the next wall and plunge everyone into another AI winter(fourth? fifth?) again. As a plus, we do ac…
Kurzweil gets a lot of flack for this sort of thing, he's generally presented as the ridiculous hype man for AI. And yet, he bet in 2002 that an AI would pass the Turing test by 2029. (And this is actually a more conservative prediction than "we will have AGI by 2029.") And looking at GPT3 it seems like he is probably going to win that bet.
I think even three years ago, most people would have thought the reverse.
So Kurzweil was imagining the turing test as the capstone to a decade of more and more capable ai products, not as "kind of early interesting success that may (or may not) presage really useful AI."
("The Turing test" is a pretty hazy target. I have no doubt that a chatgpt that was not trained to loudly announce that it was an AI could convince lots of people that it's a real human, right now. I think it's also the case that people with some experience with it could pretty quickly find ways to tell what it is.)
Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
#288So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…
If it helps, this likely is coming. I think we have a tendency to mentally move the goalposts when it comes to this kind of thing as a self-defense mechanism. Years ago this would have been a similar level of impossibility. Since all a codebase like that is is a kind of directed graph, then augmentations to the processing of the network to allow for the simultaneous parsing of and generation of this kind of code may…
Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
#289Earlier quoted context omitted.
Did I say I didn't "like" (I'd use the word "appreciate") it, or that I didn't think it should happen? If so, could you please highlight where? I just see, in what you're doing, a wild lack of self awareness. You're criticizing me for doing to someone else a milder version of what you're trying to do to me now; I'm genuinely confused how you can't see that, or how you could possibly stand the hypocrisy if you do unde…
I feel that you’re being dishonest if you are saying you’re confused or don’t understand my point.
Re: Google testing ChatGPT-like chatbot 'Apprentice Bard' with employees
#290So, a LLM, trained extensively on StackOverflow and other data (possibly the plethora of LC solutions out there), is fed a bunch of LC questions and spits out the correct solutions? In other news, water is blue. It is one thing to train an AI on megatons of data, for questions which have solutions. The day ChatGPT can build a highly scalable system from scratch, or an ultra-low latency trading system that beats the c…