Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

CheatGPT

blog.humphd.org

Post reply on HN
Print view View original

241–250 of 544 posts

Re: CheatGPT

#241

Post by adastra22 »

kurisufag wrote: post #222
throw310822 wrote: post #209

I don't understand how most of the comments here seem to be along the lines of "these interview questions are useless now" or "we need to rethink education, it hasn't kept up". These all seem absurdly myopic to me. What we're seeing is the first instance, still very limited and imperfect, of AGI. This is not going to make some interview questions obsolete, or give students more tools to cheat with their homework. It…

>What we're seeing is the first instance, still very limited and imperfect, of AGI absolutely not. language-model text generation is actually about as non-general as it gets -- they are fundamentally incapable of understanding anything at all, ever. they can't do math, work through basic logic problems, or produce any output that isn't just an assumed logical continuation of the input.

Have you actually used any of these products? GPT et al are perfectly capable of taking knowledge from any one domain and applying it towards the solution of any other problem domain, through various kinds of data abstraction, reasoning by analogy, and other techniques similar to what humans do. It makes plenty of goofups along the way, just like humans do. But if your requirement is that it performs absolutely perfectly in new domains without making any mistake or needing any supervision... well that is certainly a requirement no human could ever meet, either.

Re: CheatGPT

#243

Post by BoorishBears »

dinkumthinkum wrote: post #231
BoorishBears wrote: post #154

Earlier quoted context omitted.

While I'm not complaining that people are realizing they're dead... why is ChatGPT the final straw for those ridiculous "make a binary tree" questions? Why wasn't it the fact that these questions became such a gameable system, that we started referring to them by the copyrighted name of a site where you can access nearly every permutation that will ever be asked of you, along with extremely detailed solutions with ra…

I mean if you can’t make a binary tree, what do you really know about programming? If ChatGPT is so great, why would even need a job interview, why not just eliminate the jobs altogether?

You know, the only thing I get more sure of over the years is that defining a "good programmer" is hard

Now, I can't tell if you're being facetious or not, but if one seriously conflates being able to write a binary tree with knowing how to program... they're at least making defining the antonym a bit easier.

-

Also no one is saying ChatGPT is "so great" in this specific case, if anything the point is that ChatGPT can do impressive things, but again, regurgitating leetcode answers isn't one of them.

Re: CheatGPT

#244

Post by drakmo »

resource0x wrote: post #211
brycedriesenga wrote: post #190

Earlier quoted context omitted.

You can use this for that: https://huggingface.co/spaces/JavaFXpert/Chat-GPT-LangChain (GPT + WolframAlpha + Whisper)

I tested several AI chats, and none of them could correctly answer the question: "what is heavier, 1 kilogram of nails or 1 kilogram of feathers?". Does this one know? (I don't have openai key, can't test it myself). EDIT: turns out, the latest version of chatGPT knows the answer. They also fixed the answer to another famous trick question("The son of my father, but not my brother. Who is that?")

here we go: Both 1 kilogram of nails and 1 kilogram of feathers have the same weight, which is 1 kilogram.

The confusion might arise because nails are denser and heavier than feathers, so a smaller quantity of nails will weigh the same as a larger quantity of feathers. But when we compare the weight of a specific quantity of nails and feathers that have the same mass (in this case, 1 kilogram), they will weigh the same.

Re: CheatGPT

#245

Post by testTED »

BoorishBears wrote: post #225
epicureanideal wrote: post #162

Earlier quoted context omitted.

> "What's the weirdest bug you debugged? What made it weird?" If you can remember, 5-10 years after you solved it.

I would 100% accept that as an answer since it tells me the candidate is not good with subtext, and that's really needed to solve a lot of interesting problems. After all, if I ask "what's your favorite food you've ever eaten", there's an unspoken implication that it's a food you remember eating. I am not in fact asking you to recall every single food you've ever eaten and choose one... - From my comment below since…

But you are asking for the most interesting example, which you may remember from context, but not in any interesting or even technical detail.

Re: CheatGPT

#246

Post by techie128 »

josh2600 wrote: post #123

So most interview questions like "make a binary tree" are dead. The best interview question that will never die: "What's the weirdest bug you debugged? What made it weird?" For posterity: https://www.gamedeveloper.com/programming/my-hardest-bug-eve...

no, in-person whiteboard / laptop based interviews can still ask these questions when the interviewer is shadowing you IDE.

Re: CheatGPT

#247

Post by nine_k »

menzoic wrote: post #214
enraged_camel wrote: post #181

Earlier quoted context omitted.

ChatGPT also has decent explanations tbh.

ChatGPT provides excellent explanations in multiple languages for all code I've seen it write.

How many of them are indeed correct?

https://auerstack.substack.com/p/what-chatgpt-cant-do then search for 'prime' and read the transcript.

Re: CheatGPT

#248

Post by squeaky-clean »

lumost wrote: post #191
josh2600 wrote: post #123

So most interview questions like "make a binary tree" are dead. The best interview question that will never die: "What's the weirdest bug you debugged? What made it weird?" For posterity: https://www.gamedeveloper.com/programming/my-hardest-bug-eve...

is a hard bug the best interview question? When I do my job right 98% of the time is not debugging. This ratio changed dramatically over the course of my career.

I agree it's the best question because it's a good topic to begin a bigger conversation about your programming experience. It's hard to fake and you can take the discussion in many directions. Simply asking for their weirdest bug, getting an answer, and going "ok good, let's move on" is a bad interview question.

For example, you say the ratio of debugging:development changed dramatically over the course of your career. I would follow up and ask what key things you would attribute that to? Testing? Changing languages? Changing programming paradigms? Maybe it's simply that you have a wider knowledge of CS concepts and a stronger intuition for the correct way to model your logic. There's no right or wrong answers, just trying to see that you actually do have some opinions of your own.

Re: CheatGPT

#249

Post by consumer451 »

resource0x wrote: post #211
brycedriesenga wrote: post #190

Earlier quoted context omitted.

You can use this for that: https://huggingface.co/spaces/JavaFXpert/Chat-GPT-LangChain (GPT + WolframAlpha + Whisper)

I tested several AI chats, and none of them could correctly answer the question: "what is heavier, 1 kilogram of nails or 1 kilogram of feathers?". Does this one know? (I don't have openai key, can't test it myself). EDIT: turns out, the latest version of chatGPT knows the answer. They also fixed the answer to another famous trick question("The son of my father, but not my brother. Who is that?")

I tried it. TLDR; no it does not get it correct. But ChatGPT does!

> 1 kilogram of nails is heavier than 1 kilogram of feathers.

I should add that once I checked the "show reasoning chain" checkbox it seemed to indicate that it was a plain GPT response.

> Thought: Do I need to use a tool? No

> AI: 1 kilogram of nails is heavier than 1 kilogram of feathers.

> 1 kilogram of nails is heavier than 1 kilogram of feathers.

Once I checked all the tools in settings to include Wolfram Alpha I got this:

> Thought: Do I need to use a tool? Yes

> Action: Wolfram Alpha Action

> Input: what is heavier, 1 kilogram of nails or 1 kilogram of feathers?

> Observation: Wolfram Alpha wasn't able to answer it

> Thought: Do I need to use a tool? No

> AI: It is difficult to answer this question without knowing the exact size and shape of the nails and feathers. Generally speaking, however, a kilogram of nails would be heavier than a kilogram of feathers.

> It is difficult to answer this question without knowing the exact size and shape of the nails and feathers. Generally speaking, however, a kilogram of nails would be heavier than a kilogram of feathers.

---

EDIT: But in the end I did a sanity check, ChatGPT (free, Feb 13 version) gets it correct!

> Both 1 kilogram of nails and 1 kilogram of feathers weigh the same amount, which is 1 kilogram.

> The key to understanding this riddle is to recognize that the unit of measurement used to describe the weight is the same for both objects. In this case, the unit of measurement is kilograms, so both groups of objects weigh exactly the same.

> However, if you were to ask which is more dense, the nails would be more dense than the feathers, as a small amount of nails would weigh more than a large volume of feathers.

Re: CheatGPT

#250

Post by teaearlgraycold »

jack_pp wrote: post #238
epicureanideal wrote: post #162

Earlier quoted context omitted.

> "What's the weirdest bug you debugged? What made it weird?" If you can remember, 5-10 years after you solved it.

Exactly, I've been programming for a long time, almost 13 years since I started working on complex software and that question just makes me draw a blank. There's been bugs in my career but none that have "traumatized" me or been all that complicated to get through. Maybe I just don't put that much emphasis on negative experiences. I don't remember losing poker hands all that accurately either, I just don't care. Also…

Working with Rails I learned, after much hair loss, that Class.new is a memory leak. So it can happen in high level languages, too.
Post reply on HN