Live data from Hacker News

CheatGPT

blog.humphd.org

151–160 of 544 posts

Re: CheatGPT

#151
post #147
post #117

I see a ton of people trying to justify their use of Copilot/ChatGPT (or rushing a startup to cash in on LLMs). Maybe that conflict of interest is why there's very little talk of it being based on plagiarizing and license violation of open source code on which the model was trained. We just suffered through a couple decades of almost every company in our field selling out users' privacy, one way or another. And years…

Right, any humans that reads open source code ever should also be forced to submit any code they write to ensure they've not mentally performed copyright violations. I don't give two shits if whatever current expensive GPT is dumping out code 'very similar' to open source code today. And you'd be chopping off your own nose if you did too. Thinking these models will remain as expensive to run in the future means that…

[deleted]

Re: CheatGPT

#152
post #10

I am of two minds about ChatGPT. It’s amazingly useful when it comes to writing code dealing with my domain since the APIs are well known (AWS). But at the same time it misses subtle nuances that you have to have experience with to know when it misses something. In the hands of someone who doesn’t already know the subject area where they already know the foot guns, it can lead you wrong.

My thoughts also. This seems somewhat analogous to the "uncanny valley" problem in graphics animation. So close, but not quite there. https://en.wikipedia.org/wiki/Uncanny_valley

And ChatGPT also caused me to do an amazing self own

https://news.ycombinator.com/item?id=34814257

Re: CheatGPT

#153

The professor could just ask the student: how did you come up with this solution? What was your thinking? To prepare for this question, the student has to think really hard both about the problem and about the solution. While doing so, we learn a lot - maybe more than we would learn otherwise.

Asking ChatGPT to explain the reason it gave an answer is a thing.

Re: CheatGPT

#154

So most interview questions like "make a binary tree" are dead. The best interview question that will never die: "What's the weirdest bug you debugged? What made it weird?" For posterity: https://www.gamedeveloper.com/programming/my-hardest-bug-eve...

While I'm not complaining that people are realizing they're dead... why is ChatGPT the final straw for those ridiculous "make a binary tree" questions?

Why wasn't it the fact that these questions became such a gameable system, that we started referring to them by the copyrighted name of a site where you can access nearly every permutation that will ever be asked of you, along with extremely detailed solutions with rationale: https://leetcode.com/

It's crazy to me that of everything that ChatGPT can do, regurgitating well known answers to well known interview questions is what kills anything off...

Re: CheatGPT

#155

I teach CS1. A lot of this post resonated with me. In particular, I don't think that beginners are well-served by relying on AI to complete their assignments. Later on, once they've developed some computational thinking abilities, sure. Starting out, no. There's a real dearth of good options available to computer science educators today for teaching introductory material effectively in the face of all the new and exi…

For CS1 you probably don't need much compute power for assignments. Schools are already well funded enough to sometimes offer freshman ipad pros. You could offer them a raspberry pi or some extremely cheap, low powered PC, make them return it after the semester if you want to save them money. You can firewall it from the open internet, and have students turn in their code from this device alone to a university server. They can still cheat, sure, but to do it would mean transcribing code from one device to another by hand, which is enough friction and a timesink where fewer students would consider it versus actually paying attention in class.

Re: CheatGPT

#156

Maybe take the approach many physics classes embrace (in germany) : All tools are allowed in tests: calculators, books, as long as the correct answer is derived with "correct derivation path". If chatgpt makes some problems too easy maybe it's a good thing because we can raise the bar. Find problems that require true understanding beyond auto complete / copy pasting.

Almost certainly the bar for problems that ChatGPT cannot solve is far, far higher than a student who is just learning computer science.

Re: CheatGPT

#157
Chomsky, in a recent interview, said if students are cheating with these tools, it’s the fault of the teacher for not creating work that is interesting enough to be absorbed by …

Re: CheatGPT

#158

The professor could just ask the student: how did you come up with this solution? What was your thinking? To prepare for this question, the student has to think really hard both about the problem and about the solution. While doing so, we learn a lot - maybe more than we would learn otherwise.

Asking ChatGPT to explain the reason it gave an answer is a thing.

My bet is that it won't be able to provide a human-level explanation.

Re: CheatGPT

#159
post #157

Chomsky, in a recent interview, said if students are cheating with these tools, it’s the fault of the teacher for not creating work that is interesting enough to be absorbed by …

There is nothing interesting about pointer dereferencing errors (or their slightly-more-turd-polished equivalent, null references). Absolutely nothing at all.

Most programmers will spend a non-trivial amount of their career fussing over them, however, and any programming education program that doesn't at least touch on how to identify them and what to do is pedagogically void.

Re: CheatGPT

#160

So most interview questions like "make a binary tree" are dead. The best interview question that will never die: "What's the weirdest bug you debugged? What made it weird?" For posterity: https://www.gamedeveloper.com/programming/my-hardest-bug-eve...

>So most interview questions like "make a binary tree" are dead.

"Make a binary tree and explain it on this whiteboard"

Post reply on HN