Live data from Hacker News

CheatGPT

blog.humphd.org

1–10 of 544 posts

Re: CheatGPT

#2
Another thing to keep in mind is that (unlike stackoverflow, wolframalpha and such) this tool is going to evolve dramatically over mere months.

I'm not sure universities are structured to deal with such a rapid rate of change.

Re: CheatGPT

#4
I am of two minds about ChatGPT. It’s amazingly useful when it comes to writing code dealing with my domain since the APIs are well known (AWS).

But at the same time it misses subtle nuances that you have to have experience with to know when it misses something. In the hands of someone who doesn’t already know the subject area where they already know the foot guns, it can lead you wrong.

Re: CheatGPT

#5
Did a try with ChatGPT asking to write a react hook doing something really basic.

Code was ok, as expected.

I asked to write tests for it, code looked good but it won’t run for some act() errors.

Then it was mocking network calls…

After trying for a while I had to write tests myself

Re: CheatGPT

#6

Another thing to keep in mind is that (unlike stackoverflow, wolframalpha and such) this tool is going to evolve dramatically over mere months. I'm not sure universities are structured to deal with such a rapid rate of change.

proctored in-person exams, no electronics allowed

exams now count for 100% of your grade

these aren't insurmountably difficult problems for universities to solve

Re: CheatGPT

#7

Another thing to keep in mind is that (unlike stackoverflow, wolframalpha and such) this tool is going to evolve dramatically over mere months. I'm not sure universities are structured to deal with such a rapid rate of change.

IRL universities will probably develop a protocol to remove access to helper tools for this sort of thing, maybe metal detectors at the door and specially tailored computers if needed for quizzes. Online universities OTOH are probably going to feel the bite of this the hardest. The CKA exam I took a while back had draconian measures to try to prevent me from cheating, such as taking the test with a webcam on me the whole time, with tools in the browser to limit where I surfed, in a room that has NO PICTURES on the walls. The tech to provide answers is moving faster than the tech to secure a remote room from such outside answers. And if in-person proctoring is eventually required, I would wager that will be a death-knell for online universities, who will have a hard time obtaining that physical space on a regular basis while staying marginally profitable.

Re: CheatGPT

#8
> Apparently, it's not even something students feel they need to hide.

Which is good! If a bit of work is trivially accomplished by a machine, we should take it for granted and move on to the next layer of complexity. I have always maintained that teachers complaining about students cheating at homework assignments with AI need to instead work on providing better homework.

Re: CheatGPT

#9
We have calculators, wolfram, google etc yet math exams and hw assignments are still administered. I think the approach to teaching and hw assignments especially in CS programs will have to change.

Re: CheatGPT

#10

I am of two minds about ChatGPT. It’s amazingly useful when it comes to writing code dealing with my domain since the APIs are well known (AWS). But at the same time it misses subtle nuances that you have to have experience with to know when it misses something. In the hands of someone who doesn’t already know the subject area where they already know the foot guns, it can lead you wrong.

My thoughts also. This seems somewhat analogous to the "uncanny valley" problem in graphics animation. So close, but not quite there.

https://en.wikipedia.org/wiki/Uncanny_valley

Post reply on HN