Live data from Hacker News

CheatGPT

blog.humphd.org

481–490 of 544 posts

Re: CheatGPT

#481

As a CS professor myself, I don't think ChatGPT really creates entirely new problems for assessment, but rather makes problems that we had been sweeping under the carpet more obvious and harder to ignore. Any assignment that can be cheated by using ChatGPT could already be cheated before by asking a friend, an expert or paying someone else to do it. But most teachers assumed this doesn't happen often, and thus acted…

> asking a friend, an expert or paying someone else to do it

Surely you understand ChatGPT is infinitely more scalable. How many people can just "ask a friend" or have a spare money to pay someone else multiple times?

Re: CheatGPT

#482

Earlier quoted context omitted.

> they can't do math, work through basic logic problems ChatGPT begs to differ: Me: How do I measure 4 liters when I have a 3 liter bottle and a 5 liter bottle? ChatGPT: Here are the steps to measure 4 liters using a 3 liter and a 5 liter bottle: Fill the 5 liter bottle completely with water. Pour 3 liters from the 5 liter bottle into the 3 liter bottle, leaving 2 liters in the 5 liter bottle. Now you have 3 liters o…

OTOH, ChatGPT also agrees with kurisufag. I entered your prompt and got the same reply from ChatGPT. Then I changed "4 liters" to "4 gallons" and got this: To measure 4 gallons of liquid using a 3-liter and a 5-liter bottle, you would need to convert gallons to liters first. One gallon is approximately equal to 3.785 liters, so 4 gallons is approximately equal to 15.14 liters. Since the available bottles have capacit…

And it uses the 5 liter bottle to top up the separate container leaving 2 liters, and then proceeds to fill up the separate container.

Looks like it's mixing up elements of the solution to the original problem without understanding how the topping up works, with the solution to a different problem that it felt was sufficiently related. It's a wild guess based on similarity.

Re: CheatGPT

#484
> What about students who don't really know what they're doing and just need to get something submitted for this damned assignment before 11:59 pm?

The author mentions ChatGPT is better for more advanced users, rather than beginners. I disagree.

I think ChatGPT is really good for beginners. Instead of being stuck or making up the "why" something is done, ChatGPT can answer it. There is simply no way a lecturer or classroom has time to go "5+ why's" deep into a Question. ChatGPT at least will do it, and then you can fact check it. It helps me improve my vocabulary, point me into right placed which I can investigate further.

When I use ChatGPT for difficult problems, it doesn't give me anything useful or correct.

Re: CheatGPT

#485
post #471

As a CS professor myself, I don't think ChatGPT really creates entirely new problems for assessment, but rather makes problems that we had been sweeping under the carpet more obvious and harder to ignore. Any assignment that can be cheated by using ChatGPT could already be cheated before by asking a friend, an expert or paying someone else to do it. But most teachers assumed this doesn't happen often, and thus acted…

For my university, not that long ago, it was possible to finish computer science, without touching a computer. Still in my time most exams were done on paper. Think of algorithms in pseudocode. But also a lot of logic like reasoning, with process automata, or relational algebra (databases).

The graduates from your University must kill it on whiteboard interviews :-)

Re: CheatGPT

#486

Earlier quoted context omitted.

I tested several AI chats, and none of them could correctly answer the question: "what is heavier, 1 kilogram of nails or 1 kilogram of feathers?". Does this one know? (I don't have openai key, can't test it myself). EDIT: turns out, the latest version of chatGPT knows the answer. They also fixed the answer to another famous trick question("The son of my father, but not my brother. Who is that?")

It does not. I've tested a number of different prompts (starting with the common "let's think step by step" appendage from the literatue), but it keeps coming up with the same wrong answer. I finally broke down and started arguing with it. Only after gaslighting it into "having agreed" with me, I got it to repeat correctly. (By the way this is not chatgpt but just the gpt3.5 model, I find it easier to work with, not…

Many humans would answer the same...

Re: CheatGPT

#487
post #471

As a CS professor myself, I don't think ChatGPT really creates entirely new problems for assessment, but rather makes problems that we had been sweeping under the carpet more obvious and harder to ignore. Any assignment that can be cheated by using ChatGPT could already be cheated before by asking a friend, an expert or paying someone else to do it. But most teachers assumed this doesn't happen often, and thus acted…

For my university, not that long ago, it was possible to finish computer science, without touching a computer. Still in my time most exams were done on paper. Think of algorithms in pseudocode. But also a lot of logic like reasoning, with process automata, or relational algebra (databases).

[deleted]

Re: CheatGPT

#488
post #481

As a CS professor myself, I don't think ChatGPT really creates entirely new problems for assessment, but rather makes problems that we had been sweeping under the carpet more obvious and harder to ignore. Any assignment that can be cheated by using ChatGPT could already be cheated before by asking a friend, an expert or paying someone else to do it. But most teachers assumed this doesn't happen often, and thus acted…

> asking a friend, an expert or paying someone else to do it Surely you understand ChatGPT is infinitely more scalable. How many people can just "ask a friend" or have a spare money to pay someone else multiple times?

There is also a risk associated with asking another person to be an acomplice. Unlike ChatGPT, they might turn on you.

Re: CheatGPT

#489

As a CS professor myself, I don't think ChatGPT really creates entirely new problems for assessment, but rather makes problems that we had been sweeping under the carpet more obvious and harder to ignore. Any assignment that can be cheated by using ChatGPT could already be cheated before by asking a friend, an expert or paying someone else to do it. But most teachers assumed this doesn't happen often, and thus acted…

As a parent, I'm hoping this will reduce the at-home workloads and shift more work towards school. What's the real life value of having students go to school and then spend all-nighters trying to do homework and all the expected extra-curricular?

As I remember my education time from high-school onwards, all-nighters were usually a consequence of slacking off during school time.

In college/university a fairly big part of the education was learning what was compulsory reading and what was optional. There was always more reading than hours in the day.

Re: CheatGPT

#490
post #316

As a CS professor myself, I don't think ChatGPT really creates entirely new problems for assessment, but rather makes problems that we had been sweeping under the carpet more obvious and harder to ignore. Any assignment that can be cheated by using ChatGPT could already be cheated before by asking a friend, an expert or paying someone else to do it. But most teachers assumed this doesn't happen often, and thus acted…

> the continuous assessment fad that has always been rather disastrous for equity Can you expand on this? I lived the two models as a student and still can't make up my mind on which is best. I feel like it just takes catching some bad cold the week of the exams or a bad exam subject / topic to fail them which seems pretty unfair, but I also know my shit better and have more perspective the week of the exam and prefe…

This is probably an unpopular opinion, but in my view, traditional final exams tend to be a great equalizer. Continuous assessment is affected much more by personal circumstances.

For example, continuous assessment tends to force students to devote a constant amount of time throughout the course, which is fine for those who can afford to be full-time students, but disastrous for students who need to have a job to pay the bills. I have seen plenty of students like that getting frustrated because they lose points to this.

On the other hand, continuous assessment typically relies on assignments at home and these are deeply unequal and classist as well. The difficulty of these assignments depends on whether the student has someone more experienced to ask, whether they are paying for a private tutor, or whether they can plainly buy the assignment. I have known cases of students that basically bought every project and assignment that could be done at home, you know what made them sweat because it couldn't be bought? The final exam.

But almost no one cares about these things, continuous assessment is seen as the "progressive" thing to do because it's more modern and different from tradition, even if it's extremely classist and disproportionately harms working-class students.

On the other hand, it is true, as you point out, that the final exam model disadvantages students who have the bad luck of getting sick in that week. It's a real drawback, sadly. I still think it's better all things considered, for the reasons above.

Post reply on HN