Live data from Hacker News

Training students to prove they're not robots is pushing them to use more AI

techdirt.com

81–90 of 183 posts

Re: Training students to prove they're not robots is pushing them to use more AI

#81
post #72

Earlier quoted context omitted.

To have end of semester grades be determined by work that is done by the student, not through weekly assignments where it’s trivial to cheat

To what end? Not cheating on the weekly assignments is surely more beneficial to learning than cheating on them is, but I don’t see how removing the assignments altogether would help students learn.

If you nail the one exam, you get an A+. If you fail it, you get an F. In between, you get what your score says you get.

Re: Training students to prove they're not robots is pushing them to use more AI

#82

I've started do this on social media. I got "called out" after using big words or using a - in a sentence. So now I write less good on purpose, so whatever I commented doesn't get drawn into a sidetrack off-topic witch-hunt. As soon as someone yells "witch" you cannot disprove you're not one, and I've even had people put my handwritten comments through "AI detector" websites that "proved" they were AI (they weren't).…

[flagged]

Re: Training students to prove they're not robots is pushing them to use more AI

#83
post #66

The core of the problem the article is about isn't AI or LLMs, it's about scam software that claims to catch cheating. It's crap for the same reasons that crime predictions software is crap. It's selling a panacea, and that kind of product inherently attracts scammers. If your school uses software to detect AI writing, that's a problem with the quality of your school. The people choosing that software are too stupid…

I'm always startled about how HN approaches these topics. When we have a press release from a university about how researchers can detect thoughts via fMRI, we have no issue with the claim. But if a vendor makes a pretty believable claim that there are repetitive statistical patterns in LLM output, it's all of sudden treated the same as palm reading.

The problem isn't that AI detection doesn't work. State of the art in this field is pretty solid. The only issue is that it's probabilistic, so it sometimes fails, and when it does, we have nothing else in situations where you actually want to know if someone put in the work.

So what are you proposing, exactly? That we run a large-scale experiment of "let's see what happens if children don't actually need to learn to do thinking and writing on their own"? The reality is that without some form of compulsion, most kids would rather play video games / scroll through TikTok all day. Or that we move to a vastly more resource-intensive model where every kid is given personalized instruction and watched 1:1?

Re: Training students to prove they're not robots is pushing them to use more AI

#84

Perhaps we should not grade students on weekly, or other occasional, writing during the term or semester. How about going back to the old system where, apart from experimental lab work, nothing is graded until the end of the term? All weekly assignments should just be considered prep for one exam at the end of the term where the student has an opportunity to demonstrate mastery of the course's subject matter. They ca…

This approach does not really solve the core issue. In practice, students often do poorly when evaluation is concentrated in one end of term exam. It also pushes many students to cram at the end of the term instead of learning steadily.

A better approach is to rethink what we assess and how we assess it. Research shows that the design of assessments plays an important role in academic integrity. Assignments that require original thinking and regular engagement can reduce incentives to cheat and improve learning outcomes.

https://www.sciencedirect.com/science/article/abs/pii/S22119...

Re: Training students to prove they're not robots is pushing them to use more AI

#85
post #66

The core of the problem the article is about isn't AI or LLMs, it's about scam software that claims to catch cheating. It's crap for the same reasons that crime predictions software is crap. It's selling a panacea, and that kind of product inherently attracts scammers. If your school uses software to detect AI writing, that's a problem with the quality of your school. The people choosing that software are too stupid…

Does crapping on the average school's deep well of expertise for evaluating how effectively AI software solutions address their problems somehow fix the underlying problem (that the cost of catching cheaters is significantly higher than the cost of cheating)?

(This is roughly the same problem as evaluating software that only does an approximation of what it claims to do.)

(Aside: AI-based variations on this theme are in the early stages of proliferating across our society. They're being developed by many people using this forum and being sold to our schools, businesses, governments, and other organizations with little regard to whether they actually do what they claim.)

Re: Training students to prove they're not robots is pushing them to use more AI

#86

Perhaps we should not grade students on weekly, or other occasional, writing during the term or semester. How about going back to the old system where, apart from experimental lab work, nothing is graded until the end of the term? All weekly assignments should just be considered prep for one exam at the end of the term where the student has an opportunity to demonstrate mastery of the course's subject matter. They ca…

Came here to say the same thing. The AI problem is functionally no different to the paid essay writers. Grade everything at face value, and then have people write essays under exam conditions for grading.

Re: Training students to prove they're not robots is pushing them to use more AI

#87
post #53

Perhaps we should not grade students on weekly, or other occasional, writing during the term or semester. How about going back to the old system where, apart from experimental lab work, nothing is graded until the end of the term? All weekly assignments should just be considered prep for one exam at the end of the term where the student has an opportunity to demonstrate mastery of the course's subject matter. They ca…

I don't disagree with you that a reasonable way to cope with the current problems is to ensure everything that "counts" is done in a controlled environment, but pedagogy and its goals are vast. There are things you learn from spending several days structuring a 20-page argument that you will not learn (and cannot assess) from oral examination or a 5-paragraph essay written in a blue book.

But there's no reason to expect that work to be graded. It should be a learning exercise which trains skills later tested under exam conditions.

Re: Training students to prove they're not robots is pushing them to use more AI

#88
post #56

Tangent: I've noticed I write a lot different because of combative online arguments. I have a problem. So much of my communication is directed to people who don't want to hear me or understand me. So I've become very punchy and repetitive, trying to hammer home ideas that people are either unable or unwilling to understand. I need to find ways to talk to people who want to hear and understand me. It's hard to find ot…

One of the worst habits distinctive to online discussion-board writing (especially the sorts of places with lots and lots of people and where it's fairly hard to get permanently kicked out—like here) is too much hedging and over-specifying to try to head off shitposting by bad or bad-faith readers. It's all over forum posts, and it's poor writing, but without moderation that slaps down responses based on plain mis-re…

Despite being a different kind of writing, there are some interesting parallels with the article in what you wrote here

Re: Training students to prove they're not robots is pushing them to use more AI

#89

Perhaps we should not grade students on weekly, or other occasional, writing during the term or semester. How about going back to the old system where, apart from experimental lab work, nothing is graded until the end of the term? All weekly assignments should just be considered prep for one exam at the end of the term where the student has an opportunity to demonstrate mastery of the course's subject matter. They ca…

Why a single test at the end of the semester? Why not allow the student to demonstrate mastery at anytime during the semester when they are ready? Then they can move on to the next objective, or, if they fall short, continue to study until they meet the objectives.

Of course, creating good exams is difficult, but you have to do that either way.

Re: Training students to prove they're not robots is pushing them to use more AI

#90
nobody's asking who profits from false positives. these AI detection vendors have a direct financial incentive to flag aggressively. more flags = "more value" = more school contracts renewed. same playbook as selling antivirus to your grandma. sell fear, charge per seat, and make the false positive rate someone else's problem.
Post reply on HN