Live data from Hacker News

Do AI detectors work? Students face false cheating accusations

bloomberg.com

181–190 of 1001 posts

Re: Do AI detectors work? Students face false cheating accusations

#181
post #116

Earlier quoted context omitted.

They are well compensated. https://www.swissinfo.ch/eng/society/swiss-salaries-teachers...

That article, after a very pushy illegal gdpr consent banner, says pay is stagnant and hours long

Hours are long for everyone in Switzerland.

110k in Switzerland is a good pay today. The article is from 2017.

Re: Do AI detectors work? Students face false cheating accusations

#182
post #18

My daughter was accused of turning in an essay written by AI because the school software at her online school said so. Her mom watched her write the essay. I thought it was common knowledge that it was impossible to tell whether text was generated by AI. Evidently, the software vendors are either ignorant or are lying, and school administrators are believing them.

Imagine how little common knowledge there will be one or two generations down the road after people decide they no longer need general thinking skills, just as they've already decided calculators free them from having to care about arithmetic skills.

Maybe not having to learn to write "properly" means more bandwidth for more general thinking?

At least not having to care about arithmetic leaves more time to care about mathematics.

Re: Do AI detectors work? Students face false cheating accusations

#183

Rather than flagging it as AI why don’t we flag if it’s good or not? I work with people in their 30s That cannot write their way out of a hat. Who cares if the work is AI assisted or not. Most AI writing is super dry, formulaic and bad. The student doesn’t recognize this the give them a poor mark for having terrible style.

> Most AI writing is super dry, formulaic and bad.

LLM can generate text that is as entertaining and whimsical as its training dataset gets with no effort on your side

Re: Do AI detectors work? Students face false cheating accusations

#184
The part that annoys me is that students apparently have no right to be told why the AI flagged their work. For any process where an computer is allowed to judge people, where should be a rule in place that demands that the algorithm be able explains EXACTLY why it flagged this person.

Now this would effectively kill off the current AI powered solution, because they have no way of explaining, or even understanding, why a paper may be plagiarized or not, but I'm okay with that.

Re: Do AI detectors work? Students face false cheating accusations

#185
post #22

My kids’ school added a new weapons scanner as kids walk in the door. It’s powered by “AI.” They trust the AI quite a bit. However, the AI identifies the school issued Lenovo laptops as weapons. So every kid was flagged. Rather than stopping using such a stupid tool, they just have the kids remove their laptops before going through the scanner. I expect not smart enough people are buying “AI” products and trusting th…

Do you think it stupid to scan kids for weapons, or stupid to think that a metal detector will find weapons?

It's stupid to bring yourself into a position where scanning kids for weapons is necessary. In this case we're already past that, so the stupidity is that the device isn't updated to not identify laptops as weapons. If that's not possible, then device is a mislabeled laptop detector.

Re: Do AI detectors work? Students face false cheating accusations

#186
post #142

Earlier quoted context omitted.

Have you tried reading AI-generated code? Most of the time it's painfully obvious, so long as the snippet isn't short and trivial.

To me it is not obvious. I work with junior level devs and have seen a lot of non-AI junior level code.

You mean, you work with devs who are using AI to generate their code.

Re: Do AI detectors work? Students face false cheating accusations

#187

For a human who deals with student work or reads job applications spotting AI generated work quickly becomes trivially easy. Text seems to use the same general framework (although words are swapped around) also we see what I call 'word of the week' where whichever 'AI' engine seems to get hung up on a particular English word which is often an unusual one and uses it at every opportunity. It isn't long before you real…

the students are too lazy and dumb to do their own thinking and resort to ai. the teachers are also too lazy and dumb to assess the students' work and resort to ai. ain't it funny?

To be fair, using humans to spend time sifting through AI slop determining what is and isn't AI generated is not a fight that the humans are going to win.

Re: Do AI detectors work? Students face false cheating accusations

#188

For a human who deals with student work or reads job applications spotting AI generated work quickly becomes trivially easy. Text seems to use the same general framework (although words are swapped around) also we see what I call 'word of the week' where whichever 'AI' engine seems to get hung up on a particular English word which is often an unusual one and uses it at every opportunity. It isn't long before you real…

My other half is a non-native English speaker. She's fluent but and since ChatGPT came out she's found it very helpful having somewhere to paste a paragraph and get a better version back rather than asking me to rewrite things. That said, she'll often message me with some text and I've got a 100% hit rate for guessing if she's put it through AI first. Once you're used to how they structure sentences it's very easy to spot. I guess the hardest part is being able to prove it if you're in a position of authority like a teacher.

Re: Do AI detectors work? Students face false cheating accusations

#189
post #86

Earlier quoted context omitted.

I could see a student hollowing out the laptop and hiding a weapon inside to sneak it in if thats the case

That is beyond silly. Unless students go naked they can have a weapon in a pocket.

don't forget...natures pocket.

Re: Do AI detectors work? Students face false cheating accusations

#190

For a human who deals with student work or reads job applications spotting AI generated work quickly becomes trivially easy. Text seems to use the same general framework (although words are swapped around) also we see what I call 'word of the week' where whichever 'AI' engine seems to get hung up on a particular English word which is often an unusual one and uses it at every opportunity. It isn't long before you real…

> For a human who deals with student work or reads job applications spotting AI generated work quickly becomes trivially easy

So far. Unless there is a new generation of teachers who are no longer able to learn on non-AI generated texts because all they get is grammatically corrected by AI for example...

Even I am using Grammarly here (as being non-native), but I usually tend to ignore it, because it removes all my "spoken" style, or at least what I think is a "spoken style"

Post reply on HN