Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Do AI detectors work? Students face false cheating accusations

bloomberg.com

Post reply on HN
Print view View original

71–80 of 1001 posts

Re: Do AI detectors work? Students face false cheating accusations

#71

Post by Daz1 »

jmugan wrote: post #18

My daughter was accused of turning in an essay written by AI because the school software at her online school said so. Her mom watched her write the essay. I thought it was common knowledge that it was impossible to tell whether text was generated by AI. Evidently, the software vendors are either ignorant or are lying, and school administrators are believing them.

>I thought it was common knowledge that it was impossible to tell whether text was generated by AI.

Anyone who's been around AI generated content for more than five minutes can tell you what's legitimate and what isn't.

For example this: https://www.maersk.com/logistics-explained/transportation-an... is obviously an AI article.

Re: Do AI detectors work? Students face false cheating accusations

#72

Post by borski »

ameister14 wrote: post #66
borski wrote: post #28

Earlier quoted context omitted.

My wife is dyslexic; grammarly makes suggestions, but it doesn’t fix it for her. Perhaps that’s a feature she doesn’t have turned on? She loves it. It doesn’t cause her to be any less attentive to her writing; it just makes it possible to write.

>It doesn’t cause her to be any less attentive to her writing; it just makes it possible to write. I was not really referring to accommodations under the ADA. For people that do not require accommodations, the use of them is unfair to their classmates and can be detrimental to their ability to perform without them in the future, as there is no requirement to have the accommodations available to them. This is not the…

Fair, I can see why it looks like I confused them. I was solely using her an example; my point is that grammarly hasn’t caused her knowledge of grammar to get worse, only better. It has taught her over time.

Re: Do AI detectors work? Students face false cheating accusations

#73

Post by bryanrasmussen »

Daz1 wrote: post #71
jmugan wrote: post #18

My daughter was accused of turning in an essay written by AI because the school software at her online school said so. Her mom watched her write the essay. I thought it was common knowledge that it was impossible to tell whether text was generated by AI. Evidently, the software vendors are either ignorant or are lying, and school administrators are believing them.

>I thought it was common knowledge that it was impossible to tell whether text was generated by AI. Anyone who's been around AI generated content for more than five minutes can tell you what's legitimate and what isn't. For example this: https://www.maersk.com/logistics-explained/transportation-an... is obviously an AI article.

>Anyone who's been around AI generated content for more than five minutes can tell you what's legitimate and what isn't.

to some degree of accuracy.

Re: Do AI detectors work? Students face false cheating accusations

#74

Post by lionkor »

newZWhoDis wrote: post #53
jmugan wrote: post #18

My daughter was accused of turning in an essay written by AI because the school software at her online school said so. Her mom watched her write the essay. I thought it was common knowledge that it was impossible to tell whether text was generated by AI. Evidently, the software vendors are either ignorant or are lying, and school administrators are believing them.

The education system in the US is broadly staffed by the dumbest people from every walk of life. If they could make it elsewhere, they would. I don’t expect this to be a popular take here, and most replies will be NAXALT fallacies, but in aggregate it’s the truth. Sorry, your retired CEO physics teacher who you loved was not a representative sample.

In Germany, you have to do the equivalent of a master's degree (and then a bunch) to teach in normal public schools

Re: Do AI detectors work? Students face false cheating accusations

#75

Post by minitoar »

ipaddr wrote: post #6
mensetmanusman wrote: post #3

My daughter’s 7th grade work is 80% flagged as AI. She is a very good writer, it’s interesting to see how poorly this will go. Obviously we will go back to in class writing.

She should run it through ai to rewrite in a way so another ai doesn't detect it was written by ai.

Right, I thought this was just an arms race for tools that can generate output to fool other tools.

Re: Do AI detectors work? Students face false cheating accusations

#76

Post by tightbookkeeper »

prepend wrote: post #22

My kids’ school added a new weapons scanner as kids walk in the door. It’s powered by “AI.” They trust the AI quite a bit. However, the AI identifies the school issued Lenovo laptops as weapons. So every kid was flagged. Rather than stopping using such a stupid tool, they just have the kids remove their laptops before going through the scanner. I expect not smart enough people are buying “AI” products and trusting th…

And they trust them more than people.

Re: Do AI detectors work? Students face false cheating accusations

#78

Post by ec109685 »

stephenbez wrote: post #63

Are any students coming up with a process to prove their innocents when they get falsely accused? If I was still in school I would write my docs in a Google Doc which provides the edit history. I could potentially also record video of me typing the entire document as well or screen recording my screen.

That’s what the person in the article did:

“After her work was flagged, Olmsted says she became obsessive about avoiding another accusation. She screen-recorded herself on her laptop doing writing assignments. She worked in Google Docs to track her changes and create a digital paper trail. She even tried to tweak her vocabulary and syntax. “I am very nervous that I would get this far and run into another AI accusation,” says Olmsted, who is on target to graduate in the spring. “I have so much to lose.”

Re: Do AI detectors work? Students face false cheating accusations

#79

Post by ec109685 »

kelseyfrog wrote: post #54

The problem is that professors want a test with high sensitivity and students want a test with high specificity and only one of them is in charge of choosing and administering the test. It's a moral hazard.

Do professors really not want high specificity too? Why would they want to falsely accuse anyone?

Re: Do AI detectors work? Students face false cheating accusations

#80

Post by tdeck »

mensetmanusman wrote: post #3

My daughter’s 7th grade work is 80% flagged as AI. She is a very good writer, it’s interesting to see how poorly this will go. Obviously we will go back to in class writing.

> Obviously we will go back to in class writing.

That would be a pretty sad outcome. In my high school we did both in-class essays and homework essays. The former were always more poorly developed and more more poorly written. IMO students still deserve practice doing something that takes more than 45 minutes.

Post reply on HN