Live data from Hacker News

Do AI detectors work? Students face false cheating accusations

bloomberg.com

121–130 of 1001 posts

Re: Do AI detectors work? Students face false cheating accusations

#121
post #6

Earlier quoted context omitted.

She should run it through ai to rewrite in a way so another ai doesn't detect it was written by ai.

I've heard some students are concerned that any text submitted to an AI-detector is automatically added to training sets and therefore will eventually will be flagged as AI.

Well, that is how AI works.

Re: Do AI detectors work? Students face false cheating accusations

#122
post #22

My kids’ school added a new weapons scanner as kids walk in the door. It’s powered by “AI.” They trust the AI quite a bit. However, the AI identifies the school issued Lenovo laptops as weapons. So every kid was flagged. Rather than stopping using such a stupid tool, they just have the kids remove their laptops before going through the scanner. I expect not smart enough people are buying “AI” products and trusting th…

Reading this comment, it sounds to me that you live in a dystopian nightmare.

Re: Do AI detectors work? Students face false cheating accusations

#123
post #58

That's kinda nuts how adult people learned to trust some random algorithms in a year or two. They don't know how it works, they cannot explain it, they don't care, it just works. It's magic. If it says you cheated, you cheated. You cannot do anything about it. I want to emphasize, that this isn't really about trusting magic, it's about people nonchalantly doing ridiculous stuff nowdays and that they aren't held accou…

It is not a bug, it is a feature.

That's how you can mold society as you like at your level: this student's older sibling was a menace? Let's fuck them over, being shitty must run in the family. You don't like the race / gender / sexuality of a student? Now "chatGPT" can give you an easy way to make their school life harder.

Re: Do AI detectors work? Students face false cheating accusations

#124
I don't know what these 'students' are doing, but it's not very hard to prompt a system into not using the easily detectable 'ai generated' language at all. Also adding in some spelling errors and uncapping some words (like ai above here) makes it more realistic. But just adding an example of how you write and telling it to keep your vocabulary and writing some python to post process it makes it impossible to detect ai for humans or ai detectors. You can also ask multiple ais to rewrite it. Getting an nsfw one to add in some 'aggressive' contrary position also helps as gpt/claude would not do that unless jailbroken (which is whack-a-mole).

Re: Do AI detectors work? Students face false cheating accusations

#125

Are any students coming up with a process to prove their innocents when they get falsely accused? If I was still in school I would write my docs in a Google Doc which provides the edit history. I could potentially also record video of me typing the entire document as well or screen recording my screen.

[deleted]

Re: Do AI detectors work? Students face false cheating accusations

#126

For a human who deals with student work or reads job applications spotting AI generated work quickly becomes trivially easy. Text seems to use the same general framework (although words are swapped around) also we see what I call 'word of the week' where whichever 'AI' engine seems to get hung up on a particular English word which is often an unusual one and uses it at every opportunity. It isn't long before you real…

How are you verifying you're correct? How do you know you're not finding false positives?

Re: Do AI detectors work? Students face false cheating accusations

#127
post #22

My kids’ school added a new weapons scanner as kids walk in the door. It’s powered by “AI.” They trust the AI quite a bit. However, the AI identifies the school issued Lenovo laptops as weapons. So every kid was flagged. Rather than stopping using such a stupid tool, they just have the kids remove their laptops before going through the scanner. I expect not smart enough people are buying “AI” products and trusting th…

Do you think it stupid to scan kids for weapons, or stupid to think that a metal detector will find weapons?

I think it's stupid to have a country where guns are legal.

Re: Do AI detectors work? Students face false cheating accusations

#128

Ycombinator has funded at least one company in this space: https://www.ycombinator.com/companies/nuanced-inc It seems like a long term loosing proposition.

> It seems like a long term loosing proposition.

Sounds like a good candidate to IPO early

Re: Do AI detectors work? Students face false cheating accusations

#129

For a human who deals with student work or reads job applications spotting AI generated work quickly becomes trivially easy. Text seems to use the same general framework (although words are swapped around) also we see what I call 'word of the week' where whichever 'AI' engine seems to get hung up on a particular English word which is often an unusual one and uses it at every opportunity. It isn't long before you real…

> For a human who deals with student work or reads job applications spotting AI generated work quickly becomes trivially easy. Text seems to use the same general framework (although words are swapped around) also we see what I call 'word of the week'

Easy to catch people that aren't trying in the slightest not to get caught, right? I could instead feed a corpus of my own writing to ChatGPT and ask it to write in my style.

Re: Do AI detectors work? Students face false cheating accusations

#130
post #61

Earlier quoted context omitted.

It's not just USA, it's pretty much universal, as much as I've seen it. People like to pretend like it's some sort of noble profession, but I vividly remember having a conversation with recently graduated ex-classmates, where one of them was complaining that she failed to pass at every department she applied to, so she has no other choice than to apply for department of education (I guess? I don't know what is the na…

I went to public schools in middle class neighborhoods in California from the late sixties to the early eighties. My teachers were largely excellent. I think that was due to cultural and economic factors - teaching was considered a profession for idealistic folks to go into at the time and the spread between rich and poor was less dramatic in the 50s and 60s (when my teachers were deciding their professions). So the…

It was the tail end of when smart women had few intellectually stimulating options and teacher was a decent choice.
Post reply on HN