Live data from Hacker News

The false positive rate of AI detectors and its effect on freelance writers

authory.com

81–90 of 171 posts

Re: The false positive rate of AI detectors and its effect on freelance writers

#81
post #4

Alternative reading: company determines that paid contractor is producing content that they can’t distinguish from a borderline free LLM, and decides to use it instead. Isn’t it likely that AI (not the detector) is the real threat to freelance writers’ livelihoods?

Pretty uncharitable way of reading it.

Re: The false positive rate of AI detectors and its effect on freelance writers

#82

I want to see an "AI detector" that just marks everything as being not AI generated. Then, whenever someone is accused of using an AI by some nameless website, they can present their own website that shows they didn't use AI. Professor: "The website said you used an AI." Student: "Well, here's a website claiming I didn't use an AI." Professor: "I don't know if I believe that website, let's look into the merits of how…

Students are in a weird case. Currently instructors aren’t experts in AI tools because, well, they didn’t exist 10 years ago when even the young professors were learning how to do things. The best that can be done at the moment is to teach the old way. The current students are the ones who will need to make the AI based workflows. But obviating intro assignments by having the AI do them doesn’t benefit anybody.

If students what to deprive themselves of the opportunity to learn then that's their perogative.

Re: The false positive rate of AI detectors and its effect on freelance writers

#84
Pretty sure we are going to see a rise in the use of Oral Exams.

The teachers that don't want to use them will continue to churn out students that score high and don't know how to articulate a damn thing. Which may have been the status quo anyway.

Edit: I didn't like my original post

Re: The false positive rate of AI detectors and its effect on freelance writers

#85

I want to see an "AI detector" that just marks everything as being not AI generated. Then, whenever someone is accused of using an AI by some nameless website, they can present their own website that shows they didn't use AI. Professor: "The website said you used an AI." Student: "Well, here's a website claiming I didn't use an AI." Professor: "I don't know if I believe that website, let's look into the merits of how…

Surely this is trivial to refute? The professor just needs to have his own text that he generated using AI. When your website says it's not AI... then it's curtains I guess?

By the time a professor is this engaged and thinking this logically, the student has already won.

Re: The false positive rate of AI detectors and its effect on freelance writers

#87

I want to see an "AI detector" that just marks everything as being not AI generated. Then, whenever someone is accused of using an AI by some nameless website, they can present their own website that shows they didn't use AI. Professor: "The website said you used an AI." Student: "Well, here's a website claiming I didn't use an AI." Professor: "I don't know if I believe that website, let's look into the merits of how…

Since the AI detectors are snake oil, just run a bunch of the professor's articles through them until you get one flagged as AI generated and present those results for a rapid reassessment.

Re: The false positive rate of AI detectors and its effect on freelance writers

#88
post #84

Pretty sure we are going to see a rise in the use of Oral Exams. The teachers that don't want to use them will continue to churn out students that score high and don't know how to articulate a damn thing. Which may have been the status quo anyway. Edit: I didn't like my original post

I was one of the students who could nail the exams and assignments I turned in, but then I BOMBED oral exams.

Because of crippling anxiety.

So how do you account for that? Or autism? Or any other sort of neurological disability?

Re: The false positive rate of AI detectors and its effect on freelance writers

#89

By this point I'd just be recording myself typing it if in case this ever came up. Like what other defense is there? "No I didn't" prove it "I can't"

The really funny part is that training an AI or even just setting up a monte carlo style generator based off of your existing typing cadence would allow you to give a body of text to the algorithm and then have it produce a video that looks suspiciously like a person wrote it. Write it yourself but then only fake a video if you happen to need evidence.

What are the chances that anyone who has a AI text detection tool ALSO has a AI generates text at human like speed with edits detector.

Re: The false positive rate of AI detectors and its effect on freelance writers

#90

Earlier quoted context omitted.

> pick up a new career It sounds so easy put like that. Hmm.. what do I have to do today? Get some mustard at the grocery store, pick up a new career, drop the dog off at the vet.

That something can be plainly put doesn’t imply that it’s easy. We can have sympathy for the guy and want to support him while also recognizing the practicality that he’s been walking down a dead end road and needs to change course. Even without LLM’s, fluff writing is ripe for outsourcing to second-language writers in cheaper markets and gets more efficient as those markets optimize for it. It can be a job for a whi…

LLM-created writing isn't obviously worse than the typical pennies-a-word stuff churned out for content farms in a lot of cases--especially if the person driving the LLM has some domain knowledge about the topic and can catch any obvious errors.

Similarly, SEO often demands some graphic/any graphic to go with a story/blog/etc. and GenerativeAI is perfectly able to provide that--though lower-end royalty-free stock is pretty cheap in any case.

Post reply on HN