Live data from Hacker News

The false positive rate of AI detectors and its effect on freelance writers

authory.com

11–20 of 171 posts

Re: The false positive rate of AI detectors and its effect on freelance writers

#11
post #2

These AI detectors have all the validity of phrenology. You can enter some of your own writing (I did) to easily see for yourself. The text I entered had been online, and still is online, longer than AI writers have been around - but that doesn't seem to feed into their logic.

The whole idea of an "AI detector" is stupid. If it ever does work, it will only work until someone trains a model against it.

Re: The false positive rate of AI detectors and its effect on freelance writers

#12
post #8

Daydream: The names of companies firing people on the basis of "AI detector" results are reported to the IRS...which then uses an "AI detector" to discover whether they've been cheating on their taxes.

Interesting aside: I've been fascinated about how financial fraud can and has been detected by identifying numerical patterns that are fleetingly unlikely. Kind of like the, "fake data is actually pretty easy to detect" I've seen in academia.

Re: The false positive rate of AI detectors and its effect on freelance writers

#13

Legal question: if a writer loses a job due to a false accusal of using AI, would they win a damages lawsuit against the AI detector service if they can prove that AI content detection is knowingly imprecise? That's why those types of services (including OpenAI's initial AI detector) often have huge legal disclaimers saying not to take it as 100% accurate.

No. But you could sue your employer.

Re: The false positive rate of AI detectors and its effect on freelance writers

#14
Why even care? If the article is well written and well researched and it's seemingly impossible for readers to tell the difference, what's the problem with using AI to improve it? Did people care when computers were used instead of typewriters? When spell checkers became popular?

Re: The false positive rate of AI detectors and its effect on freelance writers

#15
post #5

Legal question: if a writer loses a job due to a false accusal of using AI, would they win a damages lawsuit against the AI detector service if they can prove that AI content detection is knowingly imprecise? That's why those types of services (including OpenAI's initial AI detector) often have huge legal disclaimers saying not to take it as 100% accurate.

Kinda like asking for the source code to the breathalyzer? https://arstechnica.com/tech-policy/2007/08/im-not-drunk-off...

I would kill to watch some smartass show up to court with their own ridiculous-looking black box "breathalyzer" and draw the parallel to "why do you magically trust theirs and not ours?"

Re: The false positive rate of AI detectors and its effect on freelance writers

#16

I want to see an "AI detector" that just marks everything as being not AI generated. Then, whenever someone is accused of using an AI by some nameless website, they can present their own website that shows they didn't use AI. Professor: "The website said you used an AI." Student: "Well, here's a website claiming I didn't use an AI." Professor: "I don't know if I believe that website, let's look into the merits of how…

What you want is a sort of AI Witches' Scales?

https://en.wikipedia.org/wiki/Oudewater#Buildings

Re: The false positive rate of AI detectors and its effect on freelance writers

#17
post #2

These AI detectors have all the validity of phrenology. You can enter some of your own writing (I did) to easily see for yourself. The text I entered had been online, and still is online, longer than AI writers have been around - but that doesn't seem to feed into their logic.

A good example: Put bits of the US Constitution in some AI detectors and they'll tell you it was AI generated. https://arstechnica.com/information-technology/2023/07/why-a...

Re: The false positive rate of AI detectors and its effect on freelance writers

#18

If your work looks so much like generated content that it’s flagging detectors, then it’s also probably the work doomed to be replaced by generated content soon enough (if not already). I don’t think current content generators will destroy many professions any time soon, but a lot of high-volume/low-value work is going to get consumed by them. This seems like an example of that work. Hopefully, this guy didn’t expect…

> pick up a new career

It sounds so easy put like that. Hmm.. what do I have to do today? Get some mustard at the grocery store, pick up a new career, drop the dog off at the vet.

Re: The false positive rate of AI detectors and its effect on freelance writers

#19
post #14

Why even care? If the article is well written and well researched and it's seemingly impossible for readers to tell the difference, what's the problem with using AI to improve it? Did people care when computers were used instead of typewriters? When spell checkers became popular?

It said in the article that they were afraid that google would downrank them for having AI generated content.

Re: The false positive rate of AI detectors and its effect on freelance writers

#20
post #14

Why even care? If the article is well written and well researched and it's seemingly impossible for readers to tell the difference, what's the problem with using AI to improve it? Did people care when computers were used instead of typewriters? When spell checkers became popular?

Mission Accomplished?

https://xkcd.com/810/

Post reply on HN