Live data from Hacker News

AI Detectors Get It Wrong. Writers Are Being Fired Anyway

gizmodo.com

51–60 of 189 posts

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#51
post #14

Earlier quoted context omitted.

who will sue? the students with their dreams crushed? you?

If I were punished by my university for AI-assisted plagiarism I didn't commit, you're damn right I would sue. Imagine getting your life ruined because a neural network deemed it necessary. These things are wrong half the time, why does anyone trust them?

Your damn wrong that I wouldn't. I'd quit. I didn't go to university to go to court.

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#52
post #35

Earlier quoted context omitted.

Precisely, it's a tech that aims to write the most average, most likely human text.

Conceptually it seems like the average of all human texts would be distinct from any users because it would blend word choices and idioms across regions, where most of us are trained and reinforced in a particular region. Other statistical anomalies probably exist; it is certainly possible to tell that an average is from a larger or smaller sample size (if I tell you X fair coin flips came up heads 75% of the time, y…

[deleted]

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#53
Reminds this current slightly comedic (IMO) situation in my office: a few months ago developers were given access to GitHub's "Copilot Enterprise". Then, a month or so later, organisation also adopted another "AI" product checking pull requests for risks associated with "use of generative AI". And needless to say it does occasionally fail code written without any "generative AI"..

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#54
I don't get this, my writing is a lot better +AI than it ever was without it (not a native speaker). So, what's the problem? As long as there are no lies right? And the writers do take responsibility... So fire them for presenting lies, for mindlessly shipping hallucinations...

But why fire people that deliver on an assignment? Why care about how they do that?

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#55
post #46

In some cases an AI will make a weird word choice. So do a lot of humans. Sometimes AIs are needlessly wordy. Um...so are a lot of humans. Rinse and repeat. AI detectors are useless. The AIs are training on human writing, so they write fundamentally like humans. How is this not obvious?

Eh, eventually AI will write like humans but currently most of the time it's very much apparent what was written by AI. English is my second language so it's hard for me to pinpoint the exact reason why but I guess it's more about the tone and the actual content (a.k.a bullshit) rather than grammar / choice of words. Most of the time AI slop reads like a soulless corporate ad. Probably because most of the content the…

If the AI writing is good, you’re not going to know it’s written by AI and you’ll continue to think you "can always tell" while more and more of what you read isn’t written by humans.

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#56

In some cases an AI will make a weird word choice. So do a lot of humans. Sometimes AIs are needlessly wordy. Um...so are a lot of humans. Rinse and repeat. AI detectors are useless. The AIs are training on human writing, so they write fundamentally like humans. How is this not obvious?

Precisely, it's a tech that aims to write the most average, most likely human text.

That's not true at all. I could tell it to write like an unhinged maniac, someone who never uses contractions, or George Washington with a lisp.

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#57

Startup idea: online text editor that logs every keystroke and blockchains a hash of all logs every day. If you're accused of AI use, you can pull up the whole painstaking writing process and prove it's real.

There's no doubt you can write a wrapper for an LLM that can realistically mimic the same process. Cat-and-mouse isn't the answer, here.

Yes it is like those tools that make digital documents look like they were scanned.

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#58

In some cases an AI will make a weird word choice. So do a lot of humans. Sometimes AIs are needlessly wordy. Um...so are a lot of humans. Rinse and repeat. AI detectors are useless. The AIs are training on human writing, so they write fundamentally like humans. How is this not obvious?

Precisely, it's a tech that aims to write the most average, most likely human text.

LLMs don't average, they learn the distribution, from which you then sample (or the UI does it for you). Because of that, they don't write in a single style that's a blend of many human styles - they can write in any and all of the human styles they saw in training, as well as blend them to create styles entirely "out of distribution". And it's up to your prompt (and sampling parameters) which style will be used.

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#59

Reminds this current slightly comedic (IMO) situation in my office: a few months ago developers were given access to GitHub's "Copilot Enterprise". Then, a month or so later, organisation also adopted another "AI" product checking pull requests for risks associated with "use of generative AI". And needless to say it does occasionally fail code written without any "generative AI"..

Deeply ironic.

Re: AI Detectors Get It Wrong. Writers Are Being Fired Anyway

#60
Regardless of whether AI detectors work or not, I worry we're reaching a new unfortunate era. While alarmists were worrying about alignment or evil AIs, the true downside of LLMs is turning out to be... AI spam.

I've started seeing it everywhere: Q&A sites, forums, etc. In some places it's banned, but how do you reliably detect it? And what makes people post AI spam when there's no reward or money involved? What are they trying to achieve?

I've seen it in Q&A sites (sometimes tool specific, I won't name names) where supposed "experts" are simply pasting LLM-generated crap. All the tell-tale signs are there, often including the famed "I apologize for making this mistake. You're right the solution doesn't work because [reasons]". Note it's often not an official AI-generated answer (like, say, the Quora AI bot), but someone with a random human-sounding username posting it as the answer. There are no rep points or upvotes involved, so it boggles the mind... why do they do it?

I don't know if HN has some sort of AI filter, but I bet we'll start seeing it here too. Instead of talking to other humans, you'll discuss things with a bot.

I predict the arms race between AI spam and AI detectors will only get worse, and as a result it'll make the internet worse for everyone.

Post reply on HN