Live data from Hacker News

OpenAI shuts down its AI Classifier due to poor accuracy

decrypt.co

281–290 of 292 posts

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#281

I'm glad that they did, although they should obviously done an announcement for it. The amount of people in the ecosystem who thinks it's even possible to detect if something is AI written or not when it's just a couple of sentences is staggering high. And somehow, people in power seems to put their faith in some of these tools that guarantee a certain amount of truthfulness when in reality it's impossible they could…

[dead]

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#283

Earlier quoted context omitted.

It's a bit suspicious to type an essay linearly from start to finish, though.

Is it? That's how I've always written them (and still do to this day). I write the first draft linearly from start to end, then go back and do my revising and editing.

Well, that's what I mean. The revisions and edits are what show that you wrote it, rather than copying from an AI line by line.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#284

Earlier quoted context omitted.

It's a bit suspicious to type an essay linearly from start to finish, though.

Will Google Docs provide that level of detail for revision history in a way that teachers can easily see that's it's likely AI-generated, and have high confidence in that?

Google Docs already does have this level of revision history.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#285
post #234

I'm glad that they did, although they should obviously done an announcement for it. The amount of people in the ecosystem who thinks it's even possible to detect if something is AI written or not when it's just a couple of sentences is staggering high. And somehow, people in power seems to put their faith in some of these tools that guarantee a certain amount of truthfulness when in reality it's impossible they could…

Dr. Michio Kaku claimed in an interview that it may eventually be possible for quantum computers to guarantee a certain level of truthfulness. I didn't really follow his argument and it seemed a little hand-wavey, but I can't prove that he's wrong. https://mkaku.org/home/tag/quantum-computing/

No need to prove! Any well calibrated bullshit detector should ring at 110dB when applied to claims mixing AI and quantum computing.

(that said, "may eventually be possible" is so weak a claim it's already meaningless. Quantum fluctuations may eventually turn me into a potato but it's not keeping me up at night)

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#286
post #148

Funny incentive problem, OpenAI obviously has an incentive to use it's best AI detection tool for adversarial training, with the result that it's detection tool will not be very good against chatGPT generated text because it is trained to defeat the detection tool.

If they wanted to disguise their content as coming from a human, they probably wouldn't keep saying "As an AI chatbot, I can't..."

I'm not saying that they are trying to disguise, I'm saying that their goal is natural language and a way you can distinguish chatGPT (aside from trivial things like "as an ai chatbot...") from human speech is most likely a way to improve chatGPT, because the goal is speaking like a human.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#287

Earlier quoted context omitted.

Doesn't sound like it to me. Researching a topic can be a lot of effort, while typing is easy, even with occasional rephrasing. Hell, even with constant rephrasing it's not very hard.

Having a student sit there and type out, word for word, a decent essay on the subject is probably fairly effective education for a LOT of subjects. In the same vein that letting students write calculator programs to do the quadratic formula for them during a test is actually a pretty good way to get them to learn the quadratic formula. It's not an exact equivalent to the intent of an essay today - from an education p…

It's better than nothing, sure, but nowhere close to as good as doing the research and formulating the ideas yourself.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#288
post #210

Rather than try to detect if pieces were generated by AI, why not just check if they're plagiarized off the outputs of a bunch of popular models? We already have traditional plagiarism analysis methods, we just need a corpus of most of the recent outputs from the most popular LLM services to check against. OpenAI, Google, Anthropic, and any other LLM-as-a-service companies could profitably sell access to these corpor…

One reason would be that LLM's don't tend to output verbatim pieces from their dataset (unless explicitly prompted to do so). This is made further complicated by the "temperature" setting allowing users to make output even more "creative" than its dataset. In OpenAI's case, its writing style usually comes from OpenAI's in-house dataset they used for RLHF. This is what gives it the ability to chat and respond with its…

You misunderstand me. I'm not talking about detecting when LLM's plagiarize humans, but when humans "plagiarize" (copy from without attributing) LLM's.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#289
post #175

Earlier quoted context omitted.

Just use a certificate chain. The manufacturer can provide each camera its own private key, signed by the manufacturer.

And when the sensor bus is hijacked to directly feed “trusted” data into the processor?

Then you can examine the specific camera and try to prove it has been tampered with. At least you know exactly which camera to look at.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#290

We shattered the turing test and now we want to put it back into pandora’s box because we don’t like the repercussions.

The techbros were so focued on whether or not they could that they accused anyone who asked if they should of being a luddite. And dinner that night was crow, and dessert was humble pie.
Post reply on HN