OpenAI shuts down its AI Classifier due to poor accuracy
1–10 of 292 posts
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#2Watermarking is a more tractable approach, but the cat is out of the bag.
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#3Watermarking is a more tractable approach, but the cat is out of the bag.
How would you go about watermarking AI written text?
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#4Re: OpenAI shuts down its AI Classifier due to poor accuracy
#5I'm glad that they did, although they should obviously done an announcement for it.
The amount of people in the ecosystem who thinks it's even possible to detect if something is AI written or not when it's just a couple of sentences is staggering high. And somehow, people in power seems to put their faith in some of these tools that guarantee a certain amount of truthfulness when in reality it's impossible they could guarantee that, and act on whatever these "AI vs Human-written" tool tell them to.
So hopefully this can serve as another example that it's simply not possible to detect if a bunch of characters were outputted by an LLM or not.
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#6[deleted]
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#7Earlier quoted context omitted.
How would you go about watermarking AI written text?
If it's generated by a SaaS, the service could sign all output with a public key.
This isn't a watermark though, the idea of a watermark is that it's inherently embedded in the data itself while not drastically changing the data
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#8I'm glad that they did, although they should obviously done an announcement for it. The amount of people in the ecosystem who thinks it's even possible to detect if something is AI written or not when it's just a couple of sentences is staggering high. And somehow, people in power seems to put their faith in some of these tools that guarantee a certain amount of truthfulness when in reality it's impossible they could…
There's also the post going around about how it can (and does) falsely flag human posts as AI output, particularly among some autistic people. About as useful as a polygraph, no?
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#9I'm glad that they did, although they should obviously done an announcement for it. The amount of people in the ecosystem who thinks it's even possible to detect if something is AI written or not when it's just a couple of sentences is staggering high. And somehow, people in power seems to put their faith in some of these tools that guarantee a certain amount of truthfulness when in reality it's impossible they could…
I see no reason why watermarking can’t be broken by having someone simply rephrase/redraw the output.
Yes, it’s still work, but it’s one step removed from having to think up of the original content.