Timing seems related to Altman launching Worldcoin (whose goal is to reliably differentiate between human and AI generated content).
https://www.reuters.com/technology/openais-sam-altman-launch...
OpenAI shuts down its AI Classifier due to poor accuracy
251–260 of 292 posts
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#252Earlier quoted context omitted.
The whole problem with AI is that it's able to copy some of the superficial indicators of quality content while feeding you lies. You cannot detect quality content without detecting truthfulness. Any heuristic you use in place of that can be copied without actually providing value (which is exactly what ChatGPT does now, when it gets things wrong)
That's the whole problem with LLMs in general. They are designed to be convincing, not necessarily accurate.
Lots of human discourse is that way too. The LLMs just learned it from us.
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#253Funny incentive problem, OpenAI obviously has an incentive to use it's best AI detection tool for adversarial training, with the result that it's detection tool will not be very good against chatGPT generated text because it is trained to defeat the detection tool.
If they wanted to disguise their content as coming from a human, they probably wouldn't keep saying "As an AI chatbot, I can't..."
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#254Earlier quoted context omitted.
The bottle of Aspirin goes through many hands between the manufacturer and you including sitting on an unattended shelf open to the public. The person making the pizza is working for the same company as the person delivering it, or may even be the same person. If you can't trust the pizza co delivery person then you probably shouldn't trust the person making it either.
Nowadays food delivery often goes through third party. Eg Uber eats, Foodora, Bolt, Grab, etc.
All the pizza places here have their own drivers still.
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#255I read a post on LinkedIn by Timnit Gebru, where she shared an anonymous post by a student who said that their paper was being rejected due to having seemingly high AI written content. Their paper was evaluated by Turnitin who claim to have a built an AI detector. The student mentioned it was putting their career at risk, and they hadn't actually taken the help of any AI and was actually a 4.0 student throughout their college career.
So assuming all that to be true, how can the likes of Turnitin claim to be an authority for AI writing detection. When I graduated a few years back, they used to offer plag check only.
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#256Earlier quoted context omitted.
That's the whole problem with LLMs in general. They are designed to be convincing, not necessarily accurate.
thats my take on all this LLM hype: they're great at creative work where accuracy is not important, and assisting in technical work where the user is already able to discern an answer that is accurate from one that is slightly to fully bullshit. even if an LLM can give an amazing and correct answer 7/10 times, it still takes a human expert to cherrypick which 7 answers are amazing and which are just convincingly-asse…
Yeah - but there’s a lot of domains where that is fine. I’m in France at the moment and I’ve been using chatgpt as a tour guide. I’m sure some of what it says is wrong, but I don’t honestly care. It’s also fantastic for teaching. I’ve been doing some self study lately and it’s been helping me to figure out what I should spend time learning and help direct my self study sessions toward what will help.
I listened to an interview with the StabilityAI founder / ceo the other day. He said we should think about LLMs like having a bunch of clever grad students / interns floating around that we can freely offload tasks to. They aren’t experts, but they’re very diligent. The question is, how can we effectively make use of them? People who succeed at this will be much more productive.
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#257Earlier quoted context omitted.
Even the idea of it is bad, ChatGPT is supposed to write indistinguishably from a human. The "detector" has extremely little information and the only somewhat reasonable criteria are things like style, where ChatGPT certainly has a particular, but by no means unique writing style. And as it gets better it will (by definition) be better at writing in more varied styles.
Yup. Moreover, the way to deal with AI in this context is not like the way to deal with plagiarism; do not try to detect AI and punish its use. Instead, assign it's use, and have the students critique the output and find the errors. This both builds skills in using a new technology, and more critically, builds the essential skills of vigilance for errors, and deeper understanding of the material — really helping stud…
Yes. Whether we like it or not, AI is with us to stay. A skill that AI can easily supplant is a skill that will become outdated very quickly. We're better off teaching students how to use AI effectively. Hopefully this will "future proof" them somewhat.
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#258As a joke I built a simple tool that swaps random words for their synonym and it did the trick in throwing off any distribution matching (came out with gibberish but still lol) https://www.gptminus1.com/
Fascinating. I tried zerogpt.com for testing a text I generated. Got 91% AI generated response. Used gptminus1.com and now zerogpt.com shows 0% AI. These detectors are garbage.
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#259I wonder if this entire "AI cheating" stuff will end up as calculators did when I was growing up. When I was a young child in school calculators were forbidden. You had to learn multiplications in your head. By the time I got to the final exam at the end of our "high school" equivalent we could use "dumb" calculators in math exams. Few years later graphing calculators became accepted in schools (sometimes even required).
It is important humans learn to express themselves in writing. The only way I think this will happen is if kids do their writing at school supervised.
Re: OpenAI shuts down its AI Classifier due to poor accuracy
#260No official announcement is lame
No lamer than dropping davinci.