Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI shuts down its AI Classifier due to poor accuracy

decrypt.co

Post reply on HN
Print view View original

271–280 of 292 posts

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#271

Post by Grimblewald »

torginus wrote: post #261

There's an exceedingly simple way of doing this that's pretty much bullet proof: Just check the given text against the database of stored generations (which they no doubt keep) and you'll have a pretty much perfect result. Logistically, searching untold terabytes of text might be challenging but to say there's fundamental difficulties is just not accurate imo.

that's the problem - no you won't. The problem is you've bought too much into the stochastic parrot view of LLM's to a point where you are viewing it as a fancy content storage/retrieval system.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#272

Post by horsawlarway »

TulliusCicero wrote: post #212
wmeredith wrote: post #164

Earlier quoted context omitted.

It seems like that's nearing the sweet spot of fraud prevention, where committing the act of fraud is as much work as doing the real thing.

Doesn't sound like it to me. Researching a topic can be a lot of effort, while typing is easy, even with occasional rephrasing. Hell, even with constant rephrasing it's not very hard.

Having a student sit there and type out, word for word, a decent essay on the subject is probably fairly effective education for a LOT of subjects.

In the same vein that letting students write calculator programs to do the quadratic formula for them during a test is actually a pretty good way to get them to learn the quadratic formula.

It's not an exact equivalent to the intent of an essay today - from an education perspective - but it's not a complete miss either.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#273

Post by PawgerZ »

josephg wrote: post #256
leeoniya wrote: post #248

Earlier quoted context omitted.

thats my take on all this LLM hype: they're great at creative work where accuracy is not important, and assisting in technical work where the user is already able to discern an answer that is accurate from one that is slightly to fully bullshit. even if an LLM can give an amazing and correct answer 7/10 times, it still takes a human expert to cherrypick which 7 answers are amazing and which are just convincingly-asse…

Yeah - but there’s a lot of domains where that is fine. I’m in France at the moment and I’ve been using chatgpt as a tour guide. I’m sure some of what it says is wrong, but I don’t honestly care. It’s also fantastic for teaching. I’ve been doing some self study lately and it’s been helping me to figure out what I should spend time learning and help direct my self study sessions toward what will help. I listened to an…

Can you explain how you use it for teaching/study? I also have used it to learn but with mixed results. Recently, I've been asking it to write me outlines so I can have somewhat of a learning plan.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#274

Post by ShamelessC »

anshumankmr wrote: post #255

I read a post on LinkedIn by Timnit Gebru, where she shared an anonymous post by a student who said that their paper was being rejected due to having seemingly high AI written content. Their paper was evaluated by Turnitin who claim to have a built an AI detector. The student mentioned it was putting their career at risk, and they hadn't actually taken the help of any AI and was actually a 4.0 student throughout thei…

> how can the likes of Turnitin claim to be an authority for AI writing detection

Pretty easy - they lie to people.

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#275

Post by kobalsky »

albert_e wrote: post #240

Many comments here seem to suggest that practically it is going to be impossible to classify text as Human generated versus AI generated -- given the many different ways in which such attempts can be foiled in a never ending game of cat-and-mouse. If we accept this ... The challenge I am foreseeing is this: We are only at the very beginning of the AI revolution -- and if LLMs need to get more sophisticated and powerf…

curation? I mean of the content is considered good, does it matter if it was produced by an LLM?

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#276

Post by ShamelessC »

thepaulthomson wrote: post #241

Wow, OpenAI pulling the plug on its AI Classifier tool really shows how tough it is to spot the difference between human and AI-generated text. It's a bummer that it didn't work out as planned, but hey, that's how we learn, right?

No disrespect, but...is this comment AI generated?

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#277

Post by josephg »

PawgerZ wrote: post #273
josephg wrote: post #256

Earlier quoted context omitted.

Yeah - but there’s a lot of domains where that is fine. I’m in France at the moment and I’ve been using chatgpt as a tour guide. I’m sure some of what it says is wrong, but I don’t honestly care. It’s also fantastic for teaching. I’ve been doing some self study lately and it’s been helping me to figure out what I should spend time learning and help direct my self study sessions toward what will help. I listened to an…

Can you explain how you use it for teaching/study? I also have used it to learn but with mixed results. Recently, I've been asking it to write me outlines so I can have somewhat of a learning plan.

I'm learning AI at the moment. I gave ChatGPT the following prompt:

> Write a training plan for a series of lessons to teach someone modern deep learning. The training plan should last for approximately 3 months of lessons.

> The lesson plan is for a single student with a strong background in programming (systems programming, algorithms and web). But the student has little knowledge of python. And university level mathematics knowledge but relatively weak skills in linear algebra, probability and statistics.

> By the end of the training process, the student should know modern deep learning methods and techniques and be able to modify, implement and deploy AI based systems.

> Think through your answer. Start by listing out learning objectives, then write a teaching plan to meet those learning objectives.

The response from chatgpt was super long! It gave me recommendations for what to study each week for the next 3 months. I've started going through the material it recommended. For the first 2 weeks, my goal is to learn the basics of python, and learn some linear algebra, and probability and statistics. Then its just a case of finding appropriate material online. I'm watching a lecture series on youtube teaching matrix mathematics now.

[1] https://chat.openai.com/share/d6966012-0d96-4511-b96e-086b80...

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#279

Post by chinchilla2020 »

josephg wrote: post #277
PawgerZ wrote: post #273

Earlier quoted context omitted.

Can you explain how you use it for teaching/study? I also have used it to learn but with mixed results. Recently, I've been asking it to write me outlines so I can have somewhat of a learning plan.

I'm learning AI at the moment. I gave ChatGPT the following prompt: > Write a training plan for a series of lessons to teach someone modern deep learning. The training plan should last for approximately 3 months of lessons. > The lesson plan is for a single student with a strong background in programming (systems programming, algorithms and web). But the student has little knowledge of python. And university level ma…

Most of those topics require months to learn. Is it feeding you a small number of lessons each week?

Re: OpenAI shuts down its AI Classifier due to poor accuracy

#280

Post by lopolo333 »

deadbeeves wrote: post #231
jdshaffer wrote: post #217

Earlier quoted context omitted.

Well, I teach English as a second language in a non-English speaking country. I often used short essays and diary-writing for homework. The students have had lots of English input over the years, but not much experience with output. So, writing assignments work out very well for them. Alas, with ChatGPT on the rise here, they no longer have to write it themselves. The upshot of which is, the useful writing assignment…

Is your objective that your students learn, or to police them? In the latter case, yes, you have those two options you mentioned. In the former case, you can just continue as you were. Some will cheat and some will not. The ones who do are only cheating themselves.

Teens are very propense to succumb under peer pressure. Some would be honest and do the work themselves, but if a significant subgroup is using GPT there's a bigger chance that this group influences some of them to do so.
Post reply on HN