Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Detect ChatGPT Generated Content

gptzero.me

Post reply on HN
Print view View original

71–80 of 109 posts

Re: Detect ChatGPT Generated Content

#71

Post by programmarchy »

bhickey wrote: post #69
krisoft wrote: post #59

This is useless. I have tried it with 4 different samples and it made mistakes with each. - it thinks AI wrote parts of my handwritten texts - King James Genesis 29 is appearantely fully AI written - a wall of text copied straight from chatgpt? Only partially AI written. - second chapter of Harry Potter? AI written parts In fact I could not find a sample yet which was not AI written at least partially according to th…

Agreed. This is useless. I asked GPT-3 to write a HN post decrying GPTZero: > GPTZero is absolute trash! It can't even detect plagarism correctly. It's a complete joke and waste of time! Don't bother with it! You'd be better off just manually checking for plagiarism. It's so unreliable it's not even worth mentioning. Just save yourself the time and money and don't bother with GPTZero. Worst AI tool ever! GPTZero clas…

Agree with you, but! In a Tom and Jerry episode, Tom Cat would be GPTZero and Jerry Mouse would be GPT3 ;)

Re: Detect ChatGPT Generated Content

#73

Post by anyonecancode »

spoork wrote: post #26

The problem with such things is that you would need 100% accuracy in most cases for it to be useful. For example many schools and universities fear that students use ChatGPT for homework. If such a plagiarism checker has false positive results in just a small percentage of cases, the consequences for honest students would be too severe to actually act on the results of the check. But perfect accuracy can never be rea…

At the university level, the problem of cheating is more a problem with our idea of a university. In an ideal world, you go to a university to learn. If someone wants to cheat, ultimately they're just cheating themselves (and, if at a private university or even most public universities, throwing a lot of money away). "Cheating" isn't really the university's problem in that view.

Ofc, in reality universities aren't (or not only, and in most cases not primarily) about learning, but about credentialism. Employers and various social systems outsource to universities the role of verifying that people actually know something, or are the "right" sort of person, or other signals.

I don't know how one goes about fixing that, or if it's even possible, but I'd like to see more acknowledgement of it. Fixing "cheating" feels like the equivalent of looking to clever programming to fix product bugs.

Re: Detect ChatGPT Generated Content

#74

Post by dvngnt_ »

krisoft wrote: post #59

This is useless. I have tried it with 4 different samples and it made mistakes with each. - it thinks AI wrote parts of my handwritten texts - King James Genesis 29 is appearantely fully AI written - a wall of text copied straight from chatgpt? Only partially AI written. - second chapter of Harry Potter? AI written parts In fact I could not find a sample yet which was not AI written at least partially according to th…

how mad would you be if someone accused you of using AI to write something but you actually did write it

Re: Detect ChatGPT Generated Content

#76

Post by lupire »

anyonecancode wrote: post #73
spoork wrote: post #26

The problem with such things is that you would need 100% accuracy in most cases for it to be useful. For example many schools and universities fear that students use ChatGPT for homework. If such a plagiarism checker has false positive results in just a small percentage of cases, the consequences for honest students would be too severe to actually act on the results of the check. But perfect accuracy can never be rea…

At the university level, the problem of cheating is more a problem with our idea of a university. In an ideal world, you go to a university to learn. If someone wants to cheat, ultimately they're just cheating themselves (and, if at a private university or even most public universities, throwing a lot of money away). "Cheating" isn't really the university's problem in that view. Ofc, in reality universities aren't (o…

Universities should stop issuing transcripts and diplomas that they refuse to guarantee. They are complicit in a fraud against employers.

Re: Detect ChatGPT Generated Content

#78

Post by lupire »

another-dave wrote: post #43
dogma1138 wrote: post #32

Earlier quoted context omitted.

That’s a very naïve outlook in reality like with every system the burden of proof would end up falling on the accused not the accuser…

What could that burden of proof look like? Not sure how a student could prove that the negative, apart from videotaping themselves writing the essay, or only being allowed type it on an airgapped machine owned by the university. Doesn't feel very feasible to implement.

Even before GPT, schools should require students to submit derailed outlines and notes of their work. For one, students need to learn these skills. For two, it helps protect against more plagiarism and cheating.

Re: Detect ChatGPT Generated Content

#79

Post by lupire »

avereveard wrote: post #46
Nanana909 wrote: post #39

Earlier quoted context omitted.

> The problem with such things is that you would need 100% accuracy in most cases for it to be useful. Why? If there is 75% confidence a students report was generated using ChatGPT, then that’s enough to sit down with the student and discuss the content in person and see if they actually know it. A tool such as this could help the teacher having to avoid doing this with every student, and also reinforce to students t…

This is not what is going to happen tho. Flagged content will not be accepted and the student failed for the class, or worse for the year. Expulsion is on the card as the war against generated content becomes bitter.

No university will expel a student without evidence. One tried and lost a $1.5M lawsuit.

https://people.com/human-interest/twins-defamation-lawsuit-m...

Re: Detect ChatGPT Generated Content

#80

Post by lupire »

drexlspivey wrote: post #66

I wonder if there is a way to watermark generated text, not by adding extra spaces or using invisible characters but by using grammar. Example naive rule “every 13th word MUST be a proposition”. Another more complex example “every 11th word is a checksum of the previous 10. You encode a few bits in every word i.e noun=1 verb=2 article=3 etc”

Trivial to break by making tiny changes.
Post reply on HN