I tried this on my recent AI satire article. While ChatGPT detected my story as AI (because I wrote it like a machine), GPTZero gladly says it's human written. ChatGPT's response: https://imgur.com/a/u7iBBaX GPTZero's response: https://imgur.com/a/89icz2X To be clear, my story was ChatGPT-assisted. But I wonder why ChatGPT couldn't detect it correctly like GPTZero?
Detect ChatGPT Generated Content
31–40 of 109 posts
Re: Detect ChatGPT Generated Content
#32The problem with such things is that you would need 100% accuracy in most cases for it to be useful. For example many schools and universities fear that students use ChatGPT for homework. If such a plagiarism checker has false positive results in just a small percentage of cases, the consequences for honest students would be too severe to actually act on the results of the check. But perfect accuracy can never be rea…
Re: Detect ChatGPT Generated Content
#33So, what prevents chatGPT to use detection tool and fine-tune its response accordingly?
Re: Detect ChatGPT Generated Content
#34I can tell you that detecting AI plagiarism can be a challenging task, as AI models like ChatGPT are able to generate text that is similar to existing text. It is important to note that not all text generated by AI models is considered plagiarism, as it may be used in a legal, educational or research context. The best way to evaluate the accuracy of a plagiarism detection website would be to test it using a variety o…
Your text is likely to be written entirely by AI
False positives and all.
Re: Detect ChatGPT Generated Content
#35I tried this on my recent AI satire article. While ChatGPT detected my story as AI (because I wrote it like a machine), GPTZero gladly says it's human written. ChatGPT's response: https://imgur.com/a/u7iBBaX GPTZero's response: https://imgur.com/a/89icz2X To be clear, my story was ChatGPT-assisted. But I wonder why ChatGPT couldn't detect it correctly like GPTZero?
If your story was ChatGPT assisted one can argue that it was GPT0 which misclassified it.
Here's the link to my non-paywall story for references:
https://medium.com/humor-bytes/i-your-nba-highlights-broadca...
On the topic of assistance, where do detectors draw the line between AI-augmented, aided, and generated writing?
Re: Detect ChatGPT Generated Content
#36Re: Detect ChatGPT Generated Content
#37Expect an escalating arms race between models attempting to disguise their output and tools attempting to detect generated content. There may also be escalating social and perhaps legal penalties too.
Re: Detect ChatGPT Generated Content
#38Earlier quoted context omitted.
If your story was ChatGPT assisted one can argue that it was GPT0 which misclassified it.
Correction: I used ChatGPT to discover new words and rephrase the story myself. Here's the link to my non-paywall story for references: https://medium.com/humor-bytes/i-your-nba-highlights-broadca... On the topic of assistance, where do detectors draw the line between AI-augmented, aided, and generated writing?
Like with anything else this is something that would require society to come to a consensus.
And there are various issues with AI assisted or generated content depending on the context. For example educational institutions may see this as cheating whilst corporate entities might fear legal challenges in relation to copyright and IP.
Re: Detect ChatGPT Generated Content
#39The problem with such things is that you would need 100% accuracy in most cases for it to be useful. For example many schools and universities fear that students use ChatGPT for homework. If such a plagiarism checker has false positive results in just a small percentage of cases, the consequences for honest students would be too severe to actually act on the results of the check. But perfect accuracy can never be rea…
Why? If there is 75% confidence a students report was generated using ChatGPT, then that’s enough to sit down with the student and discuss the content in person and see if they actually know it. A tool such as this could help the teacher having to avoid doing this with every student, and also reinforce to students that if they don’t actually know the material there’s still a chance they get caught.
> the consequences for honest students would be too severe to actually act
Only if acting is immediately accusing them of plagiarism rather than working with the student to ensure it’s really their work.
Re: Detect ChatGPT Generated Content
#40I can tell you that detecting AI plagiarism can be a challenging task, as AI models like ChatGPT are able to generate text that is similar to existing text. It is important to note that not all text generated by AI models is considered plagiarism, as it may be used in a legal, educational or research context. The best way to evaluate the accuracy of a plagiarism detection website would be to test it using a variety o…
I ran your comment through this Detector, and received the following message. Your text is likely to be written entirely by AI False positives and all.