Live data from Hacker News

Detect ChatGPT Generated Content

gptzero.me

31–40 of 109 posts

Re: Detect ChatGPT Generated Content

#31

I tried this on my recent AI satire article. While ChatGPT detected my story as AI (because I wrote it like a machine), GPTZero gladly says it's human written. ChatGPT's response: https://imgur.com/a/u7iBBaX GPTZero's response: https://imgur.com/a/89icz2X To be clear, my story was ChatGPT-assisted. But I wonder why ChatGPT couldn't detect it correctly like GPTZero?

If your story was ChatGPT assisted one can argue that it was GPT0 which misclassified it.

Re: Detect ChatGPT Generated Content

#32
post #26

The problem with such things is that you would need 100% accuracy in most cases for it to be useful. For example many schools and universities fear that students use ChatGPT for homework. If such a plagiarism checker has false positive results in just a small percentage of cases, the consequences for honest students would be too severe to actually act on the results of the check. But perfect accuracy can never be rea…

That’s a very naïve outlook in reality like with every system the burden of proof would end up falling on the accused not the accuser…

Re: Detect ChatGPT Generated Content

#34

I can tell you that detecting AI plagiarism can be a challenging task, as AI models like ChatGPT are able to generate text that is similar to existing text. It is important to note that not all text generated by AI models is considered plagiarism, as it may be used in a legal, educational or research context. The best way to evaluate the accuracy of a plagiarism detection website would be to test it using a variety o…

I ran your comment through this Detector, and received the following message.

Your text is likely to be written entirely by AI

False positives and all.

Re: Detect ChatGPT Generated Content

#35

I tried this on my recent AI satire article. While ChatGPT detected my story as AI (because I wrote it like a machine), GPTZero gladly says it's human written. ChatGPT's response: https://imgur.com/a/u7iBBaX GPTZero's response: https://imgur.com/a/89icz2X To be clear, my story was ChatGPT-assisted. But I wonder why ChatGPT couldn't detect it correctly like GPTZero?

If your story was ChatGPT assisted one can argue that it was GPT0 which misclassified it.

Correction: I used ChatGPT to discover new words and rephrase the story myself.

Here's the link to my non-paywall story for references:

https://medium.com/humor-bytes/i-your-nba-highlights-broadca...

On the topic of assistance, where do detectors draw the line between AI-augmented, aided, and generated writing?

Re: Detect ChatGPT Generated Content

#37
post #5

Expect an escalating arms race between models attempting to disguise their output and tools attempting to detect generated content. There may also be escalating social and perhaps legal penalties too.

I'll just put this xkcd here - https://xkcd.com/810/ (Constructive)

Re: Detect ChatGPT Generated Content

#38

Earlier quoted context omitted.

If your story was ChatGPT assisted one can argue that it was GPT0 which misclassified it.

Correction: I used ChatGPT to discover new words and rephrase the story myself. Here's the link to my non-paywall story for references: https://medium.com/humor-bytes/i-your-nba-highlights-broadca... On the topic of assistance, where do detectors draw the line between AI-augmented, aided, and generated writing?

I don’t know which is why this is completely up for debate, Office also offers grammatical corrections and you have websites like Grammarly that do the same often without any “AI” as far as I know.

Like with anything else this is something that would require society to come to a consensus.

And there are various issues with AI assisted or generated content depending on the context. For example educational institutions may see this as cheating whilst corporate entities might fear legal challenges in relation to copyright and IP.

Re: Detect ChatGPT Generated Content

#39
post #26

The problem with such things is that you would need 100% accuracy in most cases for it to be useful. For example many schools and universities fear that students use ChatGPT for homework. If such a plagiarism checker has false positive results in just a small percentage of cases, the consequences for honest students would be too severe to actually act on the results of the check. But perfect accuracy can never be rea…

> The problem with such things is that you would need 100% accuracy in most cases for it to be useful.

Why? If there is 75% confidence a students report was generated using ChatGPT, then that’s enough to sit down with the student and discuss the content in person and see if they actually know it. A tool such as this could help the teacher having to avoid doing this with every student, and also reinforce to students that if they don’t actually know the material there’s still a chance they get caught.

> the consequences for honest students would be too severe to actually act

Only if acting is immediately accusing them of plagiarism rather than working with the student to ensure it’s really their work.

Re: Detect ChatGPT Generated Content

#40
post #34

I can tell you that detecting AI plagiarism can be a challenging task, as AI models like ChatGPT are able to generate text that is similar to existing text. It is important to note that not all text generated by AI models is considered plagiarism, as it may be used in a legal, educational or research context. The best way to evaluate the accuracy of a plagiarism detection website would be to test it using a variety o…

I ran your comment through this Detector, and received the following message. Your text is likely to be written entirely by AI False positives and all.

Now you've said this I read that comment and it has the ChatGPT tone for sure.
Post reply on HN