11–19 of 19 posts
I wrote a userscript (with help from ChatGPT) that identifies if comments on HN are written by AI or a human. I based it on https://huggingface.co/openai-detector . Its still a little shabby and only works on HN, but I imagine this is going to be required for general non-specific Internet browsing going forward. Looks like this: https://i.imgur.com/BTt1DTh.png
There isn't a hard boundary between "content written by an AI" and "content written by a human". I can say to ChatGPT: "Here are my ideas in point form, write them out as full paragraphs: ..." And ChatGPT will do that for me. So, is that content written by an AI, or content written by a human?
I wrote a userscript (with help from ChatGPT) that identifies if comments on HN are written by AI or a human. I based it on https://huggingface.co/openai-detector . Its still a little shabby and only works on HN, but I imagine this is going to be required for general non-specific Internet browsing going forward. Looks like this: https://i.imgur.com/BTt1DTh.png
I wrote a userscript (with help from ChatGPT) that identifies if comments on HN are written by AI or a human. I based it on https://huggingface.co/openai-detector . Its still a little shabby and only works on HN, but I imagine this is going to be required for general non-specific Internet browsing going forward. Looks like this: https://i.imgur.com/BTt1DTh.png
Very interesting! How does it work?
It only becomes reliable after about 50 tokens (one token is around 4 characters) so I mark the comments that are too short with gray and make no assessment on those.
I've put it on https://github.com/chryzsh/GPTCommentDetector
I wrote a userscript (with help from ChatGPT) that identifies if comments on HN are written by AI or a human. I based it on https://huggingface.co/openai-detector . Its still a little shabby and only works on HN, but I imagine this is going to be required for general non-specific Internet browsing going forward. Looks like this: https://i.imgur.com/BTt1DTh.png
+1 star for this repo btw
Earlier quoted context omitted.
Very interesting! How does it work?
It puts every comment into that GPT output detector and colors and writes a short comment on the HN comment, like you see in the screenshot based on a threshold. >0.7 is probably AI, >0.9 is definitely AI. Lower than that is most likely human. Most comments still appear to be human. It only becomes reliable after about 50 tokens (one token is around 4 characters) so I mark the comments that are too short with gray an…
Earlier quoted context omitted.
It puts every comment into that GPT output detector and colors and writes a short comment on the HN comment, like you see in the screenshot based on a threshold. >0.7 is probably AI, >0.9 is definitely AI. Lower than that is most likely human. Most comments still appear to be human. It only becomes reliable after about 50 tokens (one token is around 4 characters) so I mark the comments that are too short with gray an…
I see. My question of how it works was more about the method you were using to identify content as something written by an AI, but from what I saw on your repo, you rely on a set of GPT-specific configurations that identify a percentage of similarity to the content being analyzed?
Earlier quoted context omitted.
I see. My question of how it works was more about the method you were using to identify content as something written by an AI, but from what I saw on your repo, you rely on a set of GPT-specific configurations that identify a percentage of similarity to the content being analyzed?
Like desrcibed in the repo, I just feed it to the GPT output detector. I didn't write that tool, but from my understanding they trained a GPT model to recognize itself.