11–20 of 71 posts
How does this compare to GPT2 output detector? I created AIwritingcheck.org to provide teachers with a user friendly interface for this model.
How does this compare to GPT2 output detector? I created AIwritingcheck.org to provide teachers with a user friendly interface for this model.
Consider trying out GPTKit https://gptkit.ai it has higher accuracy than GPTZero and uses 6 different methods
“Unlike human-written text, model-generated text tends to lie in areas where the log probability function has negative curvature (e.g., local maxima of the log probability).”
But I would classify this into the category of dangerous research. There is a conflict of interest: overstating the effectiveness leads less technical people to give undue trust to what is ultimately a statistical decision. And it shouldn’t require repeating how serious the consequences of this decision are.
The most likely outcome is that methods like this are used to diffuse responsibility. The next step is for institutions to buy into one of these classifiers and then to create a punitive “policy”.
To me it looks like old world professors calling the council because the abacus is under threat by the calculator, and we need to ensure the students are absolutely not using the calculator for their abacus studies. This all being despite the fact that society at large is moving as fast as it can to leave the abacus for calculators.
I can't help that but feel that people have lost the forest for the trees. So transfixed on the small steps that they have completely lost track of why we take all those small steps, and the utility that they ultimately provide.
If you want to study whatever subject and become an expert, history or chemical engineering, cool, go ahead. I'm still gonna chose my AI consultant over you in 5-10 years.
Very interesting, though the passage above makes me wonder how robust it is to different models or even finetuned variations on models, as even GPT-3(.5) has evolved quite a bit over recent releases since its initial introduction, and there is likely to only be a greater and greater proliferation of models over time.
From a technical standpoint, this is interesting. Like all other methods I’ve seen, it requires access to the original model logits, so it can’t be used in closed models like GPT-3 except by OpenAI themselves. But I would classify this into the category of dangerous research. There is a conflict of interest: overstating the effectiveness leads less technical people to give undue trust to what is ultimately a statisti…