Is there really something of value to be had by fighting a war against the coming tide of AI that can spit out whatever you ask for? To me it looks like old world professors calling the council because the abacus is under threat by the calculator, and we need to ensure the students are absolutely not using the calculator for their abacus studies. This all being despite the fact that society at large is moving as fast…
DetectGPT: Zero-Shot Machine-Generated Text Detection
21–30 of 71 posts
Re: DetectGPT: Zero-Shot Machine-Generated Text Detection
#22Re: DetectGPT: Zero-Shot Machine-Generated Text Detection
#23From a technical standpoint, this is interesting. Like all other methods I’ve seen, it requires access to the original model logits, so it can’t be used in closed models like GPT-3 except by OpenAI themselves. But I would classify this into the category of dangerous research. There is a conflict of interest: overstating the effectiveness leads less technical people to give undue trust to what is ultimately a statisti…
You can get all the necessary log probabilities from the GPT-3 API.
Re: DetectGPT: Zero-Shot Machine-Generated Text Detection
#24Is there really something of value to be had by fighting a war against the coming tide of AI that can spit out whatever you ask for? To me it looks like old world professors calling the council because the abacus is under threat by the calculator, and we need to ensure the students are absolutely not using the calculator for their abacus studies. This all being despite the fact that society at large is moving as fast…
It is valuable for SPAM filters, and other fraudulent activity. If you get an e-mail from someone you know and it says "I need itunes gift cards right away!" most people know that is a scam. But if you get an e-mail that appears to be following up on a previous conversation, you are much more likely to click on a link in that e-mail.
Re: DetectGPT: Zero-Shot Machine-Generated Text Detection
#25I can't judge the capabilities of this tool, but I can't help but be skeptical on the mid-long term prospects. The fakes (text, audio, video) will improve to the point of being virtually unrecognizable from real material, no matter how good your fake detection is.
Re: DetectGPT: Zero-Shot Machine-Generated Text Detection
#26The approach to feed text through a language model and then obtain some kind of vector/hash from it will be leveraged to fingerprint writing and track people.
Re: DetectGPT: Zero-Shot Machine-Generated Text Detection
#27> This approach, which we call DetectGPT, does not require training a separate classifier, collecting a dataset of real or generated passages, or explicitly watermarking generated text. It uses only log probabilities computed by the model of interest and random perturbations of the passage from another generic pre-trained language model (e.g, T5). Very interesting, though the passage above makes me wonder how robust…
Re: DetectGPT: Zero-Shot Machine-Generated Text Detection
#28I'm one student using GPT to write my written assignments, and I cannot understand what is the issue with that. Even though it enhances the quality of my text, I cannot just copy, paste, submit and profit. I still have to understand what is being written. My workflow is normally the following:
- I ask for an outline to the essay. I use this outline as guide, remove some suggestion, add others that I think are important, rephrase some. I could as well google for similar written essays and do the same.
- Then I ask for the topics, please describe X, Y.. I read it, as a regular source. I understand it, and rewrite it. I add stuff, remove stuff, add references. Normally I endup rewriting everything
- Push the text through Grammarly, rephrase some stuff, check for plagiarism and submit it. I have to read and re-read it, many times.
I have the impression that I've got much more effective avoiding the mechanical part of the task of writing. In another hand my course has some stupid enforcement like 15k words/essay. So they are almost asking me to do some bullshit around the topic instead of going straight to the point. I simply automate the burden. As any software developer would do. I however study philosophy.
So i guess, it will help the universities and education institutions to rethink their traditional way of evaluate written assignments, which probably will be positive. It helps me definitely to write better.
Re: DetectGPT: Zero-Shot Machine-Generated Text Detection
#29Is there really something of value to be had by fighting a war against the coming tide of AI that can spit out whatever you ask for? To me it looks like old world professors calling the council because the abacus is under threat by the calculator, and we need to ensure the students are absolutely not using the calculator for their abacus studies. This all being despite the fact that society at large is moving as fast…
AI will never replace experts.
Someone still has to curate the firehose of information returned. What's the point then?
AI can only interpolate a response from internet sources, and claims of plagiarism are already coming hard. The internet was never a good source of expertise.
Re: DetectGPT: Zero-Shot Machine-Generated Text Detection
#30From a technical standpoint, this is interesting. Like all other methods I’ve seen, it requires access to the original model logits, so it can’t be used in closed models like GPT-3 except by OpenAI themselves. But I would classify this into the category of dangerous research. There is a conflict of interest: overstating the effectiveness leads less technical people to give undue trust to what is ultimately a statisti…
You can get all the necessary log probabilities from the GPT-3 API.