> Web server is down Error code 521 I’m seeing an error message from cloudflare. Is the website working for anyone else? Is there an archive / mirror?
Looks like it is indeed down.
It Wasn't AI
41–50 of 134 posts
Re: It Wasn't AI
#42IMO one of the way that most schools are going to end up being able to detect plagiarism is going to be a custom word processor (or something similar) that can track all of the edits made into a document. Basically, have the students type an essay where all of the keystrokes are recorded by the program, and so it can be detected by the program whether someone is copy and pasting whole essays, or if someone is actuall…
Maybe, but I doubt it. Spyware-based systems are doomed to failure as other commenters note. There's nothing you can do to prove the text came from a human. Faking inputs is extremely easy. People will sell a $20 USB dongle that does appropriate keyboard/mouse things. Worst case, people can simply type in the AI generated essay by hand and/or crib from it directly.
Schools are going to have to look at why take home work is prescribed, and if it should be part of a grading system at all. My hunch is that it probably shouldn't be, and even though it's a big change it's probably something they can navigate.
I predict more in-person learning interactions.
Re: It Wasn't AI
#43With the advent of new technology, so must entire practices and industries spring up to counteract the inherent harm this technology will cause and is already causing. is it a given that technological progress will often necessitate societal harm? Is such technological progress actually progress for humanity? there seems to be this universal notion that "things that can be built will be built and are inevitable". It…
Very well put.
Why not to build nukes massively? Nukes are inevitable, because in the human nature there is inherent hunger for power (ask any psychologist nearby), and nukes are the ultimate power. With nukes at reasonable prices for wealthy families, the notion of an "atomic family" would really get a new exciting meaning!
I am ofc sarcastic, but the reasoning is IMO the same like with the AI.. The real question here is: why to refrain from building nukes and why to refrain from uncontrollably developing AI.
Re: It Wasn't AI
#44Any sufficiently good AI detector will soon become part of the training process.
I am concerned about the false positive rate on AI detectors. But if they are being used to flag submissions for further review only then I can go with it. Finding out if a student cheated shouldn't be too hard, just quiz them on what they wrote.
And even before quizzing them, their work can be cross referenced against their other writing. If they've gone from writing with poor understanding of subject matter basics and poor written English to something like an exemplar essay in a matter of weeks, it's pretty clearly they've had some sort of help whether that's AI or not.
Re: It Wasn't AI
#45Seems like the site might have crashed, here's an archive link: https://web.archive.org/web/20230515030802/https://itwasntai....
But tl;dr many students have been accused of using AI by teachers who think that AI detection software works, when it really doesn't. So the goal of this site is to communicate to teachers that AI detection software isn't reliable.
I originally discovered this in a reddit comment which you can see here: https://www.reddit.com/r/ChatGPT/comments/13hi5y6/comment/jk...
Re: It Wasn't AI
#46Interesting why this site is down...
Re: It Wasn't AI
#47IMO one of the way that most schools are going to end up being able to detect plagiarism is going to be a custom word processor (or something similar) that can track all of the edits made into a document. Basically, have the students type an essay where all of the keystrokes are recorded by the program, and so it can be detected by the program whether someone is copy and pasting whole essays, or if someone is actuall…
[deleted]
Re: It Wasn't AI
#48On the one hand, this is sorely needed: AI detection software will inevitably be mostly snake oil. Academia and education desperately wants this software to work! As a result, selling them something that doesn't work is going to be very profitable. The most obvious problem with this class of software is how easy it would be to defeat if the students could access it themselves: generate some text, run it through the d…
> AI detection software will inevitably be mostly snake oil.
Probably so. The problem, of course, is that the inability to detect AI authorship leads to the increase of general distrust of everything in society.
Re: It Wasn't AI
#49"AI Detectors" are the new anti-virus - useless but once required by bureaucratic policy both unstoppable and profitable.
Re: It Wasn't AI
#50IMO one of the way that most schools are going to end up being able to detect plagiarism is going to be a custom word processor (or something similar) that can track all of the edits made into a document. Basically, have the students type an essay where all of the keystrokes are recorded by the program, and so it can be detected by the program whether someone is copy and pasting whole essays, or if someone is actuall…
Maybe, but I doubt it. Spyware-based systems are doomed to failure as other commenters note. There's nothing you can do to prove the text came from a human. Faking inputs is extremely easy. People will sell a $20 USB dongle that does appropriate keyboard/mouse things. Worst case, people can simply type in the AI generated essay by hand and/or crib from it directly. Schools are going to have to look at why take home w…
It's a cat-and-mouse game for sure. At the first level, any dongle that simply types the AI response through a fake HID device will be easy to detect. No real essay writer just types an entire document in one go, with no edits. They move paragraphs around, expand some, delete others, etc.
So this dongle will have to convincingly start with a worse version that's too short (or too long!). It'll have to pipe the GPT output through another process to mangle it, then "un" mangle it like a human would as they revise and update.
If trained on the user's own previous writings, it can convincingly align the AI's response with the voice and tone of the cheater.
Then the spyware will have to do a cryptographic verification of the keyboard ("Students are required to purchase a TI-498 keyboard. $150 at the bookstore") to prevent the dongles. There will be a black market in mod chips for the TI-498 that allow external input into the traces on the keyboard backplane. TI will release a better model that is full of epoxy and a 5G connection that reports tampering...
... Yeah, I also predict more in-person learning :)