"I used a magic 8 ball to predict the future."
"They don't predict the future."
"I know their predictions are statistically quite bad, so I used a magic 8 ball three times to make sure there wasn't any doubt."
----
How much allure for these products is there that a college professor can be on HN, know that the tools don't work, and still use them anyway?
And how are students supposed to combat that kind of misuse if even educating professors about the problem isn't enough to make them stop trusting the detectors? And for a professor to then to brag about it on HN that they're being responsible as if they expect to be praised for it?
It's just so frustrating to read... What do you do if you're a student in that situation, do you have to sit your professor down and not only show that the tools have problems but also explain the concept of correlated error?
I kind of feel like the only way this changes is with legal challenges to colleges until they eventually ban the tools from being used in grading. Public pushback isn't going to change it, schools aren't going to care about that. And if educating about the problems isn't going to change behavior, I can't expect students to walk every one of their professors through a stats class. I don't know what if any legal rights at all students actually have in these situations, I'm guessing most colleges have boilerplate that if they decide to randomly fail you tough luck.
But at the very least, @jccalhoun you should stop using these programs yourself; you have the individual ability to make your own classroom better, and you should.