[dead]
Do AI detectors work? Students face false cheating accusations
921–930 of 1001 posts
Re: Do AI detectors work? Students face false cheating accusations
#922Earlier quoted context omitted.
It's fairly simple in most situations. If it doesn't involve a computer, it's handwritten in class. If it does involve a computer, it's a temporarily offline computer. We have figured out solutions to these problems already.
You forgot “no homework that counts, or a prison- or monastery-like environment where you have no access to any of these technologies for the length of academic term”. No, humans have not ever had a similar problem before, and also some of the solutions to various problems that we have figured out in our past are no longer considered reasonable today.
No homework that counts is essentially a double win.
Re: Do AI detectors work? Students face false cheating accusations
#923Earlier quoted context omitted.
It's fairly simple in most situations. If it doesn't involve a computer, it's handwritten in class. If it does involve a computer, it's a temporarily offline computer. We have figured out solutions to these problems already.
It may be that offline LLMs will be common in a few years.
That is definitely a potential issue, but so far any text models that run on laptops are tremendously slow. Still, something to look out for.
Re: Do AI detectors work? Students face false cheating accusations
#924Earlier quoted context omitted.
Yet the murder rate was unaffected by the gun ban.
Yet the USA's intentional murder rate per 100k population is 6.383 while the UK's is 1.148 [1] [1] https://en.wikipedia.org/wiki/List_of_countries_by_intention...
So it would be reasonable to assume there are other factors at play?
Re: Do AI detectors work? Students face false cheating accusations
#925Earlier quoted context omitted.
> The central example of this is college admissions statements. Some kids have the advantage both of parents who can afford to give them the experiences that look good on such an essay (educational trips to Africa, lessons in two musical instruments, one-on-one golf coaching, that kind of thing), and who can hire tutors to "support" them in writing the essay. This is an absolute disgrace. And then these are the peopl…
> This is an absolute disgrace. And then these are the people who lecture you on "inclusion". Are they? Is there any evidence of correlation between these two groups of people?
You can decide whether it's evidence or not, but almost everything Freddie deBoer has ever written about college admissions points in that direction and I personally trust him on this topic, among other things because he presents scientific evidence that the SAT is much more reliable than some people make out to be, and is much more resistant to private tutoring. (One thing the SAT doesn't do is keep Asians out, however.) A search for "Freddie deBoer college admissions" with your favorite non-AI-shittified search engine should find lots of articles.
Re: Do AI detectors work? Students face false cheating accusations
#926Earlier quoted context omitted.
My personal take, we’ve made the cost of failure to high and cheating too easy. As a student, the only thing the next institution will see is GPA, school, major. Roughly in that order. If the cost of not getting an A is exclusion from future opportunities- then students will reject exclusion by taking easier classes or cheating. As someone who studied physics and came out with a 2.7 GPA due to studying what I wanted…
Serious question from someone who is regularly tasked with hiring Juniors. What IS a good assessment for entry-level/right out of college positions? -> GPA can be gamed, as laid out. -> Take Home assessments can mostly be gamed, I want to assess how you think, now which tools you use. -> Personality tests favor the outgoing/extroverts -> On-location tests/leet code are a crapshoot. What should be best practice here?…
This might be unpopular, but I think this is a problem that can never scale well. It is possible to get to know someone, and spot incompetence or deception; but it involves spending time with people. Once you scale you need an objective measure, such as testing, an testing has some specific failure modes. On a smaller scale, human intuition and appraisal can work more effectively. I know someone is going to point out that these can be very limited and biased. This is true, but the "objective" and "merit-based" systems don't seem to be winning over anyone either.
Re: Do AI detectors work? Students face false cheating accusations
#927Earlier quoted context omitted.
The last time I got an ID photo taken, I got to wait and watch as the dark-skinned Indian photographer repeatedly struggled to take a suitable passport photo of the light-skinned white woman who was in line directly ahead of me. This was at a long-established mall shop that specialized in photography products and services. The same photographer had taken suitable photos of some other people in line ahead of us rather…
If the outcome of a system is biased against people with darker or lighter skin, it's obviously racist and should be adjusted or eliminated. It doesn't really matter what the cause of the problem is when making this determination -- we can't just say "lol sorry, some people can't get passport photos." > Despite being in a highly-controlled purpose-built environment Frankly it sounds like the environment was not purpo…
At a certain point reality has a refletivity bias
Re: Do AI detectors work? Students face false cheating accusations
#928I am interviewing Java candidates. People were submitting ai generated written screens and I had enough. I modified my written screen in a way that allows me to catch some ai generated content. When it flags it, it’s 100% correct. There are no false positives. It’s still possible to have false negatives. Btw if anyone is recruiting and interested in such a tool, contact me. Details in profile.
>> ai generated written screens
>> I modified my written screen in a way that ...
What's a written screen? (I could not find via a quick Google search.)
Re: Do AI detectors work? Students face false cheating accusations
#929Earlier quoted context omitted.
I can't express how out of touch with reality this reply is. The students paid me nothing. The university provides some TAs, that's it. But even if they gave me all of that money in cash to spend, this would be totally impossible. I'm supposed to grade a student based on 1 conversation? Do you know how grading and teaching work? Can you imagine the complains that would come out of this process? How unfair it is to sa…
> I can't express how out of touch with reality this reply is. > The students paid me nothing. Well gee, there I was thinking they were paying $27,480 per year for "tuition"
That's as useful of a statement as shouting at a police officer that "you pay their salary" as they give you a ticket.
Re: Do AI detectors work? Students face false cheating accusations
#930Earlier quoted context omitted.
Why a single score? The AI can generate a whole boilerplate of argumentation of why it made the decision. The reviewer will pretend to read and contemplate it, and then press the "OK" button.
There's a lot of "what can you get away with" in the world; but getting caught cheating like that is likely to go worse than getting caught using an LLM for a final exam.
My argument is there is no "getting caught" here. It is perfectly legal.