Live data from Hacker News

Do AI detectors work? Students face false cheating accusations

bloomberg.com

771–780 of 1001 posts

Re: Do AI detectors work? Students face false cheating accusations

#771

Earlier quoted context omitted.

What architectures would it not be 04 on?

(older) ARM (aka, big-endian) it will be 01

You'll have to be a lot more specific than "ARM" - Most newer ARM systems are little endian in practical operation, and ARM has been "flexible endian" (you can switch between big and little endian - SCTLR has the relevant bits to control the accesses on most recent ARM ISAs) for some long while now.

Re: Do AI detectors work? Students face false cheating accusations

#772

Earlier quoted context omitted.

If you're building a system to proctor students, then part of your job is to get it to work under all reasonable real-world conditions you might encounter: low light, students with standard webcams or just the one built into their laptop, students with darker skin etc. Reality might make this harder for some cases, but solving that is what you are being paid for. Also, this could have been handled much better in the…

The last time I got an ID photo taken, I got to wait and watch as the dark-skinned Indian photographer repeatedly struggled to take a suitable passport photo of the light-skinned white woman who was in line directly ahead of me. This was at a long-established mall shop that specialized in photography products and services. The same photographer had taken suitable photos of some other people in line ahead of us rather…

If the outcome of a system is biased against people with darker or lighter skin, it's obviously racist and should be adjusted or eliminated. It doesn't really matter what the cause of the problem is when making this determination -- we can't just say "lol sorry, some people can't get passport photos."

> Despite being in a highly-controlled purpose-built environment

Frankly it sounds like the environment was not purpose-built at all. It was built to meet insufficient standards, perhaps.

Re: Do AI detectors work? Students face false cheating accusations

#773
post #769

Earlier quoted context omitted.

What architectures would it not be 04 on?

Anything big endian. unsigned int x = 0x01020304; unsigned char *c = (unsigned char*)&x; Assume x is stored at 0x100. On a little endian architecture (x86, most modern ARM systems, etc), it will be stored in memory as [04][03][02][01], from bytes 0x100 to 0x103. If you assign char c to the address of x (0x100), it will read one byte, which is 0x4. However, on a big endian system, that same value would be stored in me…

Do you know if compilers are smart enough to return 04 even on big-endian architectures nowadays? For some reason I'm under the impression that (at least clang and gcc) are able to change this from "first byte in x" to "least significant byte in x" but don't actually know why I think that. Maybe embedded compilers typically don't?

Re: Do AI detectors work? Students face false cheating accusations

#774
post #22

My kids’ school added a new weapons scanner as kids walk in the door. It’s powered by “AI.” They trust the AI quite a bit. However, the AI identifies the school issued Lenovo laptops as weapons. So every kid was flagged. Rather than stopping using such a stupid tool, they just have the kids remove their laptops before going through the scanner. I expect not smart enough people are buying “AI” products and trusting th…

Reading this comment, it sounds to me that you live in a dystopian nightmare.

Yes, but the nightmare is that we can't assume that children won't have guns on them.

Re: Do AI detectors work? Students face false cheating accusations

#776

Earlier quoted context omitted.

Passion. Juniors you want to hire will have a side project. That's all you need to see.

If someone is willing to do their job well for a fair wage, why do you insist that they make their job their entire life outside work?

If I want to hire an artist, I'd like to see their portfolio. If they don't have commercial work they can show me, I'd like to see things they created on their own time.

Re: Do AI detectors work? Students face false cheating accusations

#777
post #760

Earlier quoted context omitted.

My brother (mid-20s) still writes in cursive. He does so beautifully, completely legibly, and rapidly, at a faster rate than he, or the average person, can write non-cursive.

What a useful skill for the 160 words a year the average person writes /s

He's not the average person. His handwriting ability is both an impressive and useful skill, considering that he takes notes in a notebook, and can do so rapidly. Besides, your claim was that "no-one" uses cursive, which I simply was chiming in to point out isn't true.

Re: Do AI detectors work? Students face false cheating accusations

#778
post #640

Serious question to any teachers: are any schools embracing LLMs and teaching classes on how to use them and make or tune a model? I see lots of pearl clutching and usually the solution is to learn about the thing people are scared of, is that even happening?

Like most innovations, this is happening in the wealthiest schools. The remainder uphold the status quo, condemning the students to be 3 years behind the wealthy ones. This is how the rich stay rich.

Re: Do AI detectors work? Students face false cheating accusations

#779
post #709

Earlier quoted context omitted.

It's hard, and interviewing is better suited to answering "nope, not you!" questions than "yes, you'll be a good fit." Onsite interviews with a range of approaches seem to be the best I've found over the years. As much as it pains me, things like fizzbuzz are still useful, because people still lie about their ability to program in languages. If you claim to know C very well and can't knock that out in 5 minutes, and…

> things like fizzbuzz are still useful I think you're right here but, to play devil's advocate... isn't there some survivorship bias going on here? I assume you've never tested the negative hypothesis and gone ahead and hired somebody who couldn't program fizzbuzz to validate your assumption.

> I assume you've never tested the negative hypothesis and gone ahead and hired somebody who couldn't program fizzbuzz to validate your assumption

A former employer of mine inadvertently did! He wasn't asked to complete FizzBuzz, but I am confident he couldn't answer it as I worked on the same team as him. He was a very charismatic individual who always "needed help" from team mates on all tasks, no matter how small. He managed to collect a salary for 6 months. Some time after he was let go, the police called my employer enquiring after him, and we learned he was a conman with outstanding arrest warrants with no prior SWE experience at all. The name we all knew him by was just one of many aliases.

Re: Do AI detectors work? Students face false cheating accusations

#780

Earlier quoted context omitted.

> Such as? We need an answer now because students are being assessed now. Two decades ago, when I was in engineering school, grades were 90% based on in-person, proctored, handwritten exams. So assignments had enough weight to be worth completing, but little enough that if someone cheated, it didn't really matter as the exam was the deciding factor. > Return to the old "viva voce" exam? Still used for PhDs. But that…

There are institutions that still require a public defence for a PhD, not merely a viva. Oslo University for instance: https://www.uio.no/english/research/phd/

What PhD program doesn't require a public defense?

I'm currently a PhD candidate, and our program includes separate written and oral qualifying exams during the first year or two, and a public defense of the dissertation at the end. I thought some minor variation of this was nearly universal.

It's also my observation, by the way, that the public dissertation defense (and even the written dissertation itself) is less of a big deal than outsiders tend to think. What matters is doing the research that the advisor / committee wants, and working on some number of papers that get accepted into workshops / conferences / journals (depending on the field). Everything else seems to be kind of a check-the-box formality. By the time the committee agrees that someone has done enough to defend, it's pretty much a done deal.

Post reply on HN