Live data from Hacker News

Professor denounces mass AI fraud on an exam at Brown

english.elpais.com

241–250 of 771 posts

Re: Professor denounces mass AI fraud on an exam at Brown

#241
post #106

Earlier quoted context omitted.

I’m 30 and “we can’t do tests in paper” seems _insane_. Just how metastatic has ed tech been in what, 9 years since my undergrad?

I’m 40 and forcing students to do handwritten essays during tests has always been stupid. Typing is much faster, why bottleneck ideas by forcing handwriting?

because writing speed isn't the bottleneck for what is being tested

Re: Professor denounces mass AI fraud on an exam at Brown

#242

In the AI era, tests are going to have to be in person and hand written. I have written an article on how I have adjusted my classes to the situation: https://htmx.org/essays/universities-and-ai/ Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.

It's news to me that they weren't already. My exams were all in person and on paper in the early 2020s, and even my physics homework was a "do it on engineering paper and drop it in a mail slot" affair. The professors would forbid computers and phones during lectures and would stop to shame anyone who thought they were being sneaky. Computer Science classes were all on paper for exams, and low level ones did the old…

I think “take home open book exam, good luck,” followed by evil laughter, is mostly a math department thing.

Re: Professor denounces mass AI fraud on an exam at Brown

#243

Earlier quoted context omitted.

> In the AI era, tests are going to have to be in person and hand written. Forcing hand written should really not be necessary. It would be very cheap in terms of old computing hardware to set up a test room with old desktop PCs that have wired only NICs (with a network connection that goes to a switch in the same room with no uplink, connected to a decent size laser printer only), running something like lubuntu and…

Talking about programming-related courses, I can see the point of testing on a computer where one can run and debug actual code (that's how I had my programming courses) but I am not sure I get the advantage or writing code or pseudocode on a "basic word processor". Moreover, for math or math-heavy courses (assuming most people with degrees here have STEM degrees, and many with at least some math) I cannot imagine ho…

Writing on paper requires higher level planning skills.

A word processor allows you to edit, which is a major part of the writing process.

Forcing learners to plan everything “perfectly” before they write is a big ask. And you’re probably not teaching that skill.

I remember how much my technical writing skills improved once I started writing in a computer and editing. It was a huge difference.

Re: Professor denounces mass AI fraud on an exam at Brown

#244

In the AI era, tests are going to have to be in person and hand written. I have written an article on how I have adjusted my classes to the situation: https://htmx.org/essays/universities-and-ai/ Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.

> In the AI era, tests are going to have to be in person and hand written. Forcing hand written should really not be necessary. It would be very cheap in terms of old computing hardware to set up a test room with old desktop PCs that have wired only NICs (with a network connection that goes to a switch in the same room with no uplink, connected to a decent size laser printer only), running something like lubuntu and…

When I started university, it did indeed have a dedicated building that was essentially a computer lab specifically for testing. In theory, cheating was prevented by having people walk around the lab watching the students. Toward the end, I did have a couple exams that needed the absolutely batshit insane malware installed on a personal device, but I think if I were to do it again today, I could still demand to use the testing center instead. It still exists.

Re: Professor denounces mass AI fraud on an exam at Brown

#245
let people use as much ai as possible. encourage it. and as an educator, you have to learn to leverage it oneself or not (depending on the subject). and be better at using it than students if it does make one 'better'.

if ai doesn't help, then it won't help. if it does help, then you should use it. the metric is your output of whatever is being tested. writing an essay well and clearly understanding the material. solving a pset. whatever.

if you give access all the time for that, and then you test on a hard problem that could be done with or without ai, then it's fair. e.g. "clearly explain these four sentences of Y." obviously ai researching loosely and blathering isn't useful. won't be high signal / dense and correct and worthy of an 'a'. but someone who can harness ai and someone who knows the material well in the end will be rewarded the same by society. what you are testing is correctness and information density in a response. so you have to start now in accepting the reality that those who use ai to get there should be rewarded just the same as those who don't.

the burden is on educators to be as good as they can with ai if it is relevant or not if it is not relevant (and schools to fund them and ai companies to fund them if they have excess capital and are humanitarian).

and note the hard part even for us engineers at tech companies is in the correctness. it is very hard. but the sooner we start teaching how to do things correctly with ai, the more prepared the next generations will be.

Re: Professor denounces mass AI fraud on an exam at Brown

#246

As a university professor, I honestly don't understand the point of grading. Who will look at and care about grades? Likely company HR. But then why should we (professors) do the screening for companies for free? Also, grades have long been inflated to a point we might as well just give everyone an A and let companies figure out how to select people.

Grading is to provide your students with a goal, one that isn't so high-minded as "the goal is education". The human mind uses a "reward system", within a feedback cycle. If you want to do away with that, just because it's what you prefer, then you're ignoring the reality of being human.

Re: Professor denounces mass AI fraud on an exam at Brown

#247
post #63

Earlier quoted context omitted.

I've had such exams. It was the honor system. The idea is that a typical exam is too short to evaluate the student's knowledge and a belief that fast students shouldn't have an advantage.

How long is too short? Each exam in my BSc Applied Physics final (1977, Exeter Uni.) was three hours and we had similar exams in each of the preceding years to weed out those who weren't keeping up. I'm pretty sure that having more time would not have helped the weaker students get through the Quantum Mechanics exam. In addition I had to defend the report (120 pages of typescript and charts) of my final year project…

3 hours for us as well. When you start doing graduate level work, a problem could easily last over an hour. And many people will have false starts before they figure it out.

It's not a problem with homework assignments as they have multiple days to finish.

So the professor has to decide between poor data with high variance, or good data with lower variance.

> I'm pretty sure that having more time would not have helped the weaker students get through the Quantum Mechanics exam.

Funny you mention that. When I did my (undergrad) QM II exam, I likely got the highest score, and I'm sure my score was below 40%.

There just wasn't enough time.

Re: Professor denounces mass AI fraud on an exam at Brown

#248
post #42
post #28

Earlier quoted context omitted.

The Lance Armstrong defense

In his generation, only cheating cyclists could stay in teams. He was the one who created the situation, but in fact, cyclists had two choices - stop being cyclist or cheat.

You yourself are on drugs if you think Lance Armstrong "created the situation."

https://en.wikipedia.org/wiki/Doping_at_the_Tour_de_France#D...

Note the quantity that actually got caught and with enough evidence. Lance won it 6 times without getting caught.

Looking at it systematically there's no way all of the top finishers were not taking drugs (how else could they compete with the world's best who were? The advantage isn't small.) And it had clearly been going on for many years before Armstrong entered the event for the first time.

I really don't care for Armstrong's yellow banded hypocrisy but blaming him for the "cheat or don't bother competing" reality lets rather a lot of people off the hook with a convenient scapegoat.

But I'm sure that's all in the past and it's not like that now. Just as was said when Armstrong won 6 times while correctly stating he was the most tested athlete on the planet.

Wrapping it up and tying all that to Armstrong, as has been done, stinks. He was clearly a bit player in that extensive fraud. Six titles with no meaningful positive drug test as the most tested athlete on the planet.

Re: Professor denounces mass AI fraud on an exam at Brown

#249

It's the old game that he's trying to preserve. It's time to move on to the new game. When the landscape shifts beneath you, its very low probability that the existing structures on the landscape are a good fit for the new landscape, and the structures on the new landscape must be rethought from first principles.

He did move to a new game, which is what confirmed they'd been cheating.

Pretty funny - cheating so bad that even a blind man can see it.

Re: Professor denounces mass AI fraud on an exam at Brown

#250

As a university professor, I honestly don't understand the point of grading. Who will look at and care about grades? Likely company HR. But then why should we (professors) do the screening for companies for free? Also, grades have long been inflated to a point we might as well just give everyone an A and let companies figure out how to select people.

You should know full well you need some method of determining if a student is competent enough to move on to the next class in whatever sequence. Perhaps universities are slacking on this front, but at a minimum a student who doesn't understand the basics of Calc I should not go take Calc II
Post reply on HN