In the AI era, tests are going to have to be in person and hand written. I have written an article on how I have adjusted my classes to the situation: https://htmx.org/essays/universities-and-ai/ Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.
Professor denounces mass AI fraud on an exam at Brown
441–450 of 771 posts
Re: Professor denounces mass AI fraud on an exam at Brown
#442Earlier quoted context omitted.
Is it paywalled? I honestly didn't realize that. Sorry. I'll edit the comment and change to an open URL and paste the two main ideas here: FORCED SKILL-BUILDING GOALS Where my original purpose of giving homework assignments was to help students build their skills through active engagement, I can no longer trust that all my students will have done it by hand. But I still want my students to feel the need to improve th…
For homework: if you make homework results not count towards the final grade, then there's no reason to use an LLM - the point then just becomes to have practice problems and feedback on how well you are doing. This is what my university (EPFL) was doing ~40 years ago. And yes, some students didn't bother with the homework, and mostly paid the price at the final exam...
Unfortunately, if I give homework that will not be graded, almost no one will do it. But I WANT them to do it for the practice it gives them.
The only reasonable answer I could find is to award them full points for simply doing the homework on time, even if it has errors.
Re: Professor denounces mass AI fraud on an exam at Brown
#443In the AI era, tests are going to have to be in person and hand written. I have written an article on how I have adjusted my classes to the situation: https://htmx.org/essays/universities-and-ai/ Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.
Re: Professor denounces mass AI fraud on an exam at Brown
#444In the AI era, tests are going to have to be in person and hand written. I have written an article on how I have adjusted my classes to the situation: https://htmx.org/essays/universities-and-ai/ Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.
Wait, is this not how things are now? Do students do exams at home now? I guess it has been 14 years since I graduated but I didnt expect it to change that much.
I went to a liberal arts college that prided itself on small class sizes and the honor code, and where professors typically had a good enough read on every student that they could tell when work wasn't your own or you'd collaborated with classmates. Our in person exams were not proctored except by your peers, the professors would sit outside the room. My understanding is that this sort of arrangement has been common at liberal arts colleges and similar universities for a long time - I know UVA has long prided itself on unproctored exams.
There's been a massive culture shift in the US where cheating is more and more accepted, beyond just the AI stuff, over the last few decades, and these sorts of peer based honor codes are no longer sustainable.
Re: Professor denounces mass AI fraud on an exam at Brown
#445In the AI era, tests are going to have to be in person and hand written. I have written an article on how I have adjusted my classes to the situation: https://htmx.org/essays/universities-and-ai/ Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.
Hand written is unnecessary, just ban/confiscate phones and restrict internet access if the test needs a computer.
Re: Professor denounces mass AI fraud on an exam at Brown
#446Re: Professor denounces mass AI fraud on an exam at Brown
#447Earlier quoted context omitted.
It works about as well as replacing your barista with an iPad.
A lot of restaurants in Korea and elsewhere have replaced human cashiers with touch screen kiosks. You’re given a number, someone calls it out when your drink’s ready. For the places I went to it worked just fine. Did you have a bad experience?
Re: Professor denounces mass AI fraud on an exam at Brown
#448In the AI era, tests are going to have to be in person and hand written. I have written an article on how I have adjusted my classes to the situation: https://htmx.org/essays/universities-and-ai/ Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.
Re: Professor denounces mass AI fraud on an exam at Brown
#449I have seen it firsthand in the CS department here at Dartmouth. It is bad. We're currently designing a new intro systems curriculum, and we're thinking of it as an adversarial problem. That is, we're designing the course to ensure that a student optimizing for the best grade per unit work still meets our learning objectives. That means, as everyone else is saying, paper exams, but also 1-on-1 interviews to check tha…
Without a hint of irony, wouldn't a Voice AI solution help better manage the 1-1 interview process?
Re: Professor denounces mass AI fraud on an exam at Brown
#450Earlier quoted context omitted.
It's news to me that they weren't already. My exams were all in person and on paper in the early 2020s, and even my physics homework was a "do it on engineering paper and drop it in a mail slot" affair. The professors would forbid computers and phones during lectures and would stop to shame anyone who thought they were being sneaky. Computer Science classes were all on paper for exams, and low level ones did the old…
I think “take home open book exam, good luck,” followed by evil laughter, is mostly a math department thing.
Those exams probably took the median student 30 hours and had a median score of 50% including partial credit.
Sad to think current students will never get that experience, because a chatbot could write something good enough to get a 50% in 10 minutes, for many of those classes.