Live data from Hacker News

My university uses prompt injection to catch cheaters

varun.ch

1–10 of 74 posts

Re: My university uses prompt injection to catch cheaters

#5
Good. I wouldn't like cheaters to compete with honest students on the job market.

In my kid's school (American high school equivalent) being caught on using LLM in papers is a failed subject. Students must pass all the subjects to finish the school. Some of these subjects won't be taught the next year so effectively they lose year, two, three....

Re: My university uses prompt injection to catch cheaters

#6

Prompt injecting homework assignments is a funny idea, but doesn't seem very productive. Either the teacher needs to adjust how they are teaching new concepts or the student needs to ask themself why they are attending college in the first place.

The student is attending college to get a job. Most students don't care about the course.

Probably around 50% of students in my year were only in it for the well paying jobs a prestigious degree like that could give them.

This has to be part of the threat model for cheating.

Re: My university uses prompt injection to catch cheaters

#7

Prompt injecting homework assignments is a funny idea, but doesn't seem very productive. Either the teacher needs to adjust how they are teaching new concepts or the student needs to ask themself why they are attending college in the first place.

The student is attending college to get a job. Most students don't care about the course. Probably around 50% of students in my year were only in it for the well paying jobs a prestigious degree like that could give them. This has to be part of the threat model for cheating.

[deleted]

Re: My university uses prompt injection to catch cheaters

#8

Prompt injecting homework assignments is a funny idea, but doesn't seem very productive. Either the teacher needs to adjust how they are teaching new concepts or the student needs to ask themself why they are attending college in the first place.

The student is attending college to get a job. Most students don't care about the course. Probably around 50% of students in my year were only in it for the well paying jobs a prestigious degree like that could give them. This has to be part of the threat model for cheating.

It's pointless. Just an arms race of gimmicks. There's really no option besides making homework all optional, and putting 100% of the grade into in-person exams. I basically don't trust that any new graduate has earned their degree, and won't until schools do what's necessary to crush cheaters.

Re: My university uses prompt injection to catch cheaters

#9
I teach a tech class to marketing students, and it definitely works very well. They are allowed to use ChatGPT and other tools, with one caveat: you remain responsible for the output. I hide white-text prompt injections in specs or longer task instructions (usually in PDFs, works well enough there with copy and paste), and sometimes place a phrase near the end of the text that prompts the LLM to append something like, "I submit this assignment without checking its output, and I accept point deductions as agreed."

I used to do this for a laugh and not deduct points, next year, I showed them this before class as an introduction to working with AI and kind of as a warning, I'll deduct points, expecting nobody falling for it, then they fell for it over and over again. Well.

Re: My university uses prompt injection to catch cheaters

#10

Earlier quoted context omitted.

The student is attending college to get a job. Most students don't care about the course. Probably around 50% of students in my year were only in it for the well paying jobs a prestigious degree like that could give them. This has to be part of the threat model for cheating.

It's pointless. Just an arms race of gimmicks. There's really no option besides making homework all optional, and putting 100% of the grade into in-person exams. I basically don't trust that any new graduate has earned their degree, and won't until schools do what's necessary to crush cheaters.

I agree with you in spirit, but the last meta pre-LLM was that exams were bad at measuring student skill and that students felt more fairly treated when their grade was the result of multiple assignments and projects. I think it's a shame we have move away from that
Post reply on HN