Live data from Hacker News

Texas professor fails entire class from graduating- claiming they used ChatGTP

old.reddit.com

251–260 of 288 posts

Re: Texas professor fails entire class from graduating- claiming they used ChatGTP

#252

Earlier quoted context omitted.

He's a self-appointed expert who is neither an AI researcher, computer scientist, or any other accredited title you'd expect someone loudly yelling, “WE'RE ALL GOING TO DIE” on a technical topic like the fundamentals of AI and its dangers to hold. You and others continue to foist human qualities on LLMs because it looks like magic. To know is to know oneself. LLMs do not know themselves. In fact, there is no “self” t…

I don’t know much about him but I thought he was a researcher? There is an “Academic publications” section on https://en.m.wikipedia.org/wiki/Eliezer_Yudkowsky and it says “He is a co-founder and research fellow at the Machine Intelligence Research Institute” LLMs are not self aware, I agree, but there is clearly some reasoning going on and you could argue that its model of human behaviour can somewhat simulate self…

Being a self-appointed expert goes a long way if you're willing to work the character. A combination of information overload and a tendency to give people the benefit of the doubt - especially if there is (as yet) little competition for whatever niche you're trying to occupy. people are predisposed (and media people almost pathologically so) to assume benign or benevolent intent in the absence of better (or any alternate) sources of truth.

To wit: I'm cofounder and senior researcher at The Center For Decentralization. We have business cards, phone numbers, offered a free consultation service to budding decentralists who were interested in shaping public policy, a social media presence, the whole deal. For a little while we even sent representatives to Congressional meetings and had an office in DC. I have no official credentials in this area. And I'm also the only co-founder, because a decentralist mustbtake care to avoid any language that makes it sound like you're the center of the thing you're trying to decentralize. Which, naturally and inescapably, you are.

I started TCFD as a parody to point out the fundamental paradoxes arising when one affects to be sponsoring or causing decentralization to happen, whether as an individual or a group of individuals. I thought the joke would be obvious to anyone the moment they saw our business card or heard the name, but was rather astounded to to discover that about half of the people I introduced myself to as "senior researcher, primus inter pares" completely took it seriously.

Re: Texas professor fails entire class from graduating- claiming they used ChatGTP

#253
post #21

Wow, even if the professor assigned using ChatGPT they would not get 100% adoption. Classes have really heterogeneous behavior.

My son told me about an assignment he had where, due to a tight timeline, the homework wouldn't be corrected and returned until after the mid-term which covered that material. The professor didn't feel this was fair, so gave the students a freebie where he posted the solutions along with the homework and no restriction on how the students used it.

In an ideal world, students would still work the problems and then identify/correct their mistakes. There was no penalty for simply copying the answer key. There were still students who either didn't do the assignment or turned in homework with half of the answers incorrect.

Re: Texas professor fails entire class from graduating- claiming they used ChatGTP

#254

Earlier quoted context omitted.

For programming CS exams, you can try doing them in a computer lab with internet disabled. These exams should be allotted time much more than needed as one should not be testing for problem solving under strict time constraints. FYI its oral exams, not oral presentations. You give the student half an hour to solve a sequence of problems and gauge their thinking skills. Scales to perhaps 30 students at most.

> FYI its oral exams, not oral presentations. I was not very clear about it, but I was discussing regular semester work, as opposed to final/midterm exams. Think courses that are strongly grounded in theory but need the students to experience the coursework, like Discrete Mathematics or Linear Programming. "Oral presentations" in my case meant presenting a homework solution to the TA in person, in front of the class,…

> I was discussing regular semester work, as opposed to final/midterm exams

In my experience, these are completely useless for any core course as you mention. I have tried stuff like this in my courses, and it doesn't work. In fact, I know some students pay others to make the presentation for them, and coach them on the presentation.

Even for course projects, I have graded meetings with students before the final presentation/report. This helps ensure that they are doing the work themselves rather than depending on others. But yes, this takes a lot of time.

> Some other teachers (as well as the administration) prefer written exams, as there is a clear proof of work that can be analyzed if grades are disputed.

Video record them, my friend.

Re: Texas professor fails entire class from graduating- claiming they used ChatGTP

#255
post #230

Earlier quoted context omitted.

Indeed there’s one screenshot showing ChatGPT claim it wrote the professor’s email. How embarrassing.

What if, to spite the students, he asked ChatGPT to write the email for him?

The thread also has an example of ChatGPT claiming to have written one of the professor's own papers.

Re: Texas professor fails entire class from graduating- claiming they used ChatGTP

#256
post #66

Professors might consider including ChatGPT in the assignment: Get ChatGPT to generate the pest output possible using your prompting skills (show the prompt work and progression), then critique it, find and distinguish the accurate parts and hallucinations (citing actual hardcopy book references). Students would have to both show knowledge of the topic and show knowledge of skilled use of LLMs (which should be a usef…

How is "skilled use of LLMs" a relevant skill in agricultural science?

It seems that "skilled use of LLMs" is becoming a relevant skill almost everywhere. It is obviously relevant to their course, so...

Re: Texas professor fails entire class from graduating- claiming they used ChatGTP

#257

Earlier quoted context omitted.

I just had ChatGPT write me a poem, and then in a new session, pasted the poem back in and asked it if it wrote it. The response? "No, I did not write that poem. I am an AI language model, and I generate responses based on patterns and information in the data I have been trained on. I don't have the capability to write original poems or claim authorship of any specific text."

The thing about LLMs that a lot of people haven't cottoned onto yet is that they're essentially constantly lying. They have no concept of truth and also no concept of certainty. This makes them much less useful for a lot of tasks then people realize.

Yeah, this has been pretty obvious to me within the first 15 minutes interacting with it. It's just a bullshit a generator. If I wanted that, I would go hang out at the used car lot. So I don't use chatGPT. The amount of hype around this thing is astounding.

Re: Texas professor fails entire class from graduating- claiming they used ChatGTP

#258
post #28

The ability to 'cheat' on written assignments has always been a possibility. With the rise of the Internet, it became easier to source it from more places - with a counter balancing rise of plagiarism detectors. Now with Google, Grammarly and ChatGPT, it is trivial to copy/paste a pipeline with enough entropy to defeat many if not most detectors. I suspect the next generation of tools will be finish this cycle - we w…

Better yet! Use gpt and other ml to increase efficiency of assessments so that students can be measured more accurately, frequently and inexpensively than with human developed traditional paper/pencil items. Next, increase instructional efficiency by using gpt to tutor students individually. Lastly, remove the costly overhead of educational administration by automating the paperwork of school and district offices. Bu…

Or just do blue book exams . . .

https://en.wikipedia.org/wiki/Blue_book_exam

Re: Texas professor fails entire class from graduating- claiming they used ChatGTP

#259

Earlier quoted context omitted.

As someone who was a student over a decade ago, I'd lose my fucking mind if I had to use physical books. There was simply not enough time to go get books off the shelf and complete all my assignments. Everything was done digitally, I can't think of a single exception in college. I once turned in a math exam written using LaTeX and the professor initially declined to grade it. I did concede that I hadn't followed the…

Huh what major were you? As a math major we used exclusively physical books and it was fine. There was one time that the professor wanted us to use a theorem in a homework assignment from a book he neglected to assign to us for the class. The entire class collaborated on that problem set and emailed him for help, and he admitted he'd made a mistake and lent us a copy of the book. That was probably the biggest can't-u…

> simply not enough time to go get books off the shelf and complete all my assignments

Why bother with books when it's so easy to fabricate?

Re: Texas professor fails entire class from graduating- claiming they used ChatGTP

#260

Earlier quoted context omitted.

Self-awareness isn't a requirement for the presentation of information, which LLMs continually prove. Is every answer thus not a hallucination by this logic? If it's trained on external information, why would this information not include observations and information made about it? A human doesn't need to be able to even read to present a book to someone else with contextually relevant information.

What I meant is that it can’t self-introspect and work out how its own thought processes work. It can only know that if it was in its training data or given to the model in some other way, it’s not (yet?) possible for it to know about its inner workings just from working it out But this is true of humans in many cases too It’s training data is from 2021, so it won’t contain anything about how ChatGPT works, maybe a b…

At some point it will be trained on data that describes itself, which will make it self-aware in a way that will probably prompt much argument about what precisely we mean by the concept of self-awareness.
Post reply on HN