Student reviews are also ridiculously sexist in the average case. In a recent study, the students rated identical teachers differently enough by gender that actual teaching performance was lost in the noise: https://academic.oup.com/jeea/advance-article-abstract/doi/1... Another pair of studies showed that identical courses where students thought instructors were male rated higher than those that had a female profess…
students rated identical teachers Did you actually read critically the papers you cite? [1] claims to be comparing "identical teachers" but [1]'s sole claim to courses taught by male and female instructors is " neither students’ grades nor self-study hours are affected by the instructor’s gender ". Clearly those are hardly the only factors relevant to teacher quality. Moreover [1] claims to use "objective measure of…
Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
141–150 of 244 posts
Re: Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
#142Earlier quoted context omitted.
> as students are graded on their studying skills, I feel like teachers should be graded every fews years on their teaching skills If a teacher grades a student poorly, there can be repercussions. They have an incentive to grade fairly and accurately. The same isn't true of students, who can grade on feelings and grudges. Teachers are also subject matter experts in the material being graded. Students aren't trained a…
Students are the only people who can really evaluate the quality of teaching. Someone with a pre-existing understanding of the material cannot tell whether the class can successfully communicate it to a fresh mind. A few negative evaluations based on personal disputes can be expected. If there are grudges or strong feelings among a large enough proportion of students to meaningfully influence the aggregates, then som…
I have seen this work well for the end of highschool test (prepared every half year), participated on the mailing list purely as an observer (where teachers discussed edge cases - and there was/is a process to get official guidance from the test writer group, but not directly, so that provides a bit of blinding against biases).
As long as we try to let teachers cope by themselves (and maybe give them a few TAs in higher ed), and don't make their work testable, we're bound to have wild theories fueled by anecdata.
Re: Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
#143Earlier quoted context omitted.
If anything you would think professors would welcome reviews. They already get reviewed anyways. It's just word of mouth. At least a student could see a much wider range of opinions vs one person's experience.
We know we get reviewed anyway. What we're pushing back against is these reviews getting turned into yet another semi-useless, noisy and biased metric we're evaluated by. You want to recommend for/against a class to your friends? Don't care. What I'm not interested in is my dean pretending there's deep insight there.
It should not be used as precise metric of performance, but as a general trend overall. Instead of one friend giving a bad review for whatever reason, now I have access to the hundreds of bad experiences or the 99/100 good experiences.
As a student I really don't care about the dean professor relationship. I am a paying customer of the institution. I want to know if that professor is worth taking their class.
Also if you don't care about students giving praise/negative reviews to a friend, that kind of says something.
Re: Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
#144One of the main problems with the educational system is that students are evaluated by the same person that teaches them. If the teacher wasn’t the one grading the mean grade of the students would be a decent evaluation of the performance of teacher.
If another professor wrote the exams for a class they didn't sit in, you'd have the students screaming in unison, "this wasn't discussed in class!" Not exactly disagreeing with the idea, but students have been normalized to the idea that, with enough studying and concentration, any exam can be aced. When they feel like they've been cheated by the system they get discouraged, making a harmful learning experience.
Furthermore it forces teachers to communicate the requurements, the curriculum and sillabus well to the exam writers and graders.
Re: Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
#145This is obviously anecdotal but in my experience these ratings seem to reflect my perceived quality of the lectures quite well.
Re: Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
#146As a teacher, I disagree strongly with the conclusions of this article. Anonymous student evaluations are an invaluable tool to improve my teaching. The students say so many fair and useful things!
I think the problem is when student evaluation have an affect (positive or negative) on the teacher career.
Re: Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
#147Student reviews are also ridiculously sexist in the average case. In a recent study, the students rated identical teachers differently enough by gender that actual teaching performance was lost in the noise: https://academic.oup.com/jeea/advance-article-abstract/doi/1... Another pair of studies showed that identical courses where students thought instructors were male rated higher than those that had a female profess…
students rated identical teachers Did you actually read critically the papers you cite? [1] claims to be comparing "identical teachers" but [1]'s sole claim to courses taught by male and female instructors is " neither students’ grades nor self-study hours are affected by the instructor’s gender ". Clearly those are hardly the only factors relevant to teacher quality. Moreover [1] claims to use "objective measure of…
Re: Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
#148I'm pretty skeptical of the claims in this - it'd be interesting to see actual data. Evaluations are one of the extremely few levers students actually have to pull when dealing with a terrible teacher. I'd expect that given an entire class' worth of evaluations you'd be able to strip outliers and get some genuine useful responses. Though the worst professor I had at RPI held our grades hostage until the evaluations w…
In America teachers get tenure so your feedback has no impact on them improving. Also if you look at literally any study of them TAs for harder courses get harsher ratings, they get harsher ratings from weaker students. I also spent a number of years as a TA I can say anecdotally that is my exact first hand experience - good reviews in easy courses like graphics, atrocious scores in design of concurrent systems. In f…
Do they reuse past questions forever? That is a bad practice. Each term's exams need to be equivalent but different.
Re: Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
#149This is the age-old doctor question. You go to the doctor's office because you have a medical problem. Doctor 1 comes in on-time, she's smart, capable, friendly, and spends a good amount of time concerned about you and your situation. Doctor 2 comes in late, she's irascible, pedantic, hurried, and only listens long enough to tell you what to do. She also insults you and your family in various ways and doesn't seem to…
Pre-register patient problems, and see how fast doctors solve problems on average/median. Then it doesn't matter how jovial/amicable the doc is.
With enough data you can fish out potential signals (and then test them properly), maybe bedside manner really doesn't matter, maybe being on time is more important. (Because then people spend less time in the clinic among other sick people.)
And as others mentioned the teacher eval problem can be solved by splitting the lecturer, exam writer and grader roles. (Grading should be done by a book written as edge cases accumulate, edge cases should be handled without names to prevent bias, as much as possible.) And then aggregate stats can be published about each class and school.
Re: Students Evaluating Teachers Doesn’t Just Hurt Teachers, It Hurts Students
#150Possible alternative method is to hire and train students to be observers, both covert and overt. Put them into classes as if they were students, and those students Would then Evaluate that professor. It could work especially cross colleges, where those students will never naturally take classes by that professor.
I don't think this is effective, but it happens.