Live data from Hacker News

Under Pressure, Teachers Tamper With Test Scores

nytimes.com

11–20 of 42 posts

Re: Under Pressure, Teachers Tamper With Test Scores

#11
post #3

“Educators feel that their schools’ reputation, their livelihoods, their psychic meaning in life is at stake,” said Robert Schaeffer, public education director for FairTest, a nonprofit group critical of standardized testing. “That ends up pushing more and more of them over the line.” There is a certain strain of teacher who never felt their reputation, livelihood, or psychic essence was at danger when they were mere…

This is one place where cheaters can really ruin a system. Once cheaters invade, they can hurt everyone by raising expectations of what can be done. Worse, too often, the natural tendency is to raise the standards if some cheating is uncovered.

If you raise your standards high enough, those who were formerly honest will be forced into cheating while those who remain honest are forced out. If you raise standards high enough, you end up with only cheaters, because past some threshold, it's no longer possible to meet expectations honestly.

Re: Under Pressure, Teachers Tamper With Test Scores

#12
post #9
post #4

This shouldn't be a surprise. When you create strong incentives for someone to do something, they'll probably do it.

Like embezzlement shouldn't be a surprise. I agree, this is predictable, and in a just world our response would be predictable, too: if you falsify test scores to get a $2,970 bonus, you get kicked out of the profession, just like if you took $2,970 out of the drawer as a bank teller and tried to pocket it. (n.b. While acknowledging that 95% of bank tellers are morally upright individuals, we devise our systems under…

There's an interesting difference between the situations.

If you're a bank teller, your whole job is to manage the flow of money and information to and from customers of the bank, the ultimate goal being to make more money for the bank. If you take $3k out of the drawer, then you have failed at your immediate task (money has gone to the wrong place) and worked against the overall purpose of your job (the bank has less money, rather than more).

If you're a teacher, the heart of your job is (or should be) teaching your pupils: enabling them to know more and think better and so forth. A secondary purpose (the real purpose, according to some cynics) is to keep them out of their parents' hair and off the streets for a few hours every day. Another (subsidiary to the first, in an ideal world) is enabling them to do as well as possible in whatever external examinations they take, in the hope that it'll help them in later life. Arranging for your pupils' standardized test scores not to be too high comes very low down that list -- and if you get away with it, it benefits your pupils and your school. (While harming other pupils and other schools and other people generally, by making the test results less useful. Tragedy of the commons.)

That's not to say that it's not very bad for teachers to cheat to get better test results for their pupils. But it's bad in a different way from a bank teller's embezzlement: peripheral to their job rather than central, and immediately beneficial rather than harmful to the people you're supposed to be working for.

A better analogy (though perhaps an overdramatic one, given recent economic events) would be a mortgage salesperson, working for a mortgage broker, who sells people mortgages they are too likely to default on. When that happens, the salesperson gets more commission; his employer, the broker, gets more commission; the person who buys the mortgage gets a mortgage they want and otherwise couldn't have had (and, let's say, does manage to keep up the payments in 90% of cases, fails to do so but not so badly that they lose their home in 5% of cases, and crashes hard in 5% of cases -- which is probably kinda parallel to the outcomes for pupils whose test scores are inflated); other people, less directly connected with the broker, are the ones who get screwed.

Anyone expect mortgage salespeople who sell a bit too enthusiastically to get kicked out of their profession en masse? ... No, nor me.

> In the world we actually live in ... you'll probably not miss a day of class.

That doesn't appear to be what happened in the cases in the NYT article.

Re: Under Pressure, Teachers Tamper With Test Scores

#14
post #10

That cheating occurs is no surprise and is closely related to the question of assessing a programmer's output. Every time you instigate a method of measurement, the programmer (or teacher) finds some way to increase the result without achieving the actual aim. In the case of a programmer, the number of lines of code output, or the number of functions written, or the number of bugs detected and fixed, can all be achie…

See I think that these sorts of tests are looking at the wrong sorts of things. What they should be looking for is relative improvement rather than reaching a particular level. Especially in underprivileged areas, where the kids might be doing much more poorly than more privileged areas. Don't get me wrong, I think that if there are poor teachers then they should be dealt with, but I think that these standardised tes…

Most teacher and school assessments in the UK are based exactly on that - achieved improvement versus expected improvement. Schools in underpriveleged areas and which perform poorly on standardised tests still themselves score well if the results are "good given the context and circumstances."

The tragedy is that teachers who don't teach to the test and provide an excellent education that is tailored to the children they have are starting to worry about the security of their jobs, whereas poor teachers who have no real ability except to regurgitate the texts and drill the kids on process and recitation are relatively safe.

Re: Under Pressure, Teachers Tamper With Test Scores

#15
post #11
post #3

“Educators feel that their schools’ reputation, their livelihoods, their psychic meaning in life is at stake,” said Robert Schaeffer, public education director for FairTest, a nonprofit group critical of standardized testing. “That ends up pushing more and more of them over the line.” There is a certain strain of teacher who never felt their reputation, livelihood, or psychic essence was at danger when they were mere…

This is one place where cheaters can really ruin a system. Once cheaters invade, they can hurt everyone by raising expectations of what can be done. Worse, too often, the natural tendency is to raise the standards if some cheating is uncovered. If you raise your standards high enough, those who were formerly honest will be forced into cheating while those who remain honest are forced out. If you raise standards high…

If you raise standards high enough, you end up with only cheaters, because past some threshold, it's no longer possible to meet expectations honestly.

Evidence for this empirical statement?

Re: Under Pressure, Teachers Tamper With Test Scores

#16
post #10

Earlier quoted context omitted.

See I think that these sorts of tests are looking at the wrong sorts of things. What they should be looking for is relative improvement rather than reaching a particular level. Especially in underprivileged areas, where the kids might be doing much more poorly than more privileged areas. Don't get me wrong, I think that if there are poor teachers then they should be dealt with, but I think that these standardised tes…

Most teacher and school assessments in the UK are based exactly on that - achieved improvement versus expected improvement. Schools in underpriveleged areas and which perform poorly on standardised tests still themselves score well if the results are "good given the context and circumstances." The tragedy is that teachers who don't teach to the test and provide an excellent education that is tailored to the children…

The tragedy is that teachers who don't teach to the test and provide an excellent education that is tailored to the children they have are starting to worry about the security of their jobs, whereas poor teachers who have no real ability except to regurgitate the texts and drill the kids on process and recitation are relatively safe.

Evidence for this empirical statement? I have my doubts about this, because the best teachers I had in childhood (too few, but more than one) were able both to engage the pupils from the dullest to the brightest with deep, thoughtful questions and able to cover the fundamental facts of the lessons with efficiency.

Re: Under Pressure, Teachers Tamper With Test Scores

#17
post #11

Earlier quoted context omitted.

This is one place where cheaters can really ruin a system. Once cheaters invade, they can hurt everyone by raising expectations of what can be done. Worse, too often, the natural tendency is to raise the standards if some cheating is uncovered. If you raise your standards high enough, those who were formerly honest will be forced into cheating while those who remain honest are forced out. If you raise standards high…

If you raise standards high enough, you end up with only cheaters, because past some threshold, it's no longer possible to meet expectations honestly. Evidence for this empirical statement?

[deleted]

Re: Under Pressure, Teachers Tamper With Test Scores

#18
post #3

“Educators feel that their schools’ reputation, their livelihoods, their psychic meaning in life is at stake,” said Robert Schaeffer, public education director for FairTest, a nonprofit group critical of standardized testing. “That ends up pushing more and more of them over the line.” There is a certain strain of teacher who never felt their reputation, livelihood, or psychic essence was at danger when they were mere…

While completely true, it also glosses over the bigger problem. Not All Kids Can Learn The Same. Every single child is completely different, and has a different learning capacity and developmental time line. A child who can barely read in 3rd grade may be left behind his peers for ever, OR, he may suddenly 'get it' in 4th grade, and rapidly catch up. K-3, however, he's going to fail those standardized tests, and there isn't a damn thing his teacher can do about it. Holding every child to the same standard at the same age arbitrarily is ridiculous, and ignores the way kids actually grow and develop. It also has completely eliminated 'teaching' for all of those teachers who WERE awesome teachers, and who cared and poured their heart and soul into their lessons and kids. EVERYBODY is now essentially forced to teach to an arbitrary test, developed by academics (and lawmakers) who don't actually deal with children (anymore).

Poor black kids are going to stay lower than everyone else, because poor black kids, statistically, have much less family involvement, and a (again, statistically), substantially less 'structured' home life. THIS is the number one problem with the low end of the socio-economic academic performance ladder. Rich white kids and poor black kids attending the same class, at the same school, will not perform the same, unless the parents are both involved to the same amount. Making everybody take tests to prove this out doesn't accomplish anything. Firing teachers because parents won't do anything to help their children also does not accomplish anything.

This issue is near and dear to me - I worked in one of the school districts cited in the NYT article for 7 years, and my wife is currently teaching there. It's a farce.

Re: Under Pressure, Teachers Tamper With Test Scores

#19

Earlier quoted context omitted.

Most teacher and school assessments in the UK are based exactly on that - achieved improvement versus expected improvement. Schools in underpriveleged areas and which perform poorly on standardised tests still themselves score well if the results are "good given the context and circumstances." The tragedy is that teachers who don't teach to the test and provide an excellent education that is tailored to the children…

The tragedy is that teachers who don't teach to the test and provide an excellent education that is tailored to the children they have are starting to worry about the security of their jobs, whereas poor teachers who have no real ability except to regurgitate the texts and drill the kids on process and recitation are relatively safe. Evidence for this empirical statement? I have my doubts about this, because the best…

I concur with him based on being married to a teacher, and interacting with a bunch of teachers on a near daily basis.

This is all they talk about after school...

Re: Under Pressure, Teachers Tamper With Test Scores

#20

I hope some teachers "cheated" on the tests for principled reasons, not just for personal reward, like this UMass teacher: http://books.google.com/books?id=x3ertj1IcaAC&lpg=PA62&#...

To clarify, MOST school districts are not giving financial or other rewards for passing the exams at an acceptable level, it's simply expected to occur.
Post reply on HN