Earlier quoted context omitted.
Standardized testing is usually foiled by Goodhart's law. If the outcomes of the tests matter, schools start focusing on test prep, at the expense of actual education. It's probably necessary to have one set of standardized tests for college admission, but otherwise they should be abolished, because they are a terrible idea. Separation of responsibilities is the actual key to good public schools. At least to the exte…
Test prep and actual education don’t have to be all that different. If the test is hard and comprehensive (ie random enough) preparing for the test will teach you a lot. You see this with the SATs where people preparing for it digest 3000+ vocabulary words, write tons of sample essays and really dig into grammar. Same with the MCATs, foreign doctors spend 1-2 preparing for the MCATs and because the tests are so compr…
The ability to solve hard problems in artificial test conditions is a useful proxy for having learned what is being tested. But only if the test itself is irrelevant. If your future depends on test scores, most people start focusing on what is being tested over what they are actually supposed to learn.
All measurements are proxies. They never measure the thing they are supposed to. That's the essence of Goodhart's law. When people focus on what is being measured, they usually perform worse on whatever it was supposed to measure.
The actual quality of education is your overall contribution to the society over the expected baseline. It can never be measured for individuals but only in aggregate. And only decades after the fact.