Earlier quoted context omitted.
> Making education policy without measuring outcomes in a rigorous way is like doing science without running experiments. It's worse to present an experiment as objective without properly measuring its error bars. As I have pointed out, there are a million different factors that can influence performance on tests. Claiming that you are "measuring outcomes in a rigorous way" from these tests without putting in the tim…
I read you to be dismissing tests outright. If you merely want to stipulate that the test scores are subjected to rigorous statistical analyses that "properly measure its error bars" we are in total agreement.
I am saying that the system should fail open in their absence. "Students' achievement dropped 50 points!" makes for a really potent policy cudgel. "Students' learning dropped 50 points, +/- 40" is silly and meaningless. The former should never be available, unless the +/- is explicitly mentioned.
This is similar to prescription medicines. We have a lot of prescription medicines that do great things, which no one is debating. But without a proper evaluation process, you have zero access to them. Test assessments should be similar in my opinion.