Earlier quoted context omitted.
If the test accurately reflects the course material, is there a difference?
The problem is (at least) three-fold. One: The tail wags the dog. Since No Child Left Behind, schools have had one major metric: test scores. They have now geared everything else towards making test scores improve, from curriculum to teaching how to take a test. So the test drives all. Two: Tests are not necessarily a great way to assess mastery of material. The fact that teaching test-taking strategies can dramatica…
If you give this training to everyone (note: it doesn't take that much time), everyone receives the dramatic improvement due to test-strategy education, and test scores become comparable again.
Tests [...], of necessity, have to be far more limited in scope than what we (should) want to educate people on.
Please explain. Is the concern simply that tests are only a statistically representative sampling of things the student should know, rather than the actual knowledge?
That's true. Similarly, a map of America isn't actually America. Doesn't mean it isn't useful.