Earlier quoted context omitted.
>does not make the test itself invalid for comparison across cultures If you can't accurately quantify the cultural component, then yes it does. >Claims that basic pattern recognition is somehow not a valid means of assessment across cultures are dubious at best. Basic pattern recognition isn't the only thing that's being measured--that's the problem. Even something as simple as how often a student has been exposed t…
If it’s the best thing we have, then it’s worth using. You are proposing no alternative.
Wrong information is often worse than no information.
That's one of the problems with PISA results. Policy makers look at other countries with higher scores and try to emulate them without understanding why their scores are higher. In that case it's just cargo culting education.
This doesn't mean that standardized testing is completely useless, but you have to know the limitations, and comparing results between cultures is one of the limitations.