Earlier quoted context omitted.
But many of the tests aren’t binary in outcome, like ravens progressive matrices or N back.
The problem is not whether the answer is binary. The problem is that the author of the test needs to have at least the same level of intelligence (and probably even higher) than what the test is measuring. Otherwise how can you tell if the answer is correct? So to get a good IQ score one needs to be able to figure out what a test designer (with average IQ) thought the correct answer should be.
For example: By taking much more time and access to all literature while designing the test, which differs from the test protocol.
IQ tests aren't quizzes: you don't need to be "clever" to design them, you need to know which aspect of thought process you want to measure.
The value comes from their stability: there are tons of tests based on different methodologies and different focus points and still they roughly agree on their ranking, and remain relatively stable for individuals over time.