That just sounds like coordinate gradient descent on a multi-term objective function. Just same old optimization but with some metaparameters or component-wise conditioning.
In fact, I think to argue against optimization, you’d basically have to boil it down to existing philosophical arguments against utilitarianism.
Either way, I’m skeptical if this conclusion is very connected to Goodhart’s Law, because it assumes some type of normative axiom that would have to precede your interpretation of Goodhart’s Law.
My main interest was to pointout that it creates a sort of impossibility theorem situation if you accept Goodhart’s Law (I don’t personally accept it as a general rule, only something that applies to some types of measures and not others).
The impossibility criteria would be something like:
- If one finds a good measure, one should optimize it.
- If a measure is an optimization target, it is not a good measure.
- For a given entity, there exists a set of variables governing how well that entity can meet a goal (e.g. measures can possibly contain relevant information).
Basically you could only choose 2.
- If you pick the first two, it means there are no general variables governing the outcone you want; they are constantly changing and fundamentally unpredictable, so you might get away with optimizing something briefly, but its informativeness immediately disappears. This type of thinking is common in efficient market theory, for example, and could be connected to a fundamental belief about non-determinism or non-stationarity.
- If you choose the first and third, it seems like standard utilitarianism.
- If you choose the latter two, it seems like fatalism or religion — there are quantities that govern achieving desired outcomes, but they cannot be treated as objective optimization criteria and can only be analyzed subjectively or fatalistically.