Live data from Hacker News

Limitations of Goodhart's Law

commoncog.com

51–53 of 53 posts

Re: Limitations of Goodhart's Law

#51
post #25
post #11

Earlier quoted context omitted.

> Goodhart's law . . . is certainly not a law A scientific law is a description of a common pattern. It's not a rule voted into being by the reality legislature and enforced by nature beat cops. Goodhart's certainly is a law. > Goodhart's law (mis)applied to discussions of machine learning pipelines, so clearly there are glaring exceptions to the utility of metrics. How can an alleged misapplication of Goodhart's law…

It's not a scientific law. It's a meme law, broadly applicable but not always true. Scientific laws have no counterexamples, only refinements.

Goodhart was an economist who stated his eponymous law in 1975, before Dawkins's The Selfish Gene (origin of "meme") was published in 1976. So Goodhart was not meme-ing.

If you want to argue that economics isn't science or isn't hard science, fine.

But law is used here in the sense of scientific law nevertheless.

https://en.wikipedia.org/wiki/Category:Economics_laws

Re: Limitations of Goodhart's Law

#52

Although this is an insightful article with many good points, I am disappointed that the author didn't mention a more fundamental problem with metrics: that the very framing of business that leads to a focus on metrics is toxic to responsible business practices. The author talks a lot about listening to the voice of the process. How about listening to the voice of people? For instance, people who are concerned that w…

There are a lot of production-focused businesses where metrics are one of the most sensible, predictable ways to run the business. Are you going to listen to the opinions of 2000 auto manufacturing employees to know how things are going or look at completed cars and initial defects reported?
Post reply on HN