The Data/Human Goal Gap
ken.arneson.name
The Data/Human Goal Gap
1–10 of 13 posts
Re: The Data/Human Goal Gap
#2Usually the metrics we measure are an indirect substitute for what we actually want to measure, e.g., lines of code as a measure of programmer productivity. What inevitably happens is that behaviour is optimised for the metric, and not what the metric was intending to measure. It's really just gaming the system.
Re: The Data/Human Goal Gap
#3Though in half his examples (education, politics, baseball), the complaint actually seems to be "other people don't share my goals".
What this has to do with measurement, I have no idea. Would this problem occur less if we non-quantitatively tried to achieve the wrong goal?
Re: The Data/Human Goal Gap
#4Re: The Data/Human Goal Gap
#5Tl;dr if you don't know what your goals are, you won't achieve them. Shocking! Though in half his examples (education, politics, baseball), the complaint actually seems to be "other people don't share my goals". What this has to do with measurement, I have no idea. Would this problem occur less if we non-quantitatively tried to achieve the wrong goal?
I guess. But i think what he is driving at is, in data driven world, we can lose sight of bigger picture ie in quest for test scores we can unreasonably stress kids out, in quest for profits we can shit on employees and the environment, etc.
Just taking the last point, people generally like parks and nature. What person would say "oh yes id love to pollute my closest river?"
but then suppose you ran a factory on a river, and it would cost your company 90% of profits to dispose of your factory's waste in an environmentally sound way, and you are measured on how much profits you bring in. Or you can dump in the river for free.
Would you choose to dump your waste into the river? I think most people would.
Re: The Data/Human Goal Gap
#6https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Campbell%27s_law https://en.wikipedia.org/wiki/Reification_(fallacy)
Re: The Data/Human Goal Gap
#7Re: The Data/Human Goal Gap
#8Tl;dr if you don't know what your goals are, you won't achieve them. Shocking! Though in half his examples (education, politics, baseball), the complaint actually seems to be "other people don't share my goals". What this has to do with measurement, I have no idea. Would this problem occur less if we non-quantitatively tried to achieve the wrong goal?
the complaint actually seems to be "other people don't share my goals I guess. But i think what he is driving at is, in data driven world, we can lose sight of bigger picture ie in quest for test scores we can unreasonably stress kids out, in quest for profits we can shit on employees and the environment, etc. Just taking the last point, people generally like parks and nature. What person would say "oh yes id love to…
Re: The Data/Human Goal Gap
#9One solution to this problem is making "flipped classroom" a mandatory at all the schools.i.e. students go thru lectures/videos at home and do homework collaboratively in the Classroom. The Real world is more collaborative compared to our schools. Flipped Classroom is proven to increase scores as well. Question: What efforts are you willing to put in making this happen?
Edit: grammar