Live data from Hacker News

Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

en.wikipedia.org

111–120 of 137 posts

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#111

This is probably where I should mention my two longer articles that discuss this in depth; https://www.ribbonfarm.com/2016/06/09/goodharts-law-and-why-... https://www.ribbonfarm.com/2016/09/29/soft-bias-of-underspec... As well as my more recent paper categorizing the different ways it occurs; https://arxiv.org/abs/1803.04585

Since you’re here, what does the following property stand for in your second paper? s ∈ AifM(s)/gec

[deleted]

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#112
post #72

Earlier quoted context omitted.

> interviewer replied "that's a dumb answer a bit ot, but was that the actual response? personally, stuff like this would have me ending the interview early.

And what is your gentle phrasing for that action?

It's an interview, not a competition. The interviewer would've been much better of asking: "Why?"

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#113

During the Vietnam War, it was body count. That turned out to be a great way of incentivizing the most murderous troops.

Probably more of an incentive for NCO's and Officers to overclaim the results, so they look good to their superiors.

I recall the Luftwaffe ace rolls for the invasion of Poland reporting that 300% of the Polish tanks fielded had been destroyed.

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#114
post #20

Earlier quoted context omitted.

So then you add “size of customer base” to your metrics!

Doing so in a large software company would likely result in Sales & Marketing being empowered. Which in turn will likely lead to technical debt (as the company stretches to meet impractical promises), as well as stagnation in Engineering (S&M are delivering on the metrics, so they get promoted). In general, large organizations are like an AI. In this case, making a goal that won't backfire when applied without though…

That's why the goal in so many large public companies becomes "Make the stock price go up." If the stock price goes up, the executives and everyone else in the company with stock can unload it, take the cash, and let the new shareholders deal with any long-term consequences of their actions.

This works great up until it doesn't.

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#115

And as soon as a measure becomes known, it becomes the target. IMO, the law ought to be "As soon as a measure becomes known it ceases to become a good measure." "I'm fat because I can't touch my toes? Hang on, I'll be back in three weeks." "What's that? Your measure for gas consumption and co2 emissions has you go exactly 35 MPH for 10 minutes? Hmm....."

Before the VW diesel cheating scandal, it was alleged that US manufacturers were taking advantage of the EPA's test cycle procedure to "tune" ECM values when the dome light was active.

More than that, CAFE standards have become the ceiling for fuel economy rather than the envisioned floor. Manufacturers game the system by classifying certain cars as SUVs, claiming extra credit for the ability to run E85, or practically giving away efficient but undesirable vehicle configurations in order to just meet the target and avoid the gas guzzler tax.

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#116
post #99

Earlier quoted context omitted.

If the North didn't have a capable fighting force any more, and still overwhelmed the South shortly after the US withdrew, that means the US did not actually establish a "a viable and increasingly democratic society" during the time it had a military presence there. Societal viability includes, at a minimum, being able to survive one's enemies. Enemies that were already drastically weakened during the period of US in…

Societal viability includes, at a minimum, being able to survive one's enemies. By that argument, all of western Europe didn't save a viable society since Germany was able to defeat them. I don't agree with that.

I'd agree with that, actually.

France today is not the same as France in 1939 - the period from 1870-1940 is generally considered the French Third Republic, and they're on the Fifth Republic now. Poland today is not the same as Poland in 1939. Germany today is certainly not the same as Germany in 1939. Not only are the people in charge different, but the whole system of government is different, the cultural values are different, and many of the cities were rebuilt from the ground up.

Just because a society collapses doesn't mean the people disappear, or even that they start to think of themselves as a different nationality. Society is all of the organizational superstructure on top of that, and barring rare cases like governments-in-exile-that-can-pick-up-where-they-left-off-when-liberated, that usually doesn't survive being defeated in warfare.

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#117

Earlier quoted context omitted.

I'm sorry but this is a serious (and arguably offensive) falsehood. A 'free fire' zone is an area wherein there is no requirement for soldiers to coordinate heavy arms fire with other units via HQ etc.. This is a very reasonable policy in jungle fights where units can come under ambush at any time, i.e. "We're in an ambush and we're about to die, can you ring up HQ to see if we can shoot back?" But the notion that US…

I'm sorry but this is a serious (and arguably offensive) falsehood. I'm sorry, but I will show you to be mistaken below. But the notion that US forces would just designate an area where everyone including civilians are to be killed is an outright and offensive lie. Then you should have an issue with the Ken Burns documentary. I think I got the terminology wrong; "free fire zone" means something else. However, the pra…

This is disgusting for HN. I debunk what the gp post says with citations and quotes. The result? I get downvoted more.

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#118

Earlier quoted context omitted.

>The US handily won the Vietnam war, full stop. >In classical terms is was a clear and unambiguous outright victory. The only measure of success is whether or not you accomplish your objectives. The US did not accomplish its objectives in Vietnam of keeping a US-friendly government in power. Regardless of tactical measures of success, the US failed in its strategic objectives. I agree that popular culture has not acc…

" The US did not accomplish its objectives in Vietnam of keeping a US-friendly government in power" Yes. They did. While there was conflict. Then they left, and effectively abandoned those objectives. When the North Vietnamese rebuilt it's army and re-invaded the South - propping up the S. Vietnamese government was obviously no longer a military objective, and barely a political one. So the US won a war, withdrew, an…

The US failed to achieve a South Vietnamese gov't that had reasonable support from the general populace, which was nominally on the list of US policy goals since the beginning, but was gamed at every step of the way.

Until such was achieved, we had _always_ lost the war. Winning battles, paid for with American blood, was only a means of temporarily staving off the likely collapse for another year or two.

As for "abandoned", what does that even mean? The South had: large material advantages in artillery, vehicles, and AFVs; a significant air force (2000 craft), plus >10 years of a huge US training effort.

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#119

Earlier quoted context omitted.

I'm not making any contradictions. The Americans defeated the Viet Kong insurgency and the North Vietnamese, and then withdrew shortly thereafter. After a few years, the North Vietnamese were able to rebuild their Army. They invaded and toppled South Vietnam. Again, my point: people don't seem to have any idea of what actually happened.

I think Goodhart's law gives us a good insight. If the actual goal was to ensure the long term viability of a democratic South Vietnam, the endeavor failed. So what happened, is that the US government "gamed" it by targeting "Body Count" and "winning all the battles." In doing so, it failed to achieve the actual goal in its long term interest.

Ahhh - thanks for getting to the crux of the matter:

The military objectives were 'gamed' by using 'body count' which mislead us in terms of progress.(Actually, they were not 'gamed' so much as the old metric of 'body count' was not useful in this type of insurgency - so more a matter of 'lack of insight').

BUT - the strategic objectives did not fail for this reason.

The military objectives of defeating the VC and North Vietnamese were still outright successful. Despite all the challenges, it was a definitive military victory for the US: VC wiped out, North Vietnamese totally neutralized. The North Vietnamese basically surrendered their objectives and a 'peace treaty' was signed.

The 'failure' in Vietnam was a geopolitical one - once the US withdrew, the North Vietnamese rebuilt their army and waltzed into the South.

My point is - the two are separate issues.

The now accepted view of 'body count was misleading' actually did not fundamentally affect military outcomes. It was a bad measure, but the US still one. It affected some things, maybe a 'shock' to public opinion, but it was not existential in terms of changing the military outcomes.

The 'failed objectives' were simply due to (arguably premature) US withdrawal. You can see from US casualties [1] during the war that the war was 'won' (about mid 1970) several years before US withdrawal and even longer before a resurgent North Vietnamese invasion after US withdrawal.

Hence the confusion.

There were so many civilian casualties, so many geopolitical bits of ugliness, the US casualty rate was high enough, the terrible massacres on both sides - that all of this leaves us with a clouded view of the events.

[1] https://en.wikipedia.org/wiki/Vietnam_War_casualties

Re: Goodhart's Law: When a measure becomes a target, it ceases to be a good measure

#120

During the Vietnam War, it was body count. That turned out to be a great way of incentivizing the most murderous troops.

Probably more of an incentive for NCO's and Officers to overclaim the results, so they look good to their superiors.

Why guess about documented history?
Post reply on HN