Live data from Hacker News

Can software leaders use metrics without damaging culture?

linearb.io

11–20 of 29 posts

Re: Can software leaders use metrics without damaging culture?

#11
I've been stuck working on a problem for the last two weeks, I know this by the lingering feeling of dread, and anyone can tell by the empty squares in my commit heat-map. How can metrics help me make progress, except to tell me to try something new: Read papers, study similar solutions, reach out to other that can help. Nothings has worked so far, but it does not deter me.

I did learn a curious fact about the productivity of the most prolific writers, musicians, comedians and other creative professions. Count the number of words written, notes composed and new jokes, then divide those by a reasonable number of working hours, let's say 5 days a week with 8 hours of work over the productive period in their life.

Unfortunately, I can't find the exact numbers anymore, but it was staggeringly low, something in the vein of 1 word written per hour, 1 note composed per day, and one new joke per week.

Sure there are things to be learned from data, just not always what fits the agenda of the managerial class.

Re: Can software leaders use metrics without damaging culture?

#12

If you skipped straight to the HN comments, the article is worth reading. The author makes some thoughtful suggestions and points out some common pitfalls. Although recently, I've noticed another reason to tread lightly with metrics: Metrics have become a highly-charged topic among developers who consume a lot of Twitter, Reddit, HN and other developer chatter. The cynical response to any metrics tracking program is…

I'd like to see evidence that cynicism about metrics leads to abuse and gaming rather than just leaving. That perspective seems cynical in itself.

In my experience metrics make no difference on success, the dynamics of the team and the workflow have been set up for success or failure before you started measuring it. Metrics should never be a target, once a measure becomes a target it ceases to be a good measure.

Measures should be used to give you awareness of time and quantity. Quality as efficiency is inaccurate, it ignores the properties of the work created. Being aware of time and quantity gives managers of large empires the ability to summarize the work of many individuals into a few measures. This kills the point of individually excelling and creates the grounds for union largess. In a few years everybody realizes that the work is not created equal and you create an incentive for real quality minded people to started ranking everybody and allowing room for clearing the bottom 10%.

The same ideas in the article are pushed across youtube, across HN and the internet culture at large, in time with each other. It's disappointing to see so many smart people walk in mental lock step with one another. It devalues the individual contribution and shows there is little left for the majority of these content creators to say that hasn't been said elsewhere.

Re: Can software leaders use metrics without damaging culture?

#13
post #7

I don't think so. Basically, with metrics you are saying that you need to reduce a multidimensional value down to a single dimension. In addition, metrics are open to gaming. Take for example cycle time: >Cycle Time: If you can only have 1 metric, make it cycle time. Cycle time measures the amount of time from work started to work delivered; in other words, the amount of time from first commit to production release.…

You’d never take a team wide metric like cycle time (which is a function of the whole company) and use it to evaluate a single person. There shouldn’t be any benefit to an individual to have a low cycle time.

> You’d never take a team wide metric like cycle time (which is a function of the whole company) and use it to evaluate a single person

In theory, yes. But in practice, I bet there are a lot of people here who have stories of a metric that was supposed to only be used team wide, but was used for evaluating an individual.

Re: Can software leaders use metrics without damaging culture?

#15
post #11

I've been stuck working on a problem for the last two weeks, I know this by the lingering feeling of dread, and anyone can tell by the empty squares in my commit heat-map. How can metrics help me make progress, except to tell me to try something new: Read papers, study similar solutions, reach out to other that can help. Nothings has worked so far, but it does not deter me. I did learn a curious fact about the produc…

Yeah I'm gonna need a citation on that one Chief

Re: Can software leaders use metrics without damaging culture?

#16
post #7

Earlier quoted context omitted.

You’d never take a team wide metric like cycle time (which is a function of the whole company) and use it to evaluate a single person. There shouldn’t be any benefit to an individual to have a low cycle time.

> You’d never take a team wide metric like cycle time (which is a function of the whole company) and use it to evaluate a single person In theory, yes. But in practice, I bet there are a lot of people here who have stories of a metric that was supposed to only be used team wide, but was used for evaluating an individual.

team metrics show the team is underperforming? team lead, CTO, etc. gets canned

Re: Can software leaders use metrics without damaging culture?

#17
If you use metrics to evaluate performance, expect EVERYTHING to be gamed around them.

My friend at Facebook says that everything is based on metrics. So people will ask others to give them a “thanks” in the Performance system for Mundane things like going to a meeting. Numbers of reviews that are commented on are also a metric, so people will +1 a review.

This happens everywhere, not just Facebook. Whatever metrics you employ will incentivize your employees to target those. If you value LOC then those will be targeted. If you value number of checkins, then those will be targeted. And that’s how it should be because that’s what you as a manager are defining to your employees is what is important and valued.

So if you do choose metrics then be aware that it will change the culture.

Re: Can software leaders use metrics without damaging culture?

#18
post #11

I've been stuck working on a problem for the last two weeks, I know this by the lingering feeling of dread, and anyone can tell by the empty squares in my commit heat-map. How can metrics help me make progress, except to tell me to try something new: Read papers, study similar solutions, reach out to other that can help. Nothings has worked so far, but it does not deter me. I did learn a curious fact about the produc…

It’s closer to 1 word per minute than per hour. A 120,000 word novel / 50 weeks / 40 hour weeks / 60 minute hours = 1 word per minute.

However that’s in terms of a finished product which typically has a lot removed or edited over time.

Re: Can software leaders use metrics without damaging culture?

#19
Sounds like a lot of people in this thread are confusing metrics with measures. A metric is just that. Its just a number. It means nothing except giving you historical context over time.

A measure is when you expect a specific quota or compare a metric against another.

Goodharts law, "a metric that becomes a measure ceases to be a good metric".

In other words, once its a measure, its gamed, and useless. So how do you prevent this? Let people tell their own story. Have metrics, no quotas. Dont compare teams. Dont compare individuals. Have metrics, lots of them. Preferably enough thats its impossible to game all of them. Only let the full picture tell the story, never get too focused on one specific metric.

This applies to everything. Too focused on ARR? Guess what, you will make terrible deals at a discounted rate, have high churn, and bad customer support. Too focused on churn? You will hold on to customers you should let go. You have to always look at the bigger picture.

Only metrics, no measures.

Re: Can software leaders use metrics without damaging culture?

#20

If you use metrics to evaluate performance, expect EVERYTHING to be gamed around them. My friend at Facebook says that everything is based on metrics. So people will ask others to give them a “thanks” in the Performance system for Mundane things like going to a meeting. Numbers of reviews that are commented on are also a metric, so people will +1 a review. This happens everywhere, not just Facebook. Whatever metrics…

That's the lovely thing about working in HFT: can make the PnL the metric, as it's much easier to connect work to PnL impact, and then everybody is working towards increasing an actually useful metric.
Post reply on HN