Live data from Hacker News

Ask HN: How do you measure eng team productivity?

news.ycombinator.com

1–10 of 18 posts

Ask HN: How do you measure eng team productivity?

#1
I’m finding very little resource on this topic. However, it is paramount to follow it as a team grows or a company grows - I’ve known many companies whose developers effectively stopped developing anything of value, being burdened by bugs, bureaucracy, or poor relationships. To be precise, productivity is the measure of outputs over inputs. In the engineering world, outputs are usually value increments (the definition of which varies according to each team’s mission and expertise. They could be user stories for devs, models for data scientists, terraform changes for ops), and input is time. I would note that I don’t know whether to count maintenance tasks in or out (such as keeping versions up to date) or the output definition. However, anything that does not bring obvious value (bug fixing, refactoring) should be counted out of output in terms of productivity - don’t get me wrong, refactoring is useful and important, because when done well it will improve future productivity. The term “team” deserves some definition too. A team in my question has two attributes: - a common mission - size between 2 and 7 people

I’m looking for testimonies and knowledge: - how is productivity measured in your team if you’re an engineer? In different teams if you’re at a management level? Conversely, is it not measured and do you know why? - how is productivity measured in companies you know, either through firsthand experience or well-documented sources? (Company articles, books) - are you aware of research in this area?

On a last side note, I would count research displayed in Accelerate out of the productivity question. The DORA metrics don’t delve into the complex details of “what is value for my team” and focus on the release level. The books and research are great, but arguably not about engineering productivity.

Re: Ask HN: How do you measure eng team productivity?

#2
I think, first principle is to build something that people want.

If you build this way, I feel more comfortable than building something fast, that at the end has close to zero usage.

2 - 7 eng dev teams is a small one. It means, just put people on top of things and things should develop faster than in a an average team in any corporation.

This approach/mindset might not work in corporations etc. since they want to have "reports"

Re: Ask HN: How do you measure eng team productivity?

#3
I worked in a company who measured productivity by attributing a score based on the Fibonacci scale. But they were doing this when the feature was done.

By doing that, it was fairly easy to give a relevant score to each feature.

Engineering team was doing this to measure solely engineering productivity, but product team could do this as well to measure added value to the company.

By tracking the start/end date as well for each feature, you can then measure productivity at any time scale you want.

Re: Ask HN: How do you measure eng team productivity?

#4
post #2

I think, first principle is to build something that people want. If you build this way, I feel more comfortable than building something fast, that at the end has close to zero usage. 2 - 7 eng dev teams is a small one. It means, just put people on top of things and things should develop faster than in a an average team in any corporation. This approach/mindset might not work in corporations etc. since they want to ha…

I agree 100%, you need to have a strong product foundation to turn good output into good business outcome. A productive team that delivers features no one wants is pointless. Both go hand in hand, but as far as engineering management goes, it is still a challenge to find a good productivity metric. What’s used in your organization @przeor and what do you think of it?

Re: Ask HN: How do you measure eng team productivity?

#5
post #3

I worked in a company who measured productivity by attributing a score based on the Fibonacci scale. But they were doing this when the feature was done. By doing that, it was fairly easy to give a relevant score to each feature. Engineering team was doing this to measure solely engineering productivity, but product team could do this as well to measure added value to the company. By tracking the start/end date as wel…

That’s very interesting, what is the score based on?

Re: Ask HN: How do you measure eng team productivity?

#6
> However, anything that does not bring obvious value (bug fixing, refactoring) should be counted out of output in terms of productivity

Not counting refactoring as output makes sense, because it's more of repositioning for future output, and/or recreation.

But if fixing bugs doesn't bring value, why do you do it?

Re: Ask HN: How do you measure eng team productivity?

#7
Why do you want to measure productivity?

You already know where you are. A measurement doesn’t help your team ship better or faster.

If you’re shipping product improvements at a regular cadence, and the customers are happy, then there’s no problem with productivity.

If you’re shipping poor quality, identify why and improve that.

If you’re shipping so slow that it’s negatively impacting customers, identify why and improve that.

Shoot me an email, I’d be happy to offer more perspective or advice.

Re: Ask HN: How do you measure eng team productivity?

#8
post #7

Why do you want to measure productivity? You already know where you are. A measurement doesn’t help your team ship better or faster. If you’re shipping product improvements at a regular cadence, and the customers are happy, then there’s no problem with productivity. If you’re shipping poor quality, identify why and improve that. If you’re shipping so slow that it’s negatively impacting customers, identify why and imp…

Interesting to note that two of your decision points are on "shipping product improvements at a regular cadence" or "shipping so slow that it's negatively impacting customers". Both relate to a productivity discussion, ie "how to define what it means to 'ship' as an engineering team". In that sense, we're aligned on why it's important to measure productivity. It would however be a mistake to try to optimize for maximum productivity in a vacuum, but note that this is not what this thread is about. This thread is about the unit of measurement that people use in their teams. In that sense it's purely a research / curiosity question

Re: Ask HN: How do you measure eng team productivity?

#9
post #6

> However, anything that does not bring obvious value (bug fixing, refactoring) should be counted out of output in terms of productivity Not counting refactoring as output makes sense, because it's more of repositioning for future output, and/or recreation. But if fixing bugs doesn't bring value, why do you do it?

Well, productivity measures how fast you deliver new value. Fixing a bug is about repairing value that you thought you had delivered but actually did not. Counting bugs as "value" would be double counting.

Re: Ask HN: How do you measure eng team productivity?

#10
I have a better idea, measure how good you are at turnover. How negative is it when someone leaves? How easy is it for someone to join and be productive?

Well, specifically, you can measure onboarding, which is a proxy:

How quickly can someone get started on a feature and ship it to production? How obvious is it for them to follow your teams procedures, guardrails, tests, review processes, etc and go?

Maximizing this means maximizing the available colleagues that can work on your codebase and sets up a positive culture of enablement. It means maintaining your code is not an inscrutable mess.

Post reply on HN