Skip to content
Artwork for Managing Engineers
Managing Engineers · February 25 · 51 min

What the metrics?

Metrics are meant to help. But sometimes they just perform. In this episode, we explore the difference between measurement that drives insight and measurement that becomes theatre. From counting test cases and commit history, to DORA metrics and Monte Carlo forecasting, we unpack how numbers can guide teams - or quietly distort behaviour . We reflect on how metrics have evolved over the past 25 years, how Agile shifted the way we think about delivery and value, and why modern teams now have more data than ever but not always more clarity. We also challenge a few uncomfortable truths: When a metric becomes a target When dashboards replace conversations When velocity gets mistaken for predictability When comparing teams causes more harm than insight When “healthy culture” is reduced to a number At its best, a metric is an invitation to a conversation. At its worst, it is theatre. What we cover Early career metrics: counting test cases and “how many did you do?” Commit counts, leaderboards and accidental gamification From CD releases to cloud shipping and real time telemetry DORA and the four key delivery metrics SPACE Framework and measuring beyond output Monte Carlo method vs story point velocity Confidence levels and how to talk about uncertainty with stakeholders Goodhart’s law and the danger of turning measures into targets Pulse surveys, fatigue and the limits of yearly sentiment snapshots The challenge: if you could only pick one metric, what would it be? Useful links Monte Carlo method https://en.wikipedia.org/wiki/Monte_Carlo_method https://medium.com/@benjihuser/an-introduction-and-step-by-step-guide-to-monte-carlo-simulations-4706f675a02f Actionable Agile for Jira https://www.55degrees.se/products/actionableagileanalytics DORA research https://dora.dev/research/ SPACE Framework https://www.youtube.com/watch?v=O2rbekHpG4Q Goodhart’s law https://en.wikipedia.org/wiki/Goodhart%27s_law Moving beyond velocity https://docondev.com/escape-velocity PETALS Measuring team health across Productivity, Enjoyment, Teamwork, Learning and Serenity https://petals.team https://app.petals.team Chapter markers 00:00:07 - Intro and over engineering an EV charger box 00:02:16 - Why metrics matter and how they can mislead 00:03:27 - Counting test cases and early vanity metrics 00:05:45 - Commit counts and gamified leaderboards 00:09:57 - DORA metrics and delivery performance 00:13:07 - SPACE and measuring people, not just output 00:16:02 - Time to learn vs time to earn 00:20:03 - Monte Carlo forecasting vs velocity 00:24:35 - Pulse surveys, fatigue and psychological safety 00:30:03 - What averages hide 00:35:05 - Goodhart’s Law and when metrics go wrong 00:45:07 - If you could only choose one metric 00:50:56 - Wrap up and listener challenge Hosts Connect with us on LinkedIn… Neil Younger - https://www.linkedin.com/in/neil-younger/ Simon Jobling - https://www.linkedin.com/in/sijobling/ What do you measure? What have you stopped measuring? And what has backfired spectacularly?

0:00-51:38

transcript

No transcript — this publisher did not publish one.

show notes

Metrics are meant to help.

But sometimes they just perform.

In this episode, we explore the difference between measurement that drives insight and measurement that becomes theatre. From counting test cases and commit history, to DORA metrics and Monte Carlo forecasting, we unpack how numbers can guide teams - or quietly distort behaviour  .

We reflect on how metrics have evolved over the past 25 years, how Agile shifted the way we think about delivery and value, and why modern teams now have more data than ever but not always more clarity.

We also challenge a few uncomfortable truths:

  • When a metric becomes a target
  • When dashboards replace conversations
  • When velocity gets mistaken for predictability
  • When comparing teams causes more harm than insight
  • When “healthy culture” is reduced to a number

At its best, a metric is an invitation to a conversation.

At its worst, it is theatre.


What we cover

  • Early career metrics: counting test cases and “how many did you do?”
  • Commit counts, leaderboards and accidental gamification
  • From CD releases to cloud shipping and real time telemetry
  • DORA and the four key delivery metrics
  • SPACE Framework and measuring beyond output
  • Monte Carlo method vs story point velocity
  • Confidence levels and how to talk about uncertainty with stakeholders
  • Goodhart’s law and the danger of turning measures into targets
  • Pulse surveys, fatigue and the limits of yearly sentiment snapshots
  • The challenge: if you could only pick one metric, what would it be?

Useful links


Chapter markers

  • 00:00:07 - Intro and over engineering an EV charger box
  • 00:02:16 - Why metrics matter and how they can mislead
  • 00:03:27 - Counting test cases and early vanity metrics
  • 00:05:45 - Commit counts and gamified leaderboards
  • 00:09:57 - DORA metrics and delivery performance
  • 00:13:07 - SPACE and measuring people, not just output
  • 00:16:02 - Time to learn vs time to earn
  • 00:20:03 - Monte Carlo forecasting vs velocity
  • 00:24:35 - Pulse surveys, fatigue and psychological safety
  • 00:30:03 - What averages hide
  • 00:35:05 - Goodhart’s Law and when metrics go wrong
  • 00:45:07 - If you could only choose one metric
  • 00:50:56 - Wrap up and listener challenge

Hosts

Connect with us on LinkedIn…

Neil Younger - https://www.linkedin.com/in/neil-younger/

Simon Jobling - https://www.linkedin.com/in/sijobling/

What do you measure?

What have you stopped measuring?

And what has backfired spectacularly?

links8

more episodes

All episodes