Why Traditional Metrics Miss The Mark
Completion rates, quiz scores, and attendance. These are the usual suspects, but they tell us little about what learners understand, retain, and apply. They represent proxies for participation, not indicators of progress.
Success is too often defined by activity and not by transformation. But movement is not always momentum.
What Gets Measured Gets… Managed?
We inherited metrics from legacy systems optimised for compliance and not capability. And when we reward the wrong numbers, we reinforce the destructive behaviours. Fast completion checks. Shallow engagement—okay. Forgettable content (biting bottom lip).
The real tragedy? Learners who do the real work—reflection, struggle, application—often get overlooked because their growth isn’t immediate or easy to score.
What Should We Measure Instead?
Let’s be clear: measurement is not the problem—misalignment is! So, what if we recalibrated? What if we measured
Cognitive shift
Can learners think differently after the experience?
Behavioural application
Are learners doing anything differently?
Confidence and autonomy
Do they feel more equipped to act?
Meaning-making
Can they connect the dots in real life?
These factors may be more complex to quantify, but they hold far greater meaning. And yes, we can measure them—by using thoughtful reflection prompts, incorporating workplace feedback loops, and conducting longitudinal impact tracking.
LONGITUDINAL IMPACT TRACKING
Looking beyond the learning event and measuring what truly lasts.
In learning and development, it’s easy to celebrate early wins: attendance rates, feedback scores, and completed modules—but we must go deeper and further.
“Longitudinal Impact Tracking means tracking the ripple effects of a learning experience over time —not just what learners remember after a session, but what they retain, apply, and carry forward into their work, lives, or communities.”
This type of tracking helps us answer tougher, more meaningful questions:
- Are learners still using what they’ve learned three months later?
- Has the learning programme contributed to lasting behaviour change or capability growth?
- What is sticking—and what is slipping?
Why It Matters
Surface-level metrics don’t communicate the whole story. We must focus on measurable, meaningful change, and that means designing for and tracking long-term outcomes that matter.
Measuring What Matters
The optimal approach puts the human experience at the centre. It’s not about being anti-metrics, it’s about pro-meaning. And it involves designing tools and checkpoints that surface real indicators of progress, like
- Learner insights, not just quiz results.
- Evidence of action, not just intention.
- Growth over time, not momentary mastery.
What matters most is what sticks—and sticks with purpose.
The Work Continues
Our next post takes a hard look at engagement and why learners who seem engaged may still be disengaged beneath the surface.
Let’s Continue The Conversation
- What learning outcomes do you currently measure? Why?
- How might your data be misleading you?
- What would you learn if you asked different questions?
Try This
Review your current learning KPIs. Ask: What is one thing we are not measuring—but should be? Propose one slight change to your evaluation framework.
