FOCUS Learning Blog

Completion Is a Vanity Metric

Written by Alyssa Restauro | Jul 28, 2026, 8:55:52 PM
Every training team has a number it reports up the chain. Usually it is the completion rate. "Ninety-four percent of staff completed their required training this quarter." It looks good on a dashboard, it satisfies the auditor's calendar, and it tells you almost nothing about whether anyone can actually do their job.

Completion is a vanity metric. It measures activity, not ability.

What a completion actually records

Someone opened a course. They spent the required minutes in a module. They passed a quiz with fixed answers. They clicked through to the end before the due date. Every one of those is a measure of participation. None of them is a measure of proficiency.

In a corporate setting, where the stakes are a policy acknowledgment or a software refresher, that distinction may not matter much. In a control room, a substation, or a reactor, it is the whole game.

Here is the gap that completion hides: the distance between "course complete" and "task qualified." That space is where audit exposure lives. It is where downtime starts. It is where incidents come from. A worker can complete every assigned course and still not be qualified to perform the task in front of them, and your completion report will not tell you the difference.

The question a reviewer actually asks

Regulators already know this. Walk into an INPO, NRC, or NERC review and no one asks for your completion percentage. They ask a harder question: can you prove, on demand, that this specific person was qualified for this specific task, and that their training matched the scope of the work at the time they did it?

A completion report cannot answer that. It was never built to.

Notice the tense. Not who is qualified now, which most programs can eventually produce. Who was qualified on the day the work happened. That is the question that turns into a finding when the answer takes three days to assemble.

Why the gap got dangerous

For a long time, programs got away with it because the environment was stable. That era is over.

A generation of veteran operators is retiring, the industry's Great Crew Change, and the institutional knowledge in their heads was never written down anywhere your LMS can see. On most projections electricity demand roughly doubles by 2050, so there are more people to qualify and less time to do it. And training scope shifts with every regulatory update, every new asset class, every contractor brought in for an outage.

A metric that never told you much is now actively misleading, because it hides risk at exactly the moment risk is climbing.

What to measure instead

Start with the questions the job actually asks:

  • Is each person qualified for the tasks their position requires, right now?

  • When does each qualification expire, and what is coming due?

  • Is the training justified by an analysis of the job, not just the content you happened to have?

  • When a role changes or a contractor's scope expands, does anything automatically re-check what they are qualified for?

  • Could you produce the evidence for any of it today, without a scramble?

Those are questions about qualification, not completion. Answer them and completion takes care of itself as a byproduct. Fail to answer them and no completion rate, however high, will save you in a review or, worse, in an event.

Most programs do not know where they stand

Here is the uncomfortable part. Most training managers can tell you their completion rate to one decimal place and cannot tell you, with confidence, how they would answer the five questions above.

That is not a competence problem. It is a visibility problem. Qualification data tends to live in more places than anyone realizes: the LMS holds completions, a spreadsheet holds the qualification matrix, a supervisor's folder holds the sign-offs, and the connection between them is somebody's memory. Nobody designed it that way. It accumulated.

Which means the first useful move is not buying anything. It is finding out honestly which of those five questions your program can answer, and which one is weakest. Programs tend to be uneven rather than uniformly good or bad, and the weakest dimension is usually the one that generates the finding.

This is the difference between a system that manages content and a system that manages qualification. One tells you what people clicked. The other tells you whether they are ready. The programs that come through the next decade in good shape will be the ones that stopped confusing the two.

Completion says they clicked. It does not say they are qualified. Stop reporting the first number as if it were the second, and start by finding out which number you can actually defend.