What it measures
Two results almost never match exactly, and that difference can be perfectly normal if the uncertainties are large. The normalized error, En, answers the right question: is the difference between the participant’s value and the reference value compatible with the uncertainties each one stated?
How it is calculated
The difference between the laboratory’s result and the reference value is divided by the square root of the sum of the squares of the expanded uncertainties of both. The two uncertainties must be expressed at the same confidence level, normally the one corresponding to a coverage factor of approximately two. If one was given at another level, it must be brought to the same level before calculating.
How to read it
- Magnitude less than or equal to one: the result is consistent with the reference value within the stated uncertainties.
- Magnitude greater than one: the difference is not explained by the stated uncertainties. There may be an uncorrected bias, an underestimated uncertainty or a problem with the circulating artifact.
The sign indicates the direction of the deviation, not its severity.
Why uncertainty matters so much
This indicator evaluates both accuracy and the honesty of the uncertainty. A laboratory can obtain a value very close to the reference and still have a high indicator if it stated too small an uncertainty. Conversely, stating a very large uncertainty makes it easy to pass, but such a result provides little information, so it is also checked that the uncertainty is credible for the method and the equipment.
Cautions when interpreting it
- If the reference value comes from a higher-level laboratory, its uncertainty is usually small and the indicator depends mainly on that of the participant.
- If the reference value is a consensus of participants, the statistical basis is different and another performance indicator is usually preferred; the scheme protocol should be reviewed.
- When the circulating artifact drifts during the comparison, stability must be included in the uncertainties.
What an engineer sees in practice
The comparison report lists, for each measurement point, the participant’s value, its uncertainty, the reference value and the indicator. A result outside the criterion is treated as a signal to investigate by reviewing the procedure, the traceability of the standards and the uncertainty budget, not as an automatic verdict on the laboratory’s competence.