VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

The Core Aim of Science Mastery | Proficiency Testing

eduKate Secondary students reviewing open books for How Super Intelligence Works: the SI Failure Map.

Proficiency testing asks a wonderfully practical scientific question: if several laboratories measure the same material, can they produce results that deserve confidence? The core aim of Science mastery is to show students that a laboratory must do more than trust its own instruments and procedures. It must also demonstrate that its measurements stand up when tested against an independent comparison.

For readers searching for proficiency testing, interlaboratory comparison, laboratory quality assurance, proficiency testing z-score or ISO/IEC 17043, the key distinction is that proficiency testing evaluates how well a laboratory performs a specified test. It is not merely a competition to see which laboratory produces the largest or smallest number.

Think of it as a laboratory’s independent reality check: the work is familiar, but the answer is not supplied in advance.


The 60-Second Explanation

A proficiency testing (PT) programme commonly works as follows:

  1. An independent provider prepares suitable, sufficiently homogeneous and stable test items.
  2. Participating laboratories receive the items and analyse them using the required or permitted methods.
  3. The laboratories submit their results, generally without knowing the assigned value in advance.
  4. The provider compares submitted results with an assigned value using an appropriate statistical performance measure.
  5. Participants evaluate their performance and investigate concerning results.

The Singapore Accreditation Council describes proficiency testing as the use of interlaboratory comparisons to determine laboratory performance and explains the importance of recognised programmes for ongoing confidence in results.

Wait, What? Passing One Round Does Not Make a Laboratory Permanently Reliable?

Exactly. A strong performance in one round is encouraging evidence, not an eternal guarantee. Instruments drift, analysts change, reagents age and sample types differ. That is why ongoing proficiency testing belongs beside internal quality-control checks, calibration and method verification.

Proficiency Testing vs Interlaboratory Comparison

An interlaboratory comparison is the organised comparison of results obtained by different laboratories under defined conditions.

Proficiency testing is a type of interlaboratory comparison designed specifically to evaluate participant performance using predefined assessment criteria. Other interlaboratory comparisons may instead examine a method’s reproducibility, characterise reference material or investigate measurement differences.

The distinction matters because the purpose of the comparison determines what counts as a meaningful result.

A Worked Example: Measuring a Water Sample

Imagine four laboratories receive portions of a suitably prepared water sample. The programme’s assigned concentration is 50.0 mg/L, and the standard deviation designated for proficiency assessment is 2.0 mg/L.

LaboratoryReported resultDifference from assigned value
A49.0 mg/L−1.0 mg/L
B51.5 mg/L+1.5 mg/L
C56.0 mg/L+6.0 mg/L
D50.5 mg/L+0.5 mg/L

Laboratory C is noticeably farther from the assigned value. That does not tell us the cause. It tells us where a detailed investigation is justified.

How a PT Z-Score Works

A common score is:

z = (laboratory result − assigned value) ÷ proficiency-assessment standard deviation.

For Laboratory C:

z = (56.0 − 50.0) ÷ 2.0 = +3.0.

In many proficiency schemes, scores are commonly interpreted using absolute values near 2 and 3 as signals for warning and action. But the specific programme’s stated criteria always govern interpretation. This z-score is not identical in purpose to a student’s normal-distribution z-score, even though the equations look similar.

Where Does the Assigned Value Come From?

An assigned value may be based on:

  • certified reference values;
  • independent reference measurements;
  • formulation values in appropriate prepared materials;
  • robust consensus values from participant laboratories, where suitable.

Students should ask how the assigned value was established. A value derived from participating laboratories is not automatically equivalent to an independently certified reference.

Why Homogeneity and Stability Matter

If Laboratory A receives a different concentration from Laboratory B through poor sample preparation, the comparison is not fair.

Likewise, if the sample changes during shipping or storage, apparent laboratory errors could actually reflect test-item instability. Good programmes therefore evaluate whether distributed materials are appropriately comparable and stable over the required period.

What an Unsatisfactory Result Should Trigger

A surprising PT score should lead to investigation rather than concealment:

  1. Check transcription, units and dilution calculations.
  2. Review instrument calibration and control-chart behaviour.
  3. Inspect sample preparation and possible contamination.
  4. Check reagent lots, standards and method instructions.
  5. Document root cause, corrective action and evidence of improvement.

This is a powerful lesson for students: the purpose of an independent check is not to avoid ever being wrong. It is to make errors visible and correctable.

PT vs Internal Quality Control

Internal quality control may involve a laboratory’s own quality-control samples and control charts. These help detect change during routine testing.

PT adds an independent external comparison. The two approaches complement each other; neither fully replaces the other.

PT vs Method Validation

Method validation establishes whether a procedure is suitable for its intended purpose. Proficiency testing assesses a laboratory’s performance on particular items under a particular scheme. A validated method can still be performed poorly, and a good PT result does not validate every possible sample type.

When Comparing Laboratories Can Mislead

Interlaboratory results need careful context. Laboratories may use different:

  • measurement methods;
  • detection limits;
  • uncertainty budgets;
  • sample preparation procedures;
  • reporting conventions.

Differences should be interpreted against the programme design and whether the measurements are genuinely comparable.

From Primary to Secondary Science

Primary foundation: give several groups the same object to measure, then ask why their results differ and how a shared reference could help.

Secondary extension: introduce assigned values, z-scores, uncertainty, interlaboratory reproducibility and corrective action. Students can compare a classroom consensus value with a trusted independent reference and explain why they may not be interchangeable.

Five Questions Students Should Ask

  1. What was the same across participating laboratories?
  2. How was the assigned value established?
  3. What performance statistic was used?
  4. What counts as acceptable under this programme?
  5. What corrective action follows an unsatisfactory result?

Frequently Asked Questions

What is proficiency testing?

It is a structured assessment of a laboratory’s testing performance, often through interlaboratory comparisons against assigned values and defined criteria.

What does a proficiency testing z-score mean?

It expresses the difference between a reported result and the assigned value in units of the programme’s designated assessment standard deviation.

Does an unsatisfactory score prove that every laboratory result is wrong?

No. It signals a performance concern requiring investigation and assessment of affected work.

Is proficiency testing the same as calibration?

No. Calibration links measurements to references; proficiency testing evaluates laboratory performance in an external exercise.

Further Reading

The Core Aim

Proficiency testing asks whether scientific measurements survive independent comparison. Evaluate results fairly, investigate discrepancies carefully and treat corrective action as part of scientific competence.

Properly taught kids shine a bright light into the future.

Discover more from eduKate Singapore

Subscribe now to keep reading and get access to the full archive.

Continue reading