VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

Why Mathematics? | Weighted Interval Score: Nested Prediction Bands, Median Error, Quantile Losses and CRPS Approximation

WHY MATHEMATICS?

Why Mathematics? | Weighted Interval Score: Nested Prediction Bands, Median Error, Quantile Losses and CRPS Approximation

How several prediction intervals and a median become one transparent forecast score, why the quantile grid matters, and how students can audit every component.

Why mathematics is important becomes easier to see when a real decision depends on it. This guide follows the mechanism from definitions and dimensions to a worked calculation, validation, practical learning and responsible use. It keeps factual evidence separate from interpretation and treats every illustrative scenario as an example rather than a promise of results.

Choose a reading route

  • Assemble a median and nested central prediction intervals
  • Calculate each interval score and its declared weight
  • Decompose the total into sharpness and directional penalties
  • Compare models on matched targets, horizons and quantile grids

Chapter map

  1. 1. Median
  2. 2. Outcome
  3. 3. Inner interval
  4. 4. Inner miss
  5. 5. Inner score
  6. 6. Outer interval
  7. 7. Outer coverage
  8. 8. Weights
  9. 9. Weighted sum
  10. 10. Normalisation
  11. 11. Pinball identity
  12. 12. CRPS link
  13. 13. Decomposition
  14. 14. Aggregation
  15. 15. Missing cases
  16. 16. Claim

Visit the How Mathematics Works hub for the wider series and its connections to education, reasoning, science, computing, design and careers.


1. Median

A small example makes the mechanism visible. Record the predictive median.

A concrete situation

Use m=100.

What the mathematics does not license

The median is not the mean by default. Evidence becomes stronger when the limitation is tested instead of hidden.

Try it, check it, transfer it

Name functional. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


2. Outcome

This is where modelling choices begin to affect evidence. Observe y=120.

A concrete situation

Median absolute error is 20.

What the mathematics does not license

One outcome cannot establish calibration. Keeping this boundary clear makes the result easier to audit and transfer.

Try it, check it, transfer it

Keep case label. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


3. Inner interval

The central mathematical idea is concrete. Use 50% interval [90,110].

A concrete situation

Alpha is .50 and width is 20.

What the mathematics does not license

Intervals must be nested for the intended summary. A trustworthy workflow records the choice before seeing the final test result.

Try it, check it, transfer it

Check order. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


4. Inner miss

Here the geometry becomes operational. Outcome exceeds 110 by 10.

A concrete situation

Penalty factor is 4.

What the mathematics does not license

Use 2/alpha, not 1/alpha. Evidence becomes stronger when the limitation is tested instead of hidden.

Try it, check it, transfer it

Show formula. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.

Did You Know? In this chapter, the most important number is useful only together with its construction rule. Changing scaling, sample membership or validation design can change the numerical answer without changing the arithmetic.


5. Inner score

This step deserves a careful pause. Add width and miss penalty.

A concrete situation

20+4×10=60.

What the mathematics does not license

This is one component. Keeping this boundary clear makes the result easier to audit and transfer.

Try it, check it, transfer it

Keep component. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


6. Outer interval

The useful question is not only how to calculate, but what the calculation assumes. Use 90% interval [70,130].

A concrete situation

Alpha is .10 and width is 60.

What the mathematics does not license

Wide intervals are not free. A trustworthy workflow records the choice before seeing the final test result.

Try it, check it, transfer it

Count width. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


7. Outer coverage

A small example makes the mechanism visible. Place 120 inside [70,130].

A concrete situation

Outer score is 60.

What the mathematics does not license

Inside does not mean score zero. Evidence becomes stronger when the limitation is tested instead of hidden.

Try it, check it, transfer it

Explain width. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


8. Weights

This is where modelling choices begin to affect evidence. Use .5,.25,.05.

A concrete situation

They match median and alpha/2 choices.

What the mathematics does not license

Different grids create different summaries. Keeping this boundary clear makes the result easier to audit and transfer.

Try it, check it, transfer it

Freeze grid. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.

Did You Know? In this chapter, the most important number is useful only together with its construction rule. Changing scaling, sample membership or validation design can change the numerical answer without changing the arithmetic.


9. Weighted sum

The central mathematical idea is concrete. Calculate numerator.

A concrete situation

10+15+3=28.

What the mathematics does not license

Do not drop median contribution. A trustworthy workflow records the choice before seeing the final test result.

Try it, check it, transfer it

Audit terms. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


10. Normalisation

Here the geometry becomes operational. Divide by K+.5=2.5.

A concrete situation

WIS is 11.2.

What the mathematics does not license

A different scaling changes reported numbers. Evidence becomes stronger when the limitation is tested instead of hidden.

Try it, check it, transfer it

State divisor. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


11. Pinball identity

This step deserves a careful pause. Map interval endpoints to quantile losses.

A concrete situation

Use paired lower and upper quantiles.

What the mathematics does not license

Crossing quantiles break interpretation. Keeping this boundary clear makes the result easier to audit and transfer.

Try it, check it, transfer it

Check monotonicity. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


12. CRPS link

The useful question is not only how to calculate, but what the calculation assumes. Use a denser equally spaced grid.

A concrete situation

WIS approaches CRPS under stated weights.

What the mathematics does not license

Approximation is not equality for every sparse grid. A trustworthy workflow records the choice before seeing the final test result.

Try it, check it, transfer it

Use precise language. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.

Did You Know? In this chapter, the most important number is useful only together with its construction rule. Changing scaling, sample membership or validation design can change the numerical answer without changing the arithmetic.


13. Decomposition

A small example makes the mechanism visible. Separate widths and directional penalties.

A concrete situation

Plot sharpness, underprediction and overprediction.

What the mathematics does not license

One total can hide mechanism. Evidence becomes stronger when the limitation is tested instead of hidden.

Try it, check it, transfer it

Open score. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


14. Aggregation

This is where modelling choices begin to affect evidence. Average across a fixed case set.

A concrete situation

Stratify by target and horizon.

What the mathematics does not license

Scale differences can dominate. Keeping this boundary clear makes the result easier to audit and transfer.

Try it, check it, transfer it

Normalise only with rationale. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


15. Missing cases

The central mathematical idea is concrete. Predefine submission and observation rules.

A concrete situation

Keep denominators visible.

What the mathematics does not license

Selective omission can improve a ranking falsely. A trustworthy workflow records the choice before seeing the final test result.

Try it, check it, transfer it

Audit coverage. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.


16. Claim

Here the geometry becomes operational. Report grid, weights and components.

A concrete situation

Teaching WIS is 11.2.

What the mathematics does not license

Do not compare unmatched WIS definitions. Evidence becomes stronger when the limitation is tested instead of hidden.

Try it, check it, transfer it

Bound conclusion. Then explain the result to someone who has not seen the formula. If the explanation needs a hidden assumption, add that assumption to the model record.

Did You Know? In this chapter, the most important number is useful only together with its construction rule. Changing scaling, sample membership or validation design can change the numerical answer without changing the arithmetic.


A seven-day practice lab

  1. Day 1: define the decision, observation unit, X variables and Y or reference condition.
  2. Day 2: reproduce the smallest worked example and check every dimension, unit and sign.
  3. Day 3: build a transparent baseline and write what it assumes.
  4. Day 4: fit the main method inside a training-only pipeline; record every parameter.
  5. Day 5: challenge one assumption with a deliberately difficult dataset or operating regime.
  6. Day 6: compare validation metrics with the practical workload created by errors.
  7. Day 7: present one supported conclusion, one unresolved uncertainty and one safe next experiment.

Questions for a student, parent or mentor

  • Which part of the model is a mathematical definition, and which part is a choice?
  • What small calculation would catch a sign, scale or dimension error?
  • What evidence comes from training, validation and the untouched test?
  • What benign condition could look like a fault or prediction failure?
  • How would the answer change for another response, asset, school project or time period?
  • What should a human review before acting on the score?

A method-specific audit before deployment

The weighted interval score combines a predictive median with several nested central prediction intervals. Bracher, Ray, Gneiting and Reich explain that it is a proper score for interval or quantile forecasts and, under a common weighting scheme, approximates the continuous ranked probability score as the interval grid becomes dense. It can be decomposed into sharpness, underprediction and overprediction components, so the final number can be opened rather than treated as a mysterious leaderboard value.

Use a teaching forecast with median 100, a 50% interval [90,110], a 90% interval [70,130] and outcome 120. The median absolute error is 20. The 50% interval has alpha=.50, width 20 and upper miss 10, so its interval score is 20+4×10=60. The 90% interval has alpha=.10 and contains 120, so its score is 60. With w0=.5, w1=.25 and w2=.05, and divisor K+.5=2.5 for K=2 intervals, WIS=(.5×20+.25×60+.05×60)/2.5=11.2.

The reported WIS depends on which quantiles or intervals are supplied and how they are weighted. Scores computed from different grids are not automatically comparable. Averaging across targets with very different scales can let high-volume series dominate, while ad hoc truncation or target-dependent exclusions can change the ranking. WIS is sensitive to distance and is not the same decision criterion as the logarithmic score. A model can perform well under one score and less well under another because the scores value different forecast features.

A reproducible forecast comparison freezes the median, interval levels, weights, normalisation, targets, horizons and missing-value policy before looking at outcomes. It reports the overall mean alongside width and directional penalty components, checks empirical coverage at every nominal level and adds scale-aware summaries when targets differ. For students, WIS is a practical bridge between percentiles, absolute error, weighted averages and honest uncertainty communication.


Frequently asked questions

What data does WIS need?

A predictive median and one or more central prediction intervals, or the equivalent quantiles.

Why include several interval levels?

They describe more of the predictive distribution than one range.

Why is WIS proper?

With nonnegative fixed weights, truthful quantile and interval reporting minimises expected loss under the stated framework.

How is WIS related to pinball loss?

Each interval score can be written using its lower and upper quantile losses.

Is WIS always identical to CRPS?

No. A dense, suitably weighted interval grid approximates CRPS; sparse grids retain discretisation differences.

What must be reported?

Median, interval levels, weights, normalisation, components, targets, horizons, missing cases and uncertainty.


Primary source and fact-check note

Johannes Bracher, Evan L. Ray, Tilmann Gneiting and Nicholas G. Reich, “Evaluating Epidemic Forecasts in an Interval Format,” PLOS Computational Biology 17(2), e1008618 (2021), DOI 10.1371/journal.pcbi.1008618. Definitions and core claims in this article were checked against this primary publication. Calculations shown here were independently recomputed. Examples are educational illustrations; they are not reported industrial performance results.

Useful next reading

Keep the options open. Mathematics education supports clearer questions, transferable problem-solving skills and informed choices across science, engineering, computing, AI, statistics, design and many other careers. It does not guarantee intelligence, income, admission or employment; those outcomes depend on far more than one subject or model.

Extended laboratory: score-specific validation and responsible use

Grid audit

Freeze the median, lower and upper quantiles, central interval levels and ordering before evaluation.

Weight audit

Declare every nonnegative weight and divisor; do not compare scores built from unmatched grids as if they were identical.

Component audit

Retain absolute median error, interval widths, lower penalties and upper penalties before aggregation.

Coherence audit

Check nested intervals and noncrossing quantiles; repair only with a declared method and preserve the original diagnosis.

Did You Know? A sophisticated adjustment can be algebraically correct and still answer the wrong scientific question when samples, labels, batches or validation boundaries are wrong.

Scale audit

Stratify by target scale and horizon; use normalisation only when its meaning and reference quantity are defensible.

Missingness audit

Record every forecast and observation omission; selective case availability can change model rankings.

Uncertainty audit

Use dependence-aware comparisons when cases share dates, locations, forecast origins or ensemble members.

Final claim

Report the score definition and decomposition; never call WIS a universal measure independent of grid and decision context.

Did You Know? A sophisticated adjustment can be algebraically correct and still answer the wrong scientific question when samples, labels, batches or validation boundaries are wrong.

Mechanism workshop: calculate, challenge and transfer

Workshop 1: Median

Begin with this mechanism: Record the predictive median. Recreate the concrete case: Use m=100. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: The median is not the mean by default. Complete the transfer step: Name functional. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 2: Outcome

Begin with this mechanism: Observe y=120. Recreate the concrete case: Median absolute error is 20. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: One outcome cannot establish calibration. Complete the transfer step: Keep case label. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 3: Inner interval

Begin with this mechanism: Use 50% interval [90,110]. Recreate the concrete case: Alpha is .50 and width is 20. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Intervals must be nested for the intended summary. Complete the transfer step: Check order. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 4: Inner miss

Begin with this mechanism: Outcome exceeds 110 by 10. Recreate the concrete case: Penalty factor is 4. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Use 2/alpha, not 1/alpha. Complete the transfer step: Show formula. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Did You Know? A sophisticated adjustment can be algebraically correct and still answer the wrong scientific question when samples, labels, batches or validation boundaries are wrong.

Workshop 5: Inner score

Begin with this mechanism: Add width and miss penalty. Recreate the concrete case: 20+4×10=60. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: This is one component. Complete the transfer step: Keep component. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 6: Outer interval

Begin with this mechanism: Use 90% interval [70,130]. Recreate the concrete case: Alpha is .10 and width is 60. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Wide intervals are not free. Complete the transfer step: Count width. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 7: Outer coverage

Begin with this mechanism: Place 120 inside [70,130]. Recreate the concrete case: Outer score is 60. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Inside does not mean score zero. Complete the transfer step: Explain width. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 8: Weights

Begin with this mechanism: Use .5,.25,.05. Recreate the concrete case: They match median and alpha/2 choices. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Different grids create different summaries. Complete the transfer step: Freeze grid. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Did You Know? A sophisticated adjustment can be algebraically correct and still answer the wrong scientific question when samples, labels, batches or validation boundaries are wrong.

Workshop 9: Weighted sum

Begin with this mechanism: Calculate numerator. Recreate the concrete case: 10+15+3=28. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Do not drop median contribution. Complete the transfer step: Audit terms. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 10: Normalisation

Begin with this mechanism: Divide by K+.5=2.5. Recreate the concrete case: WIS is 11.2. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: A different scaling changes reported numbers. Complete the transfer step: State divisor. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 11: Pinball identity

Begin with this mechanism: Map interval endpoints to quantile losses. Recreate the concrete case: Use paired lower and upper quantiles. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Crossing quantiles break interpretation. Complete the transfer step: Check monotonicity. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 12: CRPS link

Begin with this mechanism: Use a denser equally spaced grid. Recreate the concrete case: WIS approaches CRPS under stated weights. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Approximation is not equality for every sparse grid. Complete the transfer step: Use precise language. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Did You Know? A sophisticated adjustment can be algebraically correct and still answer the wrong scientific question when samples, labels, batches or validation boundaries are wrong.

Workshop 13: Decomposition

Begin with this mechanism: Separate widths and directional penalties. Recreate the concrete case: Plot sharpness, underprediction and overprediction. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: One total can hide mechanism. Complete the transfer step: Open score. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 14: Aggregation

Begin with this mechanism: Average across a fixed case set. Recreate the concrete case: Stratify by target and horizon. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Scale differences can dominate. Complete the transfer step: Normalise only with rationale. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 15: Missing cases

Begin with this mechanism: Predefine submission and observation rules. Recreate the concrete case: Keep denominators visible. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Selective omission can improve a ranking falsely. Complete the transfer step: Audit coverage. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.

Workshop 16: Claim

Begin with this mechanism: Report grid, weights and components. Recreate the concrete case: Teaching WIS is 11.2. Write outcome units, median, quantile levels, interval endpoints, alpha values, weights, component scores, divisor, WIS, target and horizon with units, signs, identifiers and assumptions. Calculate the smallest non-trivial example by hand and reproduce it independently. Challenge this limitation: Do not compare unmatched WIS definitions. Complete the transfer step: Bound conclusion. Change exactly one interval endpoint, alpha level, outcome, median, quantile grid, interval weight, normalisation, predictive mean, variance, covariance, threshold, weight function, ensemble value or case weight. Explain which mathematical object changes, which score term moves, which ranking survives and which claim must weaken. Keep target definition, calculation, aggregation, uncertainty and interpretation on separate notebook lines. Explain the result once to a student with the full arithmetic and once to a parent with the real decision and original units. Add a counterexample involving lucky coverage, excessive width, quantile crossing, unmatched grids, scale domination, overconfidence, singular covariance, identical moments with different tails, threshold cherry-picking or regional improvement with global deterioration. State the extra evidence that would separate the explanations. Finish with one supported sentence, one unsupported sentence and one useful next measurement.