VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

Why Mathematics? | Prepivoted Bootstrap: CDF Transformations and Higher-Order Calibration

Why is mathematics important when a statistic is not already a pivot with a stable, parameter-free distribution? Prepivoting transforms the statistic through an estimated cumulative distribution function. The transformed value is closer to uniform under the null, so tests and confidence sets can have smaller level error.

Did You Know? Rudolf Beran showed that prepivoting can be iterated. The first transformation is closely related to studentization when studentization is appropriate, while further transformations automate higher-order corrections.

Full chapter index

Chapters 1–7 · Understand the question
  1. The pivot problem
  2. The research basis
  3. The transformation
  4. A worked empirical CDF
  5. A worked tail value
  6. Why uniformity helps
  7. Bootstrap CDF estimation
Chapters 8–14 · Reproduce the example
  1. Iteration
  2. Connection to studentization
  3. One-sided and two-sided roots
  4. Discrete statistics
  5. Nuisance parameters
  6. A quantile-resolution check
  7. Monte Carlo uncertainty
Chapters 15–21 · Check assumptions
  1. Test calibration
  2. Confidence-set inversion
  3. A regression example
  4. A spatial example
  5. Comparison with percentile intervals
  6. Comparison with double bootstrap
  7. Validation plan
Chapters 22–28 · Explore applications
  1. Limits
  2. A spreadsheet workflow
  3. A coding workflow
  4. Applications and careers
  5. A student investigation
  6. Common misconceptions
  7. Connection to recent mathematics articles
Chapters 29–35 · Study and verify
  1. Guidance for students and parents
  2. Practice questions
  3. Frequently asked questions
  4. A reporting checklist
  5. Probability-integral-transform arithmetic
  6. Final prepivoting audit
  7. Useful next reading

CHAPTER 1 OF 35 · Understand the question

1. The pivot problem

Back to contents

A perfect pivot has a distribution that does not depend on unknown nuisance parameters. Many useful roots are only approximately pivotal, so their nominal critical values can give inaccurate coverage or test size.

Contents · Next chapter

CHAPTER 2 OF 35 · Understand the question

2. The research basis

Back to contents

Beran defined prepivoting as transforming a confidence-set root by its estimated bootstrap cumulative distribution function and showed that iteration can reduce level error. Read the Biometrika abstract.

Contents · Previous chapter · Next chapter

CHAPTER 3 OF 35 · Understand the question

3. The transformation

Back to contents

For an observed root R and estimated bootstrap CDF F-star, define U=F-star(R), with the tail convention chosen for the problem. If F-star were the true continuous distribution, the probability integral transform would make U uniform on [0,1].

Contents · Previous chapter · Next chapter

CHAPTER 4 OF 35 · Understand the question

4. A worked empirical CDF

Back to contents

Suppose 80 of 100 bootstrap roots are at or below the observed root. Then F-star(R)=80/100=0.80. The prepivoted value is 0.80 under the lower-tail CDF convention.

Bootstrap rootsAt or below observedF star
100800.8
Empirical CDF transform.

Contents · Previous chapter · Next chapter

CHAPTER 5 OF 35 · Understand the question

5. A worked tail value

Back to contents

For a right-tail test using the same continuous convention, the estimated tail probability is 1−0.80=0.20. With discrete roots, equality and randomisation conventions must be stated.

Lower-tail CDFRight-tail value
0.80.2
Tail convention.

Contents · Previous chapter · Next chapter

CHAPTER 6 OF 35 · Understand the question

6. Why uniformity helps

Back to contents

A uniform reference distribution has transparent critical values. If prepivoting makes the transformed statistic closer to uniform, comparing U with alpha or 1−alpha can improve level accuracy.

Contents · Previous chapter · Next chapter

CHAPTER 7 OF 35 · Understand the question

7. Bootstrap CDF estimation

Back to contents

The empirical CDF is a step function. Finite B gives resolution about 1/B, so a 0.001 tail cannot be estimated credibly with only a few hundred replicates.

Contents · Previous chapter · Next chapter

CHAPTER 8 OF 35 · Reproduce the example

8. Iteration

Back to contents

To prepivot again, generate an outer bootstrap root and estimate its own inner bootstrap CDF value. The distribution of those first-level transformed values supplies another transformation.

Contents · Previous chapter · Next chapter

CHAPTER 9 OF 35 · Reproduce the example

9. Connection to studentization

Back to contents

Studentization divides a centred statistic by an estimated standard error to reduce nuisance-scale dependence. Beran notes that first prepivoting is nearly equivalent when studentization is appropriate, but the operations are not literally identical in every problem.

Contents · Previous chapter · Next chapter

CHAPTER 10 OF 35 · Reproduce the example

10. One-sided and two-sided roots

Back to contents

A signed root suits a directional test; an absolute or quadratic root suits two-sided alternatives. The CDF and rejection tail must match the root definition.

Contents · Previous chapter · Next chapter

CHAPTER 11 OF 35 · Reproduce the example

11. Discrete statistics

Back to contents

For discrete data, the probability integral transform is not exactly uniform because the CDF has jumps. Mid-p, randomised or conservative conventions change the result and must be justified.

Contents · Previous chapter · Next chapter

CHAPTER 12 OF 35 · Reproduce the example

12. Nuisance parameters

Back to contents

Prepivoting can reduce distributional dependence on nuisance parameters when the bootstrap estimates that dependence well. It cannot identify a nuisance parameter absent from the data.

Contents · Previous chapter · Next chapter

CHAPTER 13 OF 35 · Reproduce the example

13. A quantile-resolution check

Back to contents

With B=999, empirical tail probabilities change in increments near 0.001. Reporting 0.000347 from that run suggests false precision unless smoothing or importance methods are explicitly used.

Contents · Previous chapter · Next chapter

CHAPTER 14 OF 35 · Reproduce the example

14. Monte Carlo uncertainty

Back to contents

For U-hat=0.80 from B=100 independent replicates, the simple standard error is sqrt(0.8×0.2/100)=0.04. The transformation itself has visible simulation noise.

Contents · Previous chapter · Next chapter

CHAPTER 15 OF 35 · Check assumptions

15. Test calibration

Back to contents

A prepivoted test estimates how extreme the root is under its bootstrapped law, then may bootstrap that probability again. Simulation under known null models should verify actual size.

Contents · Previous chapter · Next chapter

CHAPTER 16 OF 35 · Check assumptions

16. Confidence-set inversion

Back to contents

Confidence sets can be built by retaining parameter values whose prepivoted test does not reject. This may require repeated bootstrap calculations across candidate values.

Contents · Previous chapter · Next chapter

CHAPTER 17 OF 35 · Check assumptions

17. A regression example

Back to contents

A heteroscedastic regression root may retain nuisance dependence after simple scaling. A suitable wild-bootstrap CDF and prepivoting can target level accuracy while preserving the regression design.

Contents · Previous chapter · Next chapter

CHAPTER 18 OF 35 · Check assumptions

18. A spatial example

Back to contents

A dependence-aware block bootstrap can estimate the CDF of a spatial root. Prepivoting does not excuse using independent resampling for correlated locations.

Contents · Previous chapter · Next chapter

CHAPTER 19 OF 35 · Check assumptions

19. Comparison with percentile intervals

Back to contents

Percentile intervals read quantiles of the statistic directly. Prepivoting transforms a root by its estimated distribution and targets calibration of a test or confidence set.

Contents · Previous chapter · Next chapter

CHAPTER 20 OF 35 · Check assumptions

20. Comparison with double bootstrap

Back to contents

Iterated prepivoting normally requires nested resampling and is therefore a conceptual route to double-bootstrap calibration. The specific root, CDF and iteration count define the actual method.

Contents · Previous chapter · Next chapter

CHAPTER 21 OF 35 · Check assumptions

21. Validation plan

Back to contents

Check approximate uniformity with probability plots under simulated truth, vary B and inner C, test tail conventions, compare size and coverage, and record ties and failed fits.

Contents · Previous chapter · Next chapter

CHAPTER 22 OF 35 · Explore applications

22. Limits

Back to contents

Prepivoting can fail with an invalid bootstrap model, discontinuous or unstable roots, weak identification, insufficient tail resolution, dependence errors or excessive nested Monte Carlo noise.

Contents · Previous chapter · Next chapter

CHAPTER 23 OF 35 · Explore applications

23. A spreadsheet workflow

Back to contents

Sort bootstrap roots, calculate empirical ranks, record equality convention and convert the observed root into U. For iteration, store outer U values separately from every inner CDF.

Contents · Previous chapter · Next chapter

CHAPTER 24 OF 35 · Explore applications

24. A coding workflow

Back to contents

Unit-test 80/100=0.80 and right-tail 0.20. Use deterministic tie rules, independent random streams and a function that returns both the transformed value and its simulation resolution.

Contents · Previous chapter · Next chapter

CHAPTER 25 OF 35 · Explore applications

25. Applications and careers

Back to contents

Prepivoting matters in econometrics, clinical trials, engineering tests and computational inference. Careers require asymptotic reasoning, resampling design and numerical validation.

Contents · Previous chapter · Next chapter

CHAPTER 26 OF 35 · Explore applications

26. A student investigation

Back to contents

Simulate a skewed null model, compare the raw root, studentized root and once-prepivoted root with Uniform(0,1), then measure rejection rates at 1%, 5% and 10%.

Contents · Previous chapter · Next chapter

CHAPTER 27 OF 35 · Explore applications

27. Common misconceptions

Back to contents

Prepivoting is not simply sorting p-values, an empirical CDF is not exact, iteration is not free, and uniform appearance in one simulation does not establish general validity.

Contents · Previous chapter · Next chapter

CHAPTER 28 OF 35 · Explore applications

28. Connection to recent mathematics articles

Back to contents

The double-bootstrap guide explains the nested computation. The bootstrap-t guide explains studentized roots.

Contents · Previous chapter · Next chapter

CHAPTER 29 OF 35 · Study and verify

29. Guidance for students and parents

Back to contents

Students should calculate an empirical CDF by hand and state the tail convention. Parents can ask whether the transformed values were checked for uniform calibration under realistic simulations.

Contents · Previous chapter · Next chapter

CHAPTER 30 OF 35 · Study and verify

30. Practice questions

Back to contents

  • Calculate 80/100.
  • Convert it to a right-tail value.
  • Compute the binomial Monte Carlo error.
  • Explain one tie convention.
  • Compare with studentization.

Contents · Previous chapter · Next chapter

CHAPTER 31 OF 35 · Study and verify

31. Frequently asked questions

Back to contents

### What is transformed? A confidence-set or test root.

### What performs the transformation? An estimated bootstrap CDF.

### Can it be repeated? Yes.

### Is uniformity exact? Only under ideal conditions.

Contents · Previous chapter · Next chapter

CHAPTER 32 OF 35 · Study and verify

32. A reporting checklist

Back to contents

Report root, null or parameter value, resampling law, B, inner C, CDF and tie convention, iteration count, Monte Carlo error, uniformity diagnostic and measured size or coverage.

Contents · Previous chapter · Next chapter

CHAPTER 33 OF 35 · Study and verify

33. Probability-integral-transform arithmetic

Back to contents

For a continuous true CDF F, F(R) is uniform when R follows F. Prepivoting replaces unknown F with a bootstrap estimate, so the gain depends on how accurately that estimate reproduces the root distribution.

Contents · Previous chapter · Next chapter

CHAPTER 34 OF 35 · Study and verify

34. Final prepivoting audit

Back to contents

Confirm the root and tail match, CDF resolution is adequate, ties are handled transparently, nested levels are preserved and improved calibration is measured rather than assumed.

Contents · Previous chapter · Next chapter

CHAPTER 35 OF 35 · Study and verify

35. Useful next reading

Back to contents

Continue through the Mathematics Learning Hub. Reproduce one nested, transformed or distributed resampling calculation by hand before trusting a large automated run.

Contents · Previous chapter · Mathematics Learning Hub

Extended practice laboratory

Practice case 1: Define root

Setup: Start from the article’s prepivoting mechanism for case 1. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 2: Choose CDF tail

Setup: Start from the article’s prepivoting mechanism for case 2. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 3: Generate bootstrap roots

Setup: Start from the article’s prepivoting mechanism for case 3. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 4: Sort roots

Setup: Start from the article’s prepivoting mechanism for case 4. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 5: Count below observed

Setup: Start from the article’s prepivoting mechanism for case 5. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 6: Calculate empirical CDF

Setup: Start from the article’s prepivoting mechanism for case 6. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 7: Calculate tail value

Setup: Start from the article’s prepivoting mechanism for case 7. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 8: Handle equality

Setup: Start from the article’s prepivoting mechanism for case 8. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 9: Check resolution

Setup: Start from the article’s prepivoting mechanism for case 9. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 10: Estimate Monte Carlo error

Setup: Start from the article’s prepivoting mechanism for case 10. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 11: Plot uniformity

Setup: Start from the article’s prepivoting mechanism for case 11. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 12: Iterate transformation

Setup: Start from the article’s prepivoting mechanism for case 12. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 13: Generate outer roots

Setup: Start from the article’s prepivoting mechanism for case 13. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 14: Generate inner CDFs

Setup: Start from the article’s prepivoting mechanism for case 14. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 15: Compare studentization

Setup: Start from the article’s prepivoting mechanism for case 15. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 16: Use signed root

Setup: Start from the article’s prepivoting mechanism for case 16. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 17: Use absolute root

Setup: Start from the article’s prepivoting mechanism for case 17. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 18: Add discreteness

Setup: Start from the article’s prepivoting mechanism for case 18. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 19: Add nuisance parameter

Setup: Start from the article’s prepivoting mechanism for case 19. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 20: Increase B

Setup: Start from the article’s prepivoting mechanism for case 20. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 21: Change inner C

Setup: Start from the article’s prepivoting mechanism for case 21. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 22: Check rejection size

Setup: Start from the article’s prepivoting mechanism for case 22. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 23: Check coverage

Setup: Start from the article’s prepivoting mechanism for case 23. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 24: Name limits

Setup: Start from the article’s prepivoting mechanism for case 24. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 25: Write conclusion

Setup: Start from the article’s prepivoting mechanism for case 25. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the resampling unit, verify the probability or weighting identity, and state one diagnostic before interpretation. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.