VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

Why Mathematics? | Regularised Horseshoe Priors for Sparse Reliability Predictors: Global–Local Shrinkage, Effective Nonzero Coefficients and Slab Regularisation

Choose your reading route

eduKateSG · Why Mathematics? · Regularised Horseshoe Priors for Sparse Reliability Predictors: Global–Local Shrinkage, Effective Nonzero Coefficients and Slab Regularisation

Start with the question, audit the worked example, or jump to the assumptions and practice. Every chapter stays open for uninterrupted reading.

Full chapter index · Practice and checking · Mathematics Learning Hub

Why mathematics is important becomes practical when a reliability model contains many possible predictors but only a few are expected to matter. Temperature, vibration, supplier, load cycles and interactions can produce a wide regression. The horseshoe prior combines one global shrinkage scale with local scales, pulling noise-like coefficients strongly toward zero while allowing supported signals to escape. The regularised horseshoe adds a finite slab that also controls the largest coefficients.

In a simplified standardised normal-means illustration, the shrinkage factor is kappa=1/(1+tau² lambda²). With global tau=0.10 and local lambda=2, kappa=1/1.04≈0.9615, leaving about 3.85% of the unshrunk signal. If lambda=20, kappa=1/5=0.20, leaving 80%. These figures teach global–local adaptation under a specific unit-information setup; a real reliability regression has likelihood scale, design matrix and slab terms that must be handled explicitly.

Full chapter index

Chapters 1–5 · Understand the question
  1. Why sparse reliability models arise
  2. The overfitting problem
  3. Global–local shrinkage
  4. The horseshoe shape
  5. A simplified shrinkage factor
Chapters 6–10 · Reproduce the example
  1. Worked local scale two
  2. Worked local scale twenty
  3. Retained signal fraction
  4. Global scale tau
  5. Local scales lambda
Chapters 11–15 · Check assumptions
  1. Effective nonzero coefficients
  2. Regularised slab
  3. Slab degrees of freedom
  4. Standardising predictors
  5. Censored reliability likelihoods
Chapters 16–20 · Explore applications
  1. Interactions and hierarchy
  2. Collinearity
  3. Posterior computation
  4. Prediction versus selection
  5. Sensitivity to expected sparsity
Chapters 21–25 · Study and verify
  1. Prior predictive checking
  2. Decision implications
  3. Reproducible reporting
  4. Parent and student learning route
  5. Common misconceptions and next reading

CHAPTER 1 OF 25 · Understand the question

1. Why sparse reliability models arise

Back to contents

Start with many possible predictors. Modern tests record many sensors, interactions and operating conditions. Only a subset may add predictive information. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Sparsity is an assumption, not an observed fact. State why it is plausible.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Save predictor scaling, global prior, local prior and regularised slab settings. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use why sparse reliability models arise as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? A continuous horseshoe prior can behave as if a model were sparse without assigning any coefficient an exact point mass at zero. That is why a careful report includes the construction, not only the final scalar.

Contents · Next chapter

CHAPTER 2 OF 25 · Understand the question

2. The overfitting problem

Back to contents

Now combine global and local shrinkage. A wide model can fit accidental variation in a small failure dataset. Dozens of coefficients chase a handful of failures. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Training fit can improve while future prediction worsens. Use regularisation and validation.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Recalculate shrinkage factors under the stated standardised model. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use the overfitting problem as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 3 OF 25 · Understand the question

3. Global–local shrinkage

Back to contents

A finite slab controls escaping coefficients. A global scale shrinks all coefficients while local scales let individual signals escape. Most effects move toward zero but a strong temperature effect remains. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. The prior does not make exact zeros. Use shrinkage language.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Compare prior effective model sizes and posterior predictive performance. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use global–local shrinkage as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 4 OF 25 · Understand the question

4. The horseshoe shape

Back to contents

Start with many possible predictors. The prior has a sharp concentration near zero and very heavy tails. Noise is compressed and large signals remain possible. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Heavy tails can create computational difficulty. Inspect posterior geometry.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Keep continuous shrinkage distinct from exact variable selection. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use the horseshoe shape as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Primary research: https://doi.org/10.1214/17-EJS1337SI. Read the authors’ definition and conditions before carrying the method into a censored reliability model.

Contents · Previous chapter · Next chapter

CHAPTER 5 OF 25 · Understand the question

5. A simplified shrinkage factor

Back to contents

Now combine global and local shrinkage. In a standard normal-means setting, kappa equals one over one plus tau squared lambda squared. Kappa near one means strong shrinkage. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. The formula changes with observation variance and design. State the setup.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Inspect divergences, ESS and coefficient-tail sensitivity. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use a simplified shrinkage factor as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 6 OF 25 · Reproduce the example

6. Worked local scale two

Back to contents

A finite slab controls escaping coefficients. Set tau 0.10 and lambda two. Tau squared lambda squared is 0.04 and kappa is 0.9615. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Rounding should follow the exact fraction. Show each step.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Save predictor scaling, global prior, local prior and regularised slab settings. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use worked local scale two as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? A continuous horseshoe prior can behave as if a model were sparse without assigning any coefficient an exact point mass at zero. That is why a careful report includes the construction, not only the final scalar.

QuantityLocal lambda 2Local lambda 20
Global tau0.100.10
tau^2 lambda^20.044.00
Shrinkage kappa0.96150.2000
Retained fraction0.03850.8000
Global-local shrinkage teaching calculation.

Contents · Previous chapter · Next chapter

CHAPTER 7 OF 25 · Reproduce the example

7. Worked local scale twenty

Back to contents

Start with many possible predictors. Set tau 0.10 and lambda twenty. The product is four and kappa is 0.20. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. A small kappa does not prove causality. Interpret it as reduced shrinkage.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Recalculate shrinkage factors under the stated standardised model. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use worked local scale twenty as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 8 OF 25 · Reproduce the example

8. Retained signal fraction

Back to contents

Now combine global and local shrinkage. One minus kappa describes the unshrunk share in the teaching model. The two examples retain 3.85% and 80%. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. It is not a posterior inclusion probability. Keep concepts separate.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Compare prior effective model sizes and posterior predictive performance. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use retained signal fraction as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 9 OF 25 · Reproduce the example

9. Global scale tau

Back to contents

A finite slab controls escaping coefficients. Tau controls overall sparsity and should reflect sample size, noise and expected signal count. A smaller tau means stronger global shrinkage. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. A default can be badly scaled. Calibrate tau.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Keep continuous shrinkage distinct from exact variable selection. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use global scale tau as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 10 OF 25 · Reproduce the example

10. Local scales lambda

Back to contents

Start with many possible predictors. Each coefficient receives its own positive local scale. A supported stress effect obtains a large lambda. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Local scales can be weakly identified. Check sampling and sensitivity.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Inspect divergences, ESS and coefficient-tail sensitivity. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use local scales lambda as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 11 OF 25 · Check assumptions

11. Effective nonzero coefficients

Back to contents

Now combine global and local shrinkage. The sum of one minus shrinkage factors gives an effective model size in suitable settings. Prior knowledge about expected signals informs tau. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. It is not a literal count after every nonlinear transformation. Use the published derivation.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Save predictor scaling, global prior, local prior and regularised slab settings. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use effective nonzero coefficients as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? A continuous horseshoe prior can behave as if a model were sparse without assigning any coefficient an exact point mass at zero. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 12 OF 25 · Check assumptions

12. Regularised slab

Back to contents

A finite slab controls escaping coefficients. The regularised horseshoe limits the variance available to escaping coefficients. A finite slab scale controls implausibly huge effects. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. The slab is not a hard coefficient bound. Inspect induced quantiles.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Recalculate shrinkage factors under the stated standardised model. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use regularised slab as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Second authoritative source: https://proceedings.mlr.press/v54/piironen17a.html. Compare its reference distribution, diagnostics and finite-simulation cautions with this worked example.

Contents · Previous chapter · Next chapter

CHAPTER 13 OF 25 · Check assumptions

13. Slab degrees of freedom

Back to contents

Start with many possible predictors. A prior on the slab can soften its boundary and retain heavy tails. Large effects are regularised rather than clipped. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Extra hyperparameters add sensitivity. Report them all.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Compare prior effective model sizes and posterior predictive performance. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use slab degrees of freedom as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 14 OF 25 · Check assumptions

14. Standardising predictors

Back to contents

Now combine global and local shrinkage. Comparable predictor scales make coefficient priors interpretable. Temperature and vibration are centred and scaled. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Back-transformed effects need original units. Save scaling constants.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Keep continuous shrinkage distinct from exact variable selection. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use standardising predictors as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 15 OF 25 · Check assumptions

15. Censored reliability likelihoods

Back to contents

A finite slab controls escaping coefficients. Survival contributions include failures and censoring, so information differs by predictor pattern. A rare operating regime has mostly censored units. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Shrinkage cannot create failure information. Improve design where feasible.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Inspect divergences, ESS and coefficient-tail sensitivity. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use censored reliability likelihoods as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 16 OF 25 · Explore applications

16. Interactions and hierarchy

Back to contents

Start with many possible predictors. Scientific interactions should respect main-effect structure when appropriate. Stress by temperature enters with both parents. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. A generic horseshoe does not enforce heredity automatically. Encode structure explicitly.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Save predictor scaling, global prior, local prior and regularised slab settings. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use interactions and hierarchy as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? A continuous horseshoe prior can behave as if a model were sparse without assigning any coefficient an exact point mass at zero. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 17 OF 25 · Explore applications

17. Collinearity

Back to contents

Now combine global and local shrinkage. Correlated sensors can share or exchange posterior signal. Two vibration measures compete for the same effect. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Individual coefficient ranks may be unstable. Inspect joint predictions.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Recalculate shrinkage factors under the stated standardised model. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use collinearity as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 18 OF 25 · Explore applications

18. Posterior computation

Back to contents

A finite slab controls escaping coefficients. Funnel-like local scales can challenge HMC. Divergences appear near extreme shrinkage. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. More iterations do not repair biased exploration. Use stable parameterisations and diagnostics.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Compare prior effective model sizes and posterior predictive performance. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use posterior computation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 19 OF 25 · Explore applications

19. Prediction versus selection

Back to contents

Start with many possible predictors. Continuous shrinkage often targets prediction rather than exact variable deletion. A small coefficient remains in the model. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Thresholding after the fact can understate uncertainty. Report predictive performance.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Keep continuous shrinkage distinct from exact variable selection. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use prediction versus selection as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 20 OF 25 · Explore applications

20. Sensitivity to expected sparsity

Back to contents

Now combine global and local shrinkage. Vary the prior effective model size and slab scale. Maintenance risk stays stable across plausible settings. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Choosing settings after seeing outcomes biases interpretation. Plan the grid.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Inspect divergences, ESS and coefficient-tail sensitivity. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use sensitivity to expected sparsity as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 21 OF 25 · Study and verify

21. Prior predictive checking

Back to contents

A finite slab controls escaping coefficients. Simulate coefficients, hazards and lifetimes before fitting. Most curves remain plausible while a few show strong effects. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Plausible coefficients can produce implausible survival curves. Check observables.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Save predictor scaling, global prior, local prior and regularised slab settings. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use prior predictive checking as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? A continuous horseshoe prior can behave as if a model were sparse without assigning any coefficient an exact point mass at zero. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 22 OF 25 · Study and verify

22. Decision implications

Back to contents

Start with many possible predictors. Shrunken predictors change risk ranking and sensor investment. A supplier indicator no longer drives replacement. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Coefficient size alone does not encode cost. Add a loss model.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Recalculate shrinkage factors under the stated standardised model. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use decision implications as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 23 OF 25 · Study and verify

23. Reproducible reporting

Back to contents

Now combine global and local shrinkage. Save scaling, tau prior, local-scale prior, slab parameters and software version. A reviewer reconstructs every transformation. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Saying horseshoe alone is incomplete. Archive code and draws.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Compare prior effective model sizes and posterior predictive performance. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use reproducible reporting as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 24 OF 25 · Study and verify

24. Parent and student learning route

Back to contents

A finite slab controls escaping coefficients. The horseshoe connects fractions, squares, weighted shrinkage and uncertainty. Verify 0.9615 and 0.20. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. A retained fraction is not a probability of truth. Graph kappa against lambda.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Keep continuous shrinkage distinct from exact variable selection. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use parent and student learning route as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Useful next reading: Mathematics Learning Hub, eduKate Mathematics Learning System, approach to learning mathematics, Bukit Timah Mathematics curriculum overview, cross-subject learning approach, previous Why Mathematics article. Choose the destination that matches the next question rather than treating links as a checklist.

Contents · Previous chapter · Next chapter

CHAPTER 25 OF 25 · Study and verify

25. Common misconceptions and next reading

Back to contents

Start with many possible predictors. Horseshoe priors do not guarantee true-variable recovery, exact zeros or causal effects. They express global–local shrinkage under a sparsity assumption. This step matters because sparse prediction, adaptive shrinkage and honest high-dimensional reliability modelling require the mathematical object, prediction target and reliability question to stay aligned. Regularisation cannot replace validation. Read Piironen and Vehtari.

A reproducible audit should record variables, units, observation boundaries, censoring codes, model version and software settings. Inspect divergences, ESS and coefficient-tail sensitivity. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to guide reliability work.

Try a small learning experiment: calculate one over one plus tau squared lambda squared for tau 0.10 and local scales two and twenty. Use common misconceptions and next reading as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Quick answers

What must be fixed before checking a model or algorithm? Define the dataset unit, censoring mechanism, time scale, parameterisation, simulation design and diagnostic rule.

Does a satisfactory diagnostic prove the model is true? No. It supports a particular check under stated assumptions and simulation conditions.

Which mathematics matters? Probability defines the reference distribution, simulation makes it observable, proportions summarise tail events, variance describes uncertainty and graphs expose structured mismatch.

How should a student practise? Preserve intermediate quantities, predict directions before calculating, change one input at a time and explain the result in ordinary language.

What follows an internal check? Sensitivity analysis, independent computation, held-out or later-data prediction and a separate decision analysis when cost or safety matters.

Contents · Previous chapter · Mathematics Learning Hub

Extended practice laboratory

Practice case 1: Why sparse reliability models arise

Setup: Use this chapter’s illustrative case: Only a subset may add predictive information.

Task: State why it is plausible.

Checking target: Sparsity is an assumption, not an observed fact.

Practice case 2: The overfitting problem

Setup: Use this chapter’s illustrative case: Dozens of coefficients chase a handful of failures.

Task: Use regularisation and validation.

Checking target: Training fit can improve while future prediction worsens.

Practice case 3: Global–local shrinkage

Setup: Use this chapter’s illustrative case: Most effects move toward zero but a strong temperature effect remains.

Task: Use shrinkage language.

Checking target: The prior does not make exact zeros.

Practice case 4: The horseshoe shape

Setup: Use this chapter’s illustrative case: Noise is compressed and large signals remain possible.

Task: Inspect posterior geometry.

Checking target: Heavy tails can create computational difficulty.

Practice case 5: A simplified shrinkage factor

Setup: Use this chapter’s illustrative case: Kappa near one means strong shrinkage.

Task: State the setup.

Checking target: The formula changes with observation variance and design.

Practice case 6: Worked local scale two

Setup: Use this chapter’s illustrative case: Tau squared lambda squared is 0.04 and kappa is 0.9615.

Task: Show each step.

Checking target: Rounding should follow the exact fraction.

Practice case 7: Worked local scale twenty

Setup: Use this chapter’s illustrative case: The product is four and kappa is 0.20.

Task: Interpret it as reduced shrinkage.

Checking target: A small kappa does not prove causality.

Practice case 8: Retained signal fraction

Setup: Use this chapter’s illustrative case: The two examples retain 3.85% and 80%.

Task: Keep concepts separate.

Checking target: It is not a posterior inclusion probability.

Practice case 9: Global scale tau

Setup: Use this chapter’s illustrative case: A smaller tau means stronger global shrinkage.

Task: Calibrate tau.

Checking target: A default can be badly scaled.

Practice case 10: Local scales lambda

Setup: Use this chapter’s illustrative case: A supported stress effect obtains a large lambda.

Task: Check sampling and sensitivity.

Checking target: Local scales can be weakly identified.