VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

Why Mathematics? | Deviance Information Criterion for Bayesian Reliability Models: Posterior Fit, Effective Parameters, MCMC and Model Limits

Why mathematics is important becomes practical when a Bayesian reliability model contains latent effects, hierarchical variation or partial pooling and the ordinary count of parameters is unclear. The Deviance Information Criterion, or DIC, combines posterior mean deviance with an estimated effective number of parameters. In its familiar form, D(theta) = -2 log p(y|theta) plus a model-independent constant, p_D = E[D(theta)|y] – D(E[theta|y]), and DIC = E[D(theta)|y] + p_D.

This guide develops censored-data deviance, posterior averaging, effective complexity, MCMC computation, parameterisation, multimodality and validation. If posterior mean deviance is 248 and deviance at the posterior mean is 240, then p_D = 8 and DIC = 256. Smaller DIC is preferred only for comparable models using the same data and likelihood convention. DIC is not a posterior probability, not an external prediction score and can behave poorly for skewed, multimodal, singular or weakly identified posteriors.

Full chapter index

Chapters 1–5 · Understand the question
  1. Why Bayesian complexity is not always a raw parameter count
  2. Deviance from the observed-data likelihood
  3. Posterior mean deviance
  4. Deviance at the posterior mean
  5. Effective parameters p_D
Chapters 6–10 · Reproduce the example
  1. Completing DIC 256
  2. Lower is relative, not absolute
  3. Same-data and same-likelihood rule
  4. Parameterisation sensitivity
  5. Alternative effective complexity p_V
Chapters 11–15 · Check assumptions
  1. Hierarchical reliability models
  2. Latent variables and focus
  3. MCMC convergence
  4. Monte Carlo error
  5. Skewed posterior distributions
Chapters 16–20 · Explore applications
  1. Multimodality
  2. Singular models
  3. Sparse failures and weak identification
  4. Prior sensitivity
  5. DIC versus WAIC
Chapters 21–25 · Study and verify
  1. DIC versus PSIS-LOO
  2. Posterior predictive checks
  3. External validation
  4. Parent and student learning route
  5. Common misconceptions and next reading

CHAPTER 1 OF 25 · Understand the question

1. Why Bayesian complexity is not always a raw parameter count

Back to contents

Start with the posterior object. Hierarchical shrinkage and latent structure mean fitted parameters can contribute less than one full degree of freedom each. A fleet model contains many unit effects but pulls them toward a shared population distribution. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Counting every latent effect as one can exaggerate practical flexibility. Estimate effective complexity under the declared posterior.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep the posterior draws, observed-data deviance definition and effective-complexity convention together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use why bayesian complexity is not always a raw parameter count as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? DIC can change under a nonlinear reparameterisation because deviance at a posterior mean is not generally invariant. That is why a careful report includes the construction, not only the final scalar.

Contents · Next chapter

CHAPTER 2 OF 25 · Understand the question

2. Deviance from the observed-data likelihood

Back to contents

Now separate fit from flexibility. Deviance is commonly defined as minus twice the log likelihood of the observed data, up to a constant shared across compared models. A failure contributes log f(t), while a right-censored unit contributes log S(c). This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Using complete-data likelihood in one model and observed-data likelihood in another breaks comparison. Name the likelihood and constant convention.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. A negative or implausible effective parameter count is evidence about posterior geometry, not a discount coupon. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use deviance from the observed-data likelihood as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 3 OF 25 · Understand the question

3. Posterior mean deviance

Back to contents

The reliability interpretation comes next. Average D(theta) over retained posterior draws to describe typical fitted lack of fit under posterior uncertainty. A chain yields an average deviance of 248. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Poor MCMC mixing can make the average unreliable. Check chains before computing DIC.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Compare conditional and marginal DIC only after stating which future unit the model is meant to predict. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use posterior mean deviance as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 4 OF 25 · Understand the question

4. Deviance at the posterior mean

Back to contents

Start with the posterior object. Evaluate the deviance at the componentwise posterior mean theta-bar under the same likelihood. The worked model gives D(theta-bar)=240. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. The posterior mean can lie in a low-density or implausible region for skewed or multimodal posteriors. Inspect posterior geometry before trusting this plug-in point.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Reparameterisation sensitivity deserves a worked sensitivity result whenever the posterior mean is not representative. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use deviance at the posterior mean as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Primary research: https://doi.org/10.1111/1467-9868.00353. Read the authors’ definition and conditions before carrying the formula into a censored reliability model.

Contents · Previous chapter · Next chapter

CHAPTER 5 OF 25 · Understand the question

5. Effective parameters p_D

Back to contents

Now separate fit from flexibility. The original effective-complexity measure p_D is posterior mean deviance minus deviance at the posterior mean. 248-240 gives p_D=8. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Negative or unexpectedly large p_D is a diagnostic signal, not a value to hide. Report both deviance terms and p_D.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. DIC is a fitted-data summary; posterior predictive checks and later data answer different questions. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use effective parameters p_d as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 6 OF 25 · Reproduce the example

6. Completing DIC 256

Back to contents

The reliability interpretation comes next. Add p_D to posterior mean deviance, or equivalently add twice p_D to deviance at the posterior mean. 248+8=256 and 240+16=256. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Rounding each MCMC summary early can create disagreement between the two routes. Keep full precision and verify both identities.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep the posterior draws, observed-data deviance definition and effective-complexity convention together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use completing dic 256 as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? DIC can change under a nonlinear reparameterisation because deviance at a posterior mean is not generally invariant. That is why a careful report includes the construction, not only the final scalar.

QuantityValue
Posterior mean deviance D-bar248
Deviance at posterior mean240
Effective parameters p_D8
DIC256
DIC worked example.

Contents · Previous chapter · Next chapter

CHAPTER 7 OF 25 · Reproduce the example

7. Lower is relative, not absolute

Back to contents

Start with the posterior object. DIC ranks a declared comparable candidate set and has no universal pass threshold. Values 256 and 260 give a difference of four. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. The smaller value can still belong to an inadequate model. Pair DIC with posterior predictive checks.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. A negative or implausible effective parameter count is evidence about posterior geometry, not a discount coupon. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use lower is relative, not absolute as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 8 OF 25 · Reproduce the example

8. Same-data and same-likelihood rule

Back to contents

Now separate fit from flexibility. Every candidate must use the same observations, censoring definitions and response scale. All models fit the same 120 component records. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Dropping records with missing covariates changes the target comparison. Freeze the analysis set and missing-data model.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Compare conditional and marginal DIC only after stating which future unit the model is meant to predict. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use same-data and same-likelihood rule as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 9 OF 25 · Reproduce the example

9. Parameterisation sensitivity

Back to contents

The reliability interpretation comes next. Because D(theta-bar) uses a posterior mean, nonlinear reparameterisation can change p_D and DIC. A mean on the log-scale transformed back is not the mean on the natural scale. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Equivalent probability models can receive different DIC values under careless computation. Use a stable scientifically meaningful parameterisation.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Reparameterisation sensitivity deserves a worked sensitivity result whenever the posterior mean is not representative. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use parameterisation sensitivity as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 10 OF 25 · Reproduce the example

10. Alternative effective complexity p_V

Back to contents

Start with the posterior object. A variance-based alternative uses one half of the posterior variance of the deviance. If Var(D)=18, p_V=9. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Different definitions need not agree in finite or irregular posteriors. Label the exact DIC convention.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. DIC is a fitted-data summary; posterior predictive checks and later data answer different questions. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use alternative effective complexity p_v as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 11 OF 25 · Check assumptions

11. Hierarchical reliability models

Back to contents

Now separate fit from flexibility. DIC was motivated partly by models where the number of effective parameters is ambiguous. Batch-level frailties share information across manufacturing lots. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. The choice of focus—conditional or marginal prediction—changes the relevant likelihood. Match DIC to the intended predictive unit.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep the posterior draws, observed-data deviance definition and effective-complexity convention together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use hierarchical reliability models as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? DIC can change under a nonlinear reparameterisation because deviance at a posterior mean is not generally invariant. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 12 OF 25 · Check assumptions

12. Latent variables and focus

Back to contents

The reliability interpretation comes next. Conditional DIC may assess predictions for existing units, while marginal likelihood formulations target new units after integrating latent effects. A machine-specific frailty is known for an existing machine but unknown for a new one. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Mixing these focuses creates misleading rankings. State whether prediction is conditional or population-level.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. A negative or implausible effective parameter count is evidence about posterior geometry, not a discount coupon. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use latent variables and focus as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Second authoritative source: https://doi.org/10.1007/s11222-016-9696-4. Compare its prediction target, diagnostics and finite-sample cautions with this worked example.

Contents · Previous chapter · Next chapter

CHAPTER 13 OF 25 · Check assumptions

13. MCMC convergence

Back to contents

Start with the posterior object. DIC is a posterior summary and inherits every failure of the sampling algorithm. One chain remains trapped in a high-deviance mode. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. A precise printed DIC can conceal nonconvergence. Check rank plots, effective sample size and chain agreement.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Compare conditional and marginal DIC only after stating which future unit the model is meant to predict. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use mcmc convergence as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 14 OF 25 · Check assumptions

14. Monte Carlo error

Back to contents

Now separate fit from flexibility. Finite posterior draws make D-bar, p_D and DIC estimates noisy. Two independent runs differ by 0.8 DIC units. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Treating a tiny difference as decisive ignores simulation error. Repeat computation or estimate Monte Carlo uncertainty.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Reparameterisation sensitivity deserves a worked sensitivity result whenever the posterior mean is not representative. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use monte carlo error as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 15 OF 25 · Check assumptions

15. Skewed posterior distributions

Back to contents

The reliability interpretation comes next. A strongly skewed parameter posterior makes the componentwise mean a poor representative point. A weakly identified shape parameter has a long right tail. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. D(theta-bar) can overstate or understate typical fit. Plot the posterior and consider predictive alternatives.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. DIC is a fitted-data summary; posterior predictive checks and later data answer different questions. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use skewed posterior distributions as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 16 OF 25 · Explore applications

16. Multimodality

Back to contents

Start with the posterior object. When several separated modes explain the data, theta-bar may average incompatible solutions. Two latent-class labelings create symmetric modes. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. DIC can produce unstable or nonsensical effective complexity. Resolve identifiability or use LOO-based evaluation.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep the posterior draws, observed-data deviance definition and effective-complexity convention together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use multimodality as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? DIC can change under a nonlinear reparameterisation because deviance at a posterior mean is not generally invariant. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 17 OF 25 · Explore applications

17. Singular models

Back to contents

Now separate fit from flexibility. Mixtures and redundant latent structures can violate regular approximations behind simple complexity summaries. Two mixture components become indistinguishable. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. A single p_D may not capture the geometry. Use methods designed for singular models.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. A negative or implausible effective parameter count is evidence about posterior geometry, not a discount coupon. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use singular models as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 18 OF 25 · Explore applications

18. Sparse failures and weak identification

Back to contents

The reliability interpretation comes next. Heavy censoring can leave tail and shape parameters weakly informed even with many total units. Only six failures occur before the study closes. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. DIC cannot manufacture information about the late-life hazard. Inspect profiles, priors and posterior predictive tails.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Compare conditional and marginal DIC only after stating which future unit the model is meant to predict. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use sparse failures and weak identification as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 19 OF 25 · Explore applications

19. Prior sensitivity

Back to contents

Start with the posterior object. The posterior and therefore DIC depend on the prior, especially when reliability evidence is sparse. A regularising prior stabilises a shape parameter. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. A ranking that changes across defensible priors is not robust. Publish a prior sensitivity table.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Reparameterisation sensitivity deserves a worked sensitivity result whenever the posterior mean is not representative. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use prior sensitivity as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 20 OF 25 · Explore applications

20. DIC versus WAIC

Back to contents

Now separate fit from flexibility. WAIC uses pointwise log predictive densities and a pointwise variance penalty, targeting predictive accuracy more directly. Two models have similar DIC but different WAIC. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Asymptotic or finite-sample behaviour differs. Do not treat the acronyms as interchangeable.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. DIC is a fitted-data summary; posterior predictive checks and later data answer different questions. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use dic versus waic as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 21 OF 25 · Study and verify

21. DIC versus PSIS-LOO

Back to contents

The reliability interpretation comes next. PSIS-LOO estimates leave-one-out predictive performance and supplies influence diagnostics. One component has a large Pareto-k diagnostic. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. DIC provides no equivalent pointwise reliability warning. Use predictive tools when the goal is out-of-sample performance.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep the posterior draws, observed-data deviance definition and effective-complexity convention together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use dic versus psis-loo as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? DIC can change under a nonlinear reparameterisation because deviance at a posterior mean is not generally invariant. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 22 OF 25 · Study and verify

22. Posterior predictive checks

Back to contents

Start with the posterior object. Simulate replicated lifetimes and censoring-relevant summaries from the fitted model. Replicated early-failure counts miss the observed cluster. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. A lower DIC does not excuse a visible predictive failure. Check mechanisms and time regions separately.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. A negative or implausible effective parameter count is evidence about posterior geometry, not a discount coupon. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use posterior predictive checks as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 23 OF 25 · Study and verify

23. External validation

Back to contents

Now separate fit from flexibility. Freeze the Bayesian model and test predictive distributions on later units or another site. A development fleet differs from field deployment. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. DIC uses the original data and does not measure transportability. Report calibration, log score and operational outcomes externally.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Compare conditional and marginal DIC only after stating which future unit the model is meant to predict. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use external validation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 24 OF 25 · Study and verify

24. Parent and student learning route

Back to contents

The reliability interpretation comes next. DIC joins logarithms, averages, variance, Bayesian updating and model comparison. Students can verify 248-240=8 and 248+8=256. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Arithmetic is only the first layer; the representative posterior point matters. Draw a posterior with one mode and then two modes.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Reparameterisation sensitivity deserves a worked sensitivity result whenever the posterior mean is not representative. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use parent and student learning route as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Useful next reading: Mathematics Learning Hub, eduKate Mathematics Learning System, approach to learning mathematics, Bukit Timah Mathematics curriculum overview, cross-subject learning approach, nested likelihood-ratio guide. Choose the destination that matches the next question rather than treating links as a checklist.

Contents · Previous chapter · Next chapter

CHAPTER 25 OF 25 · Study and verify

25. Common misconceptions and next reading

Back to contents

Start with the posterior object. DIC is not a Bayes factor, not a probability that one model is correct and not always invariant to reparameterisation. A negative p_D is a warning rather than a complexity bonus. This step matters because posterior fit, effective complexity and Bayesian reliability judgement require the mathematical object, prediction target and reliability question to stay aligned. Predictive validation remains necessary. Read Spiegelhalter and colleagues, then compare the result with modern LOO guidance.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. DIC is a fitted-data summary; posterior predictive checks and later data answer different questions. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: recalculate D-bar, D at theta-bar, p_D and DIC, then sketch a bimodal posterior to explain why a componentwise mean can fail. Use common misconceptions and next reading as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Quick answers

What must be fixed before comparing models? Use the same observations, censoring mechanism, time scale, likelihood convention and predictive unit.

Does a preferred value prove a model is true? No. The comparison is conditional on its candidates, data and assumptions.

Which mathematics matters? Algebra organises identities, logarithms stabilise products, probability represents uncertainty, variance measures instability and graphs expose influential cases.

How should a student practise? Preserve intermediate quantities, predict directions before calculating and change one input at a time.

What follows the comparison? Diagnostics, uncertainty analysis, posterior or predictive checks, later-data validation and a separate decision analysis when costs or safety matter.

Contents · Previous chapter · Mathematics Learning Hub

Extended practice laboratory

Practice case 1: Why Bayesian complexity is not always a raw parameter count

Setup: Use this chapter’s illustrative case: A fleet model contains many unit effects but pulls them toward a shared population distribution.

Task: Estimate effective complexity under the declared posterior.

Checking target: Counting every latent effect as one can exaggerate practical flexibility.

Practice case 2: Deviance from the observed-data likelihood

Setup: Use this chapter’s illustrative case: A failure contributes log f(t), while a right-censored unit contributes log S(c).

Task: Name the likelihood and constant convention.

Checking target: Using complete-data likelihood in one model and observed-data likelihood in another breaks comparison.

Practice case 3: Posterior mean deviance

Setup: Use this chapter’s illustrative case: A chain yields an average deviance of 248.

Task: Check chains before computing DIC.

Checking target: Poor MCMC mixing can make the average unreliable.

Practice case 4: Deviance at the posterior mean

Setup: Use this chapter’s illustrative case: The worked model gives D(theta-bar)=240.

Task: Inspect posterior geometry before trusting this plug-in point.

Checking target: The posterior mean can lie in a low-density or implausible region for skewed or multimodal posteriors.

Practice case 5: Effective parameters p_D

Setup: Use this chapter’s illustrative case: 248-240 gives p_D=8.

Task: Report both deviance terms and p_D.

Checking target: Negative or unexpectedly large p_D is a diagnostic signal, not a value to hide.

Practice case 6: Completing DIC 256

Setup: Use this chapter’s illustrative case: 248+8=256 and 240+16=256.

Task: Keep full precision and verify both identities.

Checking target: Rounding each MCMC summary early can create disagreement between the two routes.

Practice case 7: Lower is relative, not absolute

Setup: Use this chapter’s illustrative case: Values 256 and 260 give a difference of four.

Task: Pair DIC with posterior predictive checks.

Checking target: The smaller value can still belong to an inadequate model.

Practice case 8: Same-data and same-likelihood rule

Setup: Use this chapter’s illustrative case: All models fit the same 120 component records.

Task: Freeze the analysis set and missing-data model.

Checking target: Dropping records with missing covariates changes the target comparison.

Practice case 9: Parameterisation sensitivity

Setup: Use this chapter’s illustrative case: A mean on the log-scale transformed back is not the mean on the natural scale.

Task: Use a stable scientifically meaningful parameterisation.

Checking target: Equivalent probability models can receive different DIC values under careless computation.

Practice case 10: Alternative effective complexity p_V

Setup: Use this chapter’s illustrative case: If Var(D)=18, p_V=9.

Task: Label the exact DIC convention.

Checking target: Different definitions need not agree in finite or irregular posteriors.