VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

Why Mathematics? | Thermodynamic Integration for Bayesian Reliability Models: Power Posteriors, Temperature Paths, Log Evidence and Grid Error

The importance of mathematics becomes visible when a Bayesian reliability model has a difficult evidence integral but can be connected smoothly from prior to posterior. Thermodynamic integration, also called path sampling in a broader formulation, creates power posteriors p_beta(theta|y) proportional to p(y|theta)^beta p(theta), with beta moving from 0 to 1. The log evidence equals the integral from 0 to 1 of the expected log likelihood under these intermediate distributions.

In a teaching example, expected log likelihoods at beta 0, 0.25, 0.5, 0.75 and 1 are -160, -145, -130, -120 and -115. Composite trapezoidal integration gives approximately -133.125. This guide develops temperatures, power posteriors, quadrature, path design, Monte Carlo error, censored likelihoods and prior sensitivity. A smooth-looking curve is not enough when chains have not mixed or the grid misses sharp curvature near beta zero.

Full chapter index

Chapters 1–5 · Understand the question
  1. From prior to posterior
  2. Power posterior density
  3. Log evidence identity
  4. Censored log likelihood
  5. Temperature grid
Chapters 6–10 · Reproduce the example
  1. Expected log likelihoods
  2. Trapezoidal calculation -133.125
  3. Quadrature error
  4. Simpson and higher-order rules
  5. Curvature near beta zero
Chapters 11–15 · Check assumptions
  1. Independent chains by temperature
  2. Parallel tempering exchange
  3. Path design
  4. Normalising prior
  5. MCMC convergence
Chapters 16–20 · Explore applications
  1. Monte Carlo error
  2. Autocorrelation
  3. Multimodality
  4. Prior sensitivity
  5. Bayes factors
Chapters 21–25 · Study and verify
  1. Relation to bridge sampling
  2. Relation to stepping-stone methods
  3. Predictive validation
  4. Parent and student learning route
  5. Common misconceptions and next reading

CHAPTER 1 OF 25 · Understand the question

1. From prior to posterior

Back to contents

Begin at the prior end of the path. Beta zero gives the prior and beta one gives the ordinary posterior. Intermediate temperatures gradually introduce censored lifetime evidence. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Beta is an algorithmic path coordinate, not physical temperature. Define the powered target precisely.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Save the complete temperature grid, chain diagnostics and expected log likelihood at every beta. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use from prior to posterior as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Thermodynamic integration is an exact identity in theory, while a finite temperature grid creates a separate numerical approximation. That is why a careful report includes the construction, not only the final scalar.

Contents · Next chapter

CHAPTER 2 OF 25 · Understand the question

2. Power posterior density

Back to contents

Now follow the power posterior. The unnormalised target is likelihood raised to beta times the proper prior. At beta 0.5 the square root of likelihood tempers data influence. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Powering a log likelihood is multiplication by beta, not scaling the data. Compute in log space.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Quadrature error and Monte Carlo error are separate and both need checking. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use power posterior density as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 3 OF 25 · Understand the question

3. Log evidence identity

Back to contents

Integration turns local expectations into evidence. Differentiate the log normalising constant along beta to obtain expected log likelihood. Integrating the expectation from zero to one yields log p(y). This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Regularity and integrability conditions matter. State the path and endpoint definitions.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Curvature near beta zero often demands a denser or transformed grid. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use log evidence identity as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 4 OF 25 · Understand the question

4. Censored log likelihood

Back to contents

Begin at the prior end of the path. Every temperature uses the same failure-density and censoring-survival contributions. A censored unit contributes beta log S(c|theta). This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Changing coding across beta invalidates the path. Unit-test one failure and one censoring row.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Every power posterior must use the same likelihood, prior and data units. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use censored log likelihood as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Primary research: https://doi.org/10.1214/ss/1028905934. Read the authors’ definition and conditions before carrying the formula into a censored reliability model.

Contents · Previous chapter · Next chapter

CHAPTER 5 OF 25 · Understand the question

5. Temperature grid

Back to contents

Now follow the power posterior. Select beta values dense enough where the expected log likelihood bends sharply. A grid includes 0, .25, .5, .75 and 1 for illustration. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. A coarse uniform grid often misses curvature near zero. Use pilot runs and adaptive spacing.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat with a refined path and an independent evidence estimator when practical. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use temperature grid as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 6 OF 25 · Reproduce the example

6. Expected log likelihoods

Back to contents

Integration turns local expectations into evidence. At each beta, average log likelihood over draws from that power posterior. The five teaching values run from -160 to -115. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Unmixed chains make a biased curve. Diagnose every temperature.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Save the complete temperature grid, chain diagnostics and expected log likelihood at every beta. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use expected log likelihoods as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Thermodynamic integration is an exact identity in theory, while a finite temperature grid creates a separate numerical approximation. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 7 OF 25 · Reproduce the example

7. Trapezoidal calculation -133.125

Back to contents

Begin at the prior end of the path. Approximate the area with adjacent trapezoids of width .25. .25[(-160-115)/2-145-130-120]=-133.125. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. The negative signs make mental arithmetic easy to reverse. Recalculate segment by segment.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Quadrature error and Monte Carlo error are separate and both need checking. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use trapezoidal calculation -133.125 as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 8 OF 25 · Reproduce the example

8. Quadrature error

Back to contents

Now follow the power posterior. The trapezoidal rule approximates a curved function with straight segments. Adding beta points changes log evidence by 0.3. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Monte Carlo precision cannot remove discretisation bias. Refine the grid until stable.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Curvature near beta zero often demands a denser or transformed grid. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use quadrature error as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

BetaExpected log likelihood
0-160
0.25-145
0.50-130
0.75-120
1-115
Trapezoid log evidence-133.125
Thermodynamic-integration example.

Contents · Previous chapter · Next chapter

CHAPTER 9 OF 25 · Reproduce the example

9. Simpson and higher-order rules

Back to contents

Integration turns local expectations into evidence. Smoother curves can support more accurate quadrature when spacing and point count suit the rule. Simpson’s rule combines endpoint and midpoint values. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Higher order does not cure noisy or discontinuous estimates. Compare rules on the same curve.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Every power posterior must use the same likelihood, prior and data units. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use simpson and higher-order rules as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 10 OF 25 · Reproduce the example

10. Curvature near beta zero

Back to contents

Begin at the prior end of the path. Diffuse priors can create rapid change when a small amount of likelihood is introduced. Expected log likelihood rises sharply between beta 0 and .05. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. A uniform five-point grid misses this region. Use beta powers or adaptive knots.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat with a refined path and an independent evidence estimator when practical. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use curvature near beta zero as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 11 OF 25 · Check assumptions

11. Independent chains by temperature

Back to contents

Now follow the power posterior. One approach samples each beta separately. Twenty parallel MCMC runs cover the path. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Poor initialisation can trap neighbouring chains differently. Use warm starts and multiple chains.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Save the complete temperature grid, chain diagnostics and expected log likelihood at every beta. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use independent chains by temperature as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Thermodynamic integration is an exact identity in theory, while a finite temperature grid creates a separate numerical approximation. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 12 OF 25 · Check assumptions

12. Parallel tempering exchange

Back to contents

Integration turns local expectations into evidence. Coupled chains can swap states between temperatures to improve mode exploration. A hot chain crosses between reliability regimes. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Swap acceptance alone does not prove endpoint mixing. Inspect mode visits at every beta.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Quadrature error and Monte Carlo error are separate and both need checking. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use parallel tempering exchange as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Second authoritative source: https://doi.org/10.1214/ss/1028905934. Compare its prediction target, diagnostics and finite-sample cautions with this worked example.

Contents · Previous chapter · Next chapter

CHAPTER 13 OF 25 · Check assumptions

13. Path design

Back to contents

Begin at the prior end of the path. General path sampling can connect distributions through routes other than simple likelihood powers. A reference density bridges a difficult posterior. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. A poorly chosen path increases variance. Choose paths with overlap and smooth expectations.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Curvature near beta zero often demands a denser or transformed grid. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use path design as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 14 OF 25 · Check assumptions

14. Normalising prior

Back to contents

Now follow the power posterior. At beta zero, the prior must integrate to one for the endpoint constant to be known. Proper priors anchor the path. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. An improper prior makes log evidence undefined. Audit all prior constants.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Every power posterior must use the same likelihood, prior and data units. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use normalising prior as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 15 OF 25 · Check assumptions

15. MCMC convergence

Back to contents

Integration turns local expectations into evidence. Each expectation is a posterior-style Monte Carlo estimate. One temperature has low ESS for the Weibull shape. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. One bad point distorts the integral. Report diagnostics across the full grid.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat with a refined path and an independent evidence estimator when practical. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use mcmc convergence as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 16 OF 25 · Explore applications

16. Monte Carlo error

Back to contents

Begin at the prior end of the path. Finite draws create uncertainty in each ordinate and the integrated total. Repeated runs vary by 0.18 log units. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. A single smooth line can hide dependence. Repeat and propagate uncertainty.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Save the complete temperature grid, chain diagnostics and expected log likelihood at every beta. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use monte carlo error as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Thermodynamic integration is an exact identity in theory, while a finite temperature grid creates a separate numerical approximation. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 17 OF 25 · Explore applications

17. Autocorrelation

Back to contents

Now follow the power posterior. Power-posterior chains may mix differently at different temperatures. Beta .75 has long autocorrelation from a latent batch effect. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Equal iterations do not give equal information. Allocate computation by ESS.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Quadrature error and Monte Carlo error are separate and both need checking. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use autocorrelation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 18 OF 25 · Explore applications

18. Multimodality

Back to contents

Integration turns local expectations into evidence. Heating can help explore modes, but a badly spaced ladder may still isolate them. Two failure-mechanism modes exchange only at very low beta. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Missing one mode biases evidence. Check occupancy and use richer proposals.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Curvature near beta zero often demands a denser or transformed grid. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use multimodality as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 19 OF 25 · Explore applications

19. Prior sensitivity

Back to contents

Begin at the prior end of the path. Because the path begins at the prior, evidence responds directly to prior scale and shape. A wider frailty prior lowers integrated evidence. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. The method does not make priors objective. Repeat defensible alternatives.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Every power posterior must use the same likelihood, prior and data units. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use prior sensitivity as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 20 OF 25 · Explore applications

20. Bayes factors

Back to contents

Now follow the power posterior. Subtract two log evidence estimates and exponentiate the difference if useful. Log evidences -133.125 and -135.125 give log BF 2 and BF≈7.389. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Errors from two integrations combine. Report uncertainty in the difference.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat with a refined path and an independent evidence estimator when practical. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use bayes factors as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 21 OF 25 · Study and verify

21. Relation to bridge sampling

Back to contents

Integration turns local expectations into evidence. Path sampling uses a continuum of bridges, while bridge sampling uses identities between selected distributions. Both target normalising constants. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. One method is not automatically superior for every posterior. Benchmark cost and stability.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Save the complete temperature grid, chain diagnostics and expected log likelihood at every beta. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use relation to bridge sampling as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Thermodynamic integration is an exact identity in theory, while a finite temperature grid creates a separate numerical approximation. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 22 OF 25 · Study and verify

22. Relation to stepping-stone methods

Back to contents

Begin at the prior end of the path. Stepping-stone estimators use a sequence of power posteriors with ratio identities. The same temperature ladder can support another evidence estimator. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. Names and formulas should not be mixed. Label the implemented estimator.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Quadrature error and Monte Carlo error are separate and both need checking. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use relation to stepping-stone methods as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 23 OF 25 · Study and verify

23. Predictive validation

Back to contents

Now follow the power posterior. Integrated evidence does not measure later-batch calibration directly. The higher-evidence model misses new operating conditions. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. A model can win the path integral and lose in deployment. Add predictive checks and external data.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Curvature near beta zero often demands a denser or transformed grid. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use predictive validation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 24 OF 25 · Study and verify

24. Parent and student learning route

Back to contents

Integration turns local expectations into evidence. The method joins exponents, expectations, graphs, areas and numerical integration. Students can draw the five points and reproduce -133.125. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. The key is understanding area under a computational curve. Refine the grid and observe convergence.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Every power posterior must use the same likelihood, prior and data units. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use parent and student learning route as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Useful next reading: eduKate Mathematics Learning System, approach to learning mathematics, Bukit Timah Mathematics curriculum overview, cross-subject learning approach, nested likelihood-ratio guide, Mathematics Learning Hub. Choose the destination that matches the next question rather than treating links as a checklist.

Contents · Previous chapter · Next chapter

CHAPTER 25 OF 25 · Study and verify

25. Common misconceptions and next reading

Back to contents

Begin at the prior end of the path. Thermodynamic integration is not ordinary temperature measurement and beta is not a model probability. A dense grid cannot fix unmixed chains. This step matters because continuous evidence paths, numerical integration and reliability computation require the mathematical object, prediction target and reliability question to stay aligned. The evidence remains prior-sensitive. Read Gelman and Meng on path sampling.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat with a refined path and an independent evidence estimator when practical. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: apply the trapezoid rule to the five expected log-likelihood values, then refine the grid where the curve bends most. Use common misconceptions and next reading as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Quick answers

What must be fixed before comparing models? Use the same observations, censoring mechanism, time scale, likelihood convention and predictive unit.

Does a preferred value prove a model is true? No. The comparison is conditional on its candidates, data and assumptions.

Which mathematics matters? Algebra organises identities, logarithms stabilise products, probability represents uncertainty, variance measures instability and graphs expose influential cases.

How should a student practise? Preserve intermediate quantities, predict directions before calculating and change one input at a time.

What follows the comparison? Diagnostics, uncertainty analysis, posterior or predictive checks, later-data validation and a separate decision analysis when costs or safety matter.

Contents · Previous chapter · Mathematics Learning Hub

Extended practice laboratory

Practice case 1: From prior to posterior

Setup: Use this chapter’s illustrative case: Intermediate temperatures gradually introduce censored lifetime evidence.

Task: Define the powered target precisely.

Checking target: Beta is an algorithmic path coordinate, not physical temperature.

Practice case 2: Power posterior density

Setup: Use this chapter’s illustrative case: At beta 0.5 the square root of likelihood tempers data influence.

Task: Compute in log space.

Checking target: Powering a log likelihood is multiplication by beta, not scaling the data.

Practice case 3: Log evidence identity

Setup: Use this chapter’s illustrative case: Integrating the expectation from zero to one yields log p(y).

Task: State the path and endpoint definitions.

Checking target: Regularity and integrability conditions matter.

Practice case 4: Censored log likelihood

Setup: Use this chapter’s illustrative case: A censored unit contributes beta log S(c|theta).

Task: Unit-test one failure and one censoring row.

Checking target: Changing coding across beta invalidates the path.

Practice case 5: Temperature grid

Setup: Use this chapter’s illustrative case: A grid includes 0, .25, .5, .75 and 1 for illustration.

Task: Use pilot runs and adaptive spacing.

Checking target: A coarse uniform grid often misses curvature near zero.

Practice case 6: Expected log likelihoods

Setup: Use this chapter’s illustrative case: The five teaching values run from -160 to -115.

Task: Diagnose every temperature.

Checking target: Unmixed chains make a biased curve.

Practice case 7: Trapezoidal calculation -133.125

Setup: Use this chapter’s illustrative case: .25[(-160-115)/2-145-130-120]=-133.125.

Task: Recalculate segment by segment.

Checking target: The negative signs make mental arithmetic easy to reverse.

Practice case 8: Quadrature error

Setup: Use this chapter’s illustrative case: Adding beta points changes log evidence by 0.3.

Task: Refine the grid until stable.

Checking target: Monte Carlo precision cannot remove discretisation bias.

Practice case 9: Simpson and higher-order rules

Setup: Use this chapter’s illustrative case: Simpson’s rule combines endpoint and midpoint values.

Task: Compare rules on the same curve.

Checking target: Higher order does not cure noisy or discontinuous estimates.

Practice case 10: Curvature near beta zero

Setup: Use this chapter’s illustrative case: Expected log likelihood rises sharply between beta 0 and .05.

Task: Use beta powers or adaptive knots.

Checking target: A uniform five-point grid misses this region.