VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

Why Mathematics? | Sequential Monte Carlo Samplers for Bayesian Reliability Models: Particle Weights, Effective Sample Size, Resampling and Evidence

Choose your reading route

eduKateSG · Why Mathematics? · Sequential Monte Carlo Samplers for Bayesian Reliability Models: Particle Weights, Effective Sample Size, Resampling and Evidence

Start with the question, audit the worked example, or jump to the assumptions and practice. Every chapter stays open for uninterrupted reading.

Full chapter index · Practice and checking · Mathematics Learning Hub

The importance of mathematics becomes practical when a Bayesian reliability posterior is approached through a population of weighted particles. Sequential Monte Carlo samplers propagate particles across a sequence of distributions, update their importance weights, resample when weights become too uneven and apply Markov moves to restore diversity. The same computation can estimate ratios of normalising constants, including marginal likelihood.

In a simple diagnostic example, normalised weights 0.10, 0.20, 0.30 and 0.40 have effective sample size ESS=1/(0.01+0.04+0.09+0.16)=3.333. In a separate normalising-constant illustration, incremental mean weights 0.75 and 0.80 multiply to 0.60, giving log ratio log(0.60)=-0.51083. This guide develops particles, tempering, resampling, rejuvenation, evidence estimates, censoring, multimodality and reproducibility.

Full chapter index

Chapters 1–5 · Understand the question
  1. A sequence of target distributions
  2. Particle population
  3. Incremental importance weights
  4. Normalising the weights
  5. Worked effective sample size
Chapters 6–10 · Reproduce the example
  1. Weight degeneracy
  2. Resampling decision
  3. Multinomial and lower-variance schemes
  4. Ancestral duplication
  5. MCMC rejuvenation
Chapters 11–15 · Check assumptions
  1. Adaptive tempering
  2. Censored likelihood
  3. Evidence from incremental means
  4. Worked log ratio -0.51083
  5. Monte Carlo error
Chapters 16–20 · Explore applications
  1. Genealogical degeneracy
  2. Multimodality
  3. High-dimensional parameters
  4. Parallel computation
  5. Prior sensitivity
Chapters 21–25 · Study and verify
  1. Relation to particle filters
  2. Relation to AIS
  3. Predictive summaries
  4. Parent and student learning route
  5. Common misconceptions and next reading

CHAPTER 1 OF 25 · Understand the question

1. A sequence of target distributions

Back to contents

Begin with a weighted particle cloud. SMC samplers approximate a path of distributions defined on a common parameter space. Power posteriors move from a proper prior to a reliability posterior. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. The sequence index is algorithmic, not calendar time. Define every target.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Record targets, incremental potentials, particle counts, ESS thresholds, resampling schemes and kernels. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use a sequence of target distributions as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Resampling can equalise particle weights while simultaneously reducing the number of distinct ancestors. That is why a careful report includes the construction, not only the final scalar.

Contents · Next chapter

CHAPTER 2 OF 25 · Understand the question

2. Particle population

Back to contents

Now adapt when weights become uneven. Represent each target by many parameter particles and weights. Two thousand particles carry Weibull shape and scale values. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Particles are not automatically independent posterior draws. Preserve ancestry and weights.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep ancestry so high current ESS cannot hide genealogical collapse. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use particle population as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 3 OF 25 · Understand the question

3. Incremental importance weights

Back to contents

Resampling and rejuvenation serve different jobs. When the target changes, update each weight by the appropriate density ratio. A beta increase multiplies by likelihood to the beta difference. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Omitting proposal or backward-kernel terms biases a general SMC sampler. Derive the exact ratio.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Validate every evidence contribution and weighted summary before discarding weights. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use incremental importance weights as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 4 OF 25 · Understand the question

4. Normalising the weights

Back to contents

Begin with a weighted particle cloud. Divide positive unnormalised weights by their sum. Four weights become 0.10, 0.20, 0.30 and 0.40. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Rounding can make displayed weights fail to sum exactly to one. Calculate with full precision.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat full runs with independent seeds and compare adaptive temperature ladders. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use normalising the weights as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Primary research: https://doi.org/10.1111/j.1467-9868.2006.00553.x. Read the authors’ definition and conditions before carrying the formula into a censored reliability model.

Contents · Previous chapter · Next chapter

CHAPTER 5 OF 25 · Understand the question

5. Worked effective sample size

Back to contents

Now adapt when weights become uneven. Compute one divided by the sum of squared normalised weights. 1/(.01+.04+.09+.16)=3.333. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. ESS is a diagnostic equivalent count, not the number of distinct parameter values. Report the formula.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check mode survival, parameter movement and prior sensitivity together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use worked effective sample size as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

QuantityValue
Normalised weights0.10, 0.20, 0.30, 0.40
Sum squared weights0.30
ESS3.333
Incremental means0.75, 0.80
Normalising ratio0.60
Log ratio-0.51083
Sequential-Monte-Carlo diagnostics.

Contents · Previous chapter · Next chapter

CHAPTER 6 OF 25 · Reproduce the example

6. Weight degeneracy

Back to contents

Resampling and rejuvenation serve different jobs. As targets separate, a few particles may receive nearly all weight. One particle owns 70 percent after a large beta step. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Increasing nominal particle count does not guarantee a healthy ESS. Adapt the next step.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Record targets, incremental potentials, particle counts, ESS thresholds, resampling schemes and kernels. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use weight degeneracy as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Resampling can equalise particle weights while simultaneously reducing the number of distinct ancestors. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 7 OF 25 · Reproduce the example

7. Resampling decision

Back to contents

Begin with a weighted particle cloud. Resample when ESS falls below a chosen threshold. Trigger at half the particle count. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Resampling at every tiny step adds variance and computation. State the threshold.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep ancestry so high current ESS cannot hide genealogical collapse. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use resampling decision as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 8 OF 25 · Reproduce the example

8. Multinomial and lower-variance schemes

Back to contents

Now adapt when weights become uneven. Systematic, stratified and residual resampling can reduce variance relative to multinomial choices. Systematic resampling uses one random offset. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. No scheme restores modes already lost. Record the method and seed.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Validate every evidence contribution and weighted summary before discarding weights. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use multinomial and lower-variance schemes as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 9 OF 25 · Reproduce the example

9. Ancestral duplication

Back to contents

Resampling and rejuvenation serve different jobs. Resampling copies high-weight particles and discards low-weight ones. The 0.40 particle may receive two descendants. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Equal weights after resampling do not mean diverse states. Track unique ancestors.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat full runs with independent seeds and compare adaptive temperature ladders. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use ancestral duplication as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 10 OF 25 · Reproduce the example

10. MCMC rejuvenation

Back to contents

Begin with a weighted particle cloud. Apply a kernel invariant to the new target after resampling. Several Metropolis steps move duplicated Weibull particles. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. A low-acceptance kernel leaves clones unchanged. Diagnose acceptance and movement.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check mode survival, parameter movement and prior sensitivity together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use mcmc rejuvenation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 11 OF 25 · Check assumptions

11. Adaptive tempering

Back to contents

Now adapt when weights become uneven. Choose the next beta so predicted ESS reaches a target. A bisection search finds a beta increment. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Data-dependent schedules complicate exact replication without saved states. Archive every chosen beta.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Record targets, incremental potentials, particle counts, ESS thresholds, resampling schemes and kernels. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use adaptive tempering as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Resampling can equalise particle weights while simultaneously reducing the number of distinct ancestors. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 12 OF 25 · Check assumptions

12. Censored likelihood

Back to contents

Resampling and rejuvenation serve different jobs. Each particle evaluates failures with densities and censored units with survival probabilities. Log likelihood is cached across beta updates. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. A coding inconsistency affects every weight. Test one failure and one censoring case.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep ancestry so high current ESS cannot hide genealogical collapse. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use censored likelihood as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Second authoritative source: https://doi.org/10.1111/j.1467-9868.2006.00553.x. Compare its prediction target, diagnostics and finite-sample cautions with this worked example.

Contents · Previous chapter · Next chapter

CHAPTER 13 OF 25 · Check assumptions

13. Evidence from incremental means

Back to contents

Begin with a weighted particle cloud. The ratio of adjacent normalising constants can be estimated by the weighted mean of incremental potentials. Stage means 0.75 and 0.80 multiply to 0.60. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. A product of normalised weights is not the same estimator. Store each stage contribution.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Validate every evidence contribution and weighted summary before discarding weights. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use evidence from incremental means as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 14 OF 25 · Check assumptions

14. Worked log ratio -0.51083

Back to contents

Now adapt when weights become uneven. Take the log of 0.60 or sum log 0.75 and log 0.80. The result is about -0.51083. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Products underflow across long paths. Accumulate log ratios.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat full runs with independent seeds and compare adaptive temperature ladders. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use worked log ratio -0.51083 as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 15 OF 25 · Check assumptions

15. Monte Carlo error

Back to contents

Resampling and rejuvenation serve different jobs. Repeated SMC runs quantify variability from particles, resampling and moves. Ten runs have log-evidence standard deviation 0.08. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. One large population does not reveal all instability. Repeat with independent seeds.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check mode survival, parameter movement and prior sensitivity together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use monte carlo error as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 16 OF 25 · Explore applications

16. Genealogical degeneracy

Back to contents

Begin with a weighted particle cloud. Repeated resampling can leave the final cloud descended from very few early particles. Two thousand particles trace to twelve prior ancestors. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Current ESS can look high while path diversity is poor. Inspect ancestry.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Record targets, incremental potentials, particle counts, ESS thresholds, resampling schemes and kernels. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use genealogical degeneracy as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Resampling can equalise particle weights while simultaneously reducing the number of distinct ancestors. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 17 OF 25 · Explore applications

17. Multimodality

Back to contents

Now adapt when weights become uneven. A particle population can represent several modes if tempering and movement preserve them. Particles split between two failure mechanisms. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Resampling can accidentally eliminate a smaller mode. Use enough particles and mode-aware moves.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep ancestry so high current ESS cannot hide genealogical collapse. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use multimodality as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 18 OF 25 · Explore applications

18. High-dimensional parameters

Back to contents

Resampling and rejuvenation serve different jobs. Importance weights become more variable as dimension grows. Many frailty effects make a beta step difficult. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. More particles alone may scale poorly. Use blocked kernels and careful paths.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Validate every evidence contribution and weighted summary before discarding weights. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use high-dimensional parameters as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 19 OF 25 · Explore applications

19. Parallel computation

Back to contents

Begin with a weighted particle cloud. Weight calculations and particle moves often parallelise. Each worker updates a subset of particles. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Resampling and global ESS still require coordination. Design deterministic aggregation.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat full runs with independent seeds and compare adaptive temperature ladders. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use parallel computation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 20 OF 25 · Explore applications

20. Prior sensitivity

Back to contents

Now adapt when weights become uneven. The starting population and evidence depend on the proper prior. A diffuse latent-variance prior broadens early particles. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. SMC does not create an objective evidence scale. Repeat defensible priors.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check mode survival, parameter movement and prior sensitivity together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use prior sensitivity as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 21 OF 25 · Study and verify

21. Relation to particle filters

Back to contents

Resampling and rejuvenation serve different jobs. Particle filters usually advance latent states through observation time; SMC samplers can advance through artificial distributions on a fixed parameter space. Both use weights and resampling. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Calling every SMC sampler a time-series filter is misleading. Name the sequence being traversed.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Record targets, incremental potentials, particle counts, ESS thresholds, resampling schemes and kernels. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use relation to particle filters as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Resampling can equalise particle weights while simultaneously reducing the number of distinct ancestors. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 22 OF 25 · Study and verify

22. Relation to AIS

Back to contents

Begin with a weighted particle cloud. AIS uses independent weighted annealing paths, while SMC adds population resampling and often adaptive schedules. Both may use identical power posteriors and MCMC kernels. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Resampling changes dependence and diagnostics. Match claims to mechanics.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Keep ancestry so high current ESS cannot hide genealogical collapse. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use relation to ais as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 23 OF 25 · Study and verify

23. Predictive summaries

Back to contents

Now adapt when weights become uneven. Weighted particles estimate posterior means, survival curves and model evidence. Mission survival is a weighted average before resampling. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Discarding weights too early biases summaries. Use the correct stage weights.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Validate every evidence contribution and weighted summary before discarding weights. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use predictive summaries as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 24 OF 25 · Study and verify

24. Parent and student learning route

Back to contents

Resampling and rejuvenation serve different jobs. SMC connects fractions, squares, averages, probability, algorithms and simulation. Students can reproduce ESS 3.333 and log 0.60. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. The central idea is keeping a population useful as the target changes. Move counters across a sequence of weighted boxes.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Repeat full runs with independent seeds and compare adaptive temperature ladders. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use parent and student learning route as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Useful next reading: Bukit Timah Mathematics curriculum overview, cross-subject learning approach, nested likelihood-ratio guide, Mathematics Learning Hub, eduKate Mathematics Learning System, approach to learning mathematics. Choose the destination that matches the next question rather than treating links as a checklist.

Contents · Previous chapter · Next chapter

CHAPTER 25 OF 25 · Study and verify

25. Common misconceptions and next reading

Back to contents

Begin with a weighted particle cloud. Sequential Monte Carlo samplers are not restricted to time-series filtering and ESS is not a guarantee of mode coverage. Resampling controls weights but can reduce ancestry. This step matters because weighted particle populations, adaptive resampling and evidence require the mathematical object, prediction target and reliability question to stay aligned. Valid kernels and proper density ratios remain essential. Read Del Moral, Doucet and Jasra and compare AIS.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check mode survival, parameter movement and prior sensitivity together. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: normalise four particle weights, calculate ESS, then multiply two incremental normalising-constant estimates. Use common misconceptions and next reading as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Quick answers

What must be fixed before comparing models? Use the same observations, censoring mechanism, time scale, likelihood convention and predictive unit.

Does a preferred value prove a model is true? No. The comparison is conditional on its candidates, data and assumptions.

Which mathematics matters? Algebra organises identities, logarithms stabilise products, probability represents uncertainty, variance measures instability and graphs expose influential cases.

How should a student practise? Preserve intermediate quantities, predict directions before calculating and change one input at a time.

What follows the comparison? Diagnostics, uncertainty analysis, posterior or predictive checks, later-data validation and a separate decision analysis when costs or safety matter.

Contents · Previous chapter · Mathematics Learning Hub

Extended practice laboratory

Practice case 1: A sequence of target distributions

Setup: Use this chapter’s illustrative case: Power posteriors move from a proper prior to a reliability posterior.

Task: Define every target.

Checking target: The sequence index is algorithmic, not calendar time.

Practice case 2: Particle population

Setup: Use this chapter’s illustrative case: Two thousand particles carry Weibull shape and scale values.

Task: Preserve ancestry and weights.

Checking target: Particles are not automatically independent posterior draws.

Practice case 3: Incremental importance weights

Setup: Use this chapter’s illustrative case: A beta increase multiplies by likelihood to the beta difference.

Task: Derive the exact ratio.

Checking target: Omitting proposal or backward-kernel terms biases a general SMC sampler.

Practice case 4: Normalising the weights

Setup: Use this chapter’s illustrative case: Four weights become 0.10, 0.20, 0.30 and 0.40.

Task: Calculate with full precision.

Checking target: Rounding can make displayed weights fail to sum exactly to one.

Practice case 5: Worked effective sample size

Setup: Use this chapter’s illustrative case: 1/(.01+.04+.09+.16)=3.333.

Task: Report the formula.

Checking target: ESS is a diagnostic equivalent count, not the number of distinct parameter values.

Practice case 6: Weight degeneracy

Setup: Use this chapter’s illustrative case: One particle owns 70 percent after a large beta step.

Task: Adapt the next step.

Checking target: Increasing nominal particle count does not guarantee a healthy ESS.

Practice case 7: Resampling decision

Setup: Use this chapter’s illustrative case: Trigger at half the particle count.

Task: State the threshold.

Checking target: Resampling at every tiny step adds variance and computation.

Practice case 8: Multinomial and lower-variance schemes

Setup: Use this chapter’s illustrative case: Systematic resampling uses one random offset.

Task: Record the method and seed.

Checking target: No scheme restores modes already lost.

Practice case 9: Ancestral duplication

Setup: Use this chapter’s illustrative case: The 0.40 particle may receive two descendants.

Task: Track unique ancestors.

Checking target: Equal weights after resampling do not mean diverse states.

Practice case 10: MCMC rejuvenation

Setup: Use this chapter’s illustrative case: Several Metropolis steps move duplicated Weibull particles.

Task: Diagnose acceptance and movement.

Checking target: A low-acceptance kernel leaves clones unchanged.