VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

Why Mathematics? | Vuong Tests for Non-Nested Reliability Models: Pointwise Log-Likelihood Ratios, Directional Evidence and Model Limits

The benefits of learning mathematics become concrete when two reliability distributions are plausible but neither is a restricted version of the other. A standard nested likelihood-ratio test cannot compare Weibull and lognormal families directly. Vuong's framework instead studies the observation-level log-likelihood ratio m_i = log p_A(y_i) – log p_B(y_i), asking whether the models are equally close to the data-generating process in Kullback-Leibler terms under stated conditions.

This guide develops non-nestedness, censored pointwise likelihoods, mean log-likelihood differences, variance standardisation, directional interpretation, distinguishability, corrections and validation. With n=100 independent units, mean m=0.08 and sample standard deviation s_m=0.40, the uncorrected statistic is sqrt(100)×0.08/0.40=2.0, giving an approximate two-sided standard-normal p-value of 0.0455. Positive values favour model A in the defined direction. That result is not a universal winner: dependence, overlap, misspecification, small samples, multiple testing and different censoring mechanisms can invalidate a naive calculation.

Full chapter index

Chapters 1–5 · Understand the question
  1. Why the nested LRT does not apply
  2. Pointwise log-likelihood ratios
  3. Censored contributions
  4. Mean log-likelihood difference
  5. Sample standard deviation
Chapters 6–10 · Reproduce the example
  1. Completing the statistic 2.0
  2. Approximate two-sided p-value
  3. Directional interpretation
  4. Equal closeness is not equal truth
  5. Distinguishability and overlapping models
Chapters 11–15 · Check assumptions
  1. Model misspecification
  2. Same data and likelihood scale
  3. Independence assumption
  4. Serial and recurrent reliability data
  5. Complexity corrections
Chapters 16–20 · Explore applications
  1. Small-sample behaviour
  2. Outliers and influential failures
  3. Heavy censoring
  4. Multiple pairwise comparisons
  5. Effect size
Chapters 21–25 · Study and verify
  1. Prediction validation
  2. Physical mechanism
  3. Decision consequences
  4. Parent and student learning route
  5. Common misconceptions and next reading

CHAPTER 1 OF 25 · Understand the question

1. Why the nested LRT does not apply

Back to contents

Put the two non-nested models side by side. A nested test requires one model to arise by restricting parameters of the other. Weibull and lognormal lifetime families are usually non-nested. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Equal parameter counts do not make models nested. Write each density and test for a restriction mapping.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use why the nested lrt does not apply as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.

Contents · Next chapter

CHAPTER 2 OF 25 · Understand the question

2. Pointwise log-likelihood ratios

Back to contents

Direction must remain explicit. For every independent unit compute m_i=log p_A(y_i)-log p_B(y_i). A positive contribution means model A assigns more likelihood to that observation. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Total log likelihood alone hides the variability of contributions. Preserve the pointwise vector.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use pointwise log-likelihood ratios as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 3 OF 25 · Understand the question

3. Censored contributions

Back to contents

The reference calculation depends on design. An exact failure contributes log f_A(t)-log f_B(t), while a right-censored unit contributes log S_A(c)-log S_B(c). A survivor at 500 hours compares two log survival probabilities. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Treating censoring as failure changes direction. Use the same observation mechanism in both models.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use censored contributions as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 4 OF 25 · Understand the question

4. Mean log-likelihood difference

Back to contents

Put the two non-nested models side by side. Average m_i across n independent units to estimate the expected relative log-likelihood contribution. The worked mean is 0.08 in favour of A. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. A small mean can arise from large positive and negative cases. Plot the distribution of m_i.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use mean log-likelihood difference as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Primary research: https://doi.org/10.2307/1912557. Read the authors’ definition and conditions before carrying the formula into a censored reliability model.

Contents · Previous chapter · Next chapter

CHAPTER 5 OF 25 · Understand the question

5. Sample standard deviation

Back to contents

Direction must remain explicit. Estimate the variability of pointwise log-likelihood ratios with their sample standard deviation. The worked s_m is 0.40. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Near-zero variance signals overlapping or observationally equivalent models and needs special handling. Check distinguishability before standardising.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use sample standard deviation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 6 OF 25 · Reproduce the example

6. Completing the statistic 2.0

Back to contents

The reference calculation depends on design. Multiply the mean by sqrt(n) and divide by s_m under the ordinary independent-observation form. sqrt(100) times .08 divided by .40 equals 2.0. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Forgetting sqrt(n) changes the scale completely. Write the numerator and denominator separately.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use completing the statistic 2.0 as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.

QuantityValue
Independent units n100
Mean log-likelihood ratio0.08
Sample standard deviation0.40
Statistic2.0
Approximate two-sided normal p-value0.0455
Vuong worked example.

Contents · Previous chapter · Next chapter

CHAPTER 7 OF 25 · Reproduce the example

7. Approximate two-sided p-value

Back to contents

Put the two non-nested models side by side. Under the null and regular non-overlapping conditions, compare the statistic with a standard normal reference. |2.0| gives an approximate two-sided p-value 0.0455. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. The approximation can be poor in small or irregular samples. Report the reference assumptions.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use approximate two-sided p-value as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 8 OF 25 · Reproduce the example

8. Directional interpretation

Back to contents

Direction must remain explicit. A large positive statistic favours model A and a large negative statistic favours model B under the defined m_i direction. Reversing A and B changes the sign but not the two-sided p-value. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. A sign error reverses the narrative. Print the definition beside the result.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use directional interpretation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 9 OF 25 · Reproduce the example

9. Equal closeness is not equal truth

Back to contents

The reference calculation depends on design. The null concerns equal Kullback-Leibler closeness within the comparison, not literal truth of both models. Two wrong lifetime families can be equally close. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Non-rejection does not prove equivalence. Add adequacy checks for each model.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use equal closeness is not equal truth as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 10 OF 25 · Reproduce the example

10. Distinguishability and overlapping models

Back to contents

Put the two non-nested models side by side. If models can generate the same distribution for some parameters, the variance of m_i may vanish and the usual non-nested normal test is not the correct first step. Two parameterisations overlap at a special distribution. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Dividing by a tiny s_m is unstable. Use the framework's distinguishability analysis.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use distinguishability and overlapping models as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 11 OF 25 · Check assumptions

11. Model misspecification

Back to contents

Direction must remain explicit. Vuong's paper treats cases where both, one or neither candidate is correctly specified, but each case has conditions and interpretation. Both models omit a load-dependent hazard. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. A preferred approximation can remain scientifically inadequate. Inspect residuals and mechanism plausibility.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use model misspecification as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 12 OF 25 · Check assumptions

12. Same data and likelihood scale

Back to contents

The reference calculation depends on design. Both fitted models must use the same observations, response transformation and likelihood constants. Every candidate includes all 100 units. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Different dropped rows or density units make m_i meaningless. Freeze preprocessing and time units.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use same data and likelihood scale as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Second authoritative source: https://www.itl.nist.gov/div898/handbook/apr/section2/apr21.htm. Compare its prediction target, diagnostics and finite-sample cautions with this worked example.

Contents · Previous chapter · Next chapter

CHAPTER 13 OF 25 · Check assumptions

13. Independence assumption

Back to contents

Put the two non-nested models side by side. The basic variance formula treats pointwise contributions as independent across units. Components from one production batch share conditions. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Ignoring clustering understates uncertainty. Use cluster-robust or resampling methods.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use independence assumption as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 14 OF 25 · Check assumptions

14. Serial and recurrent reliability data

Back to contents

Direction must remain explicit. Repeated failures or degradation readings create within-unit dependence and require a predictive-unit or dependence-aware comparison. Many rows belong to one machine trajectory. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Row-level n exaggerates information. Aggregate or model the dependence explicitly.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use serial and recurrent reliability data as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 15 OF 25 · Check assumptions

15. Complexity corrections

Back to contents

The reference calculation depends on design. AIC- or BIC-style corrections can adjust the log-likelihood comparison for different parameter counts. Model A has more fitted coefficients than B. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Corrected and uncorrected tests answer slightly different selection questions. State the exact correction formula.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use complexity corrections as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 16 OF 25 · Explore applications

16. Small-sample behaviour

Back to contents

Put the two non-nested models side by side. The normal reference is asymptotic and can be inaccurate with few failures, heavy tails or highly variable m_i. Ten failures drive a hundred-unit comparison. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. A p-value near .05 is especially fragile. Use simulation or bootstrap sensitivity.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use small-sample behaviour as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 17 OF 25 · Explore applications

17. Outliers and influential failures

Back to contents

Direction must remain explicit. One unit with a huge log-likelihood ratio can dominate the mean and variance. An extreme early failure strongly favours one tail shape. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Deleting it silently changes the population. Verify provenance and report influence.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use outliers and influential failures as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 18 OF 25 · Explore applications

18. Heavy censoring

Back to contents

The reference calculation depends on design. When most records are censored early, survival contributions may not distinguish late-life tail shapes. Both models assign similar S(c) before wear-out. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. The test may have little power for the operational horizon. Design follow-up around the target difference.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use heavy censoring as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 19 OF 25 · Explore applications

19. Multiple pairwise comparisons

Back to contents

Put the two non-nested models side by side. Testing many model pairs and reporting only a favourable result inflates false-positive risk. Six distributions produce fifteen pairwise tests. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Unadjusted .05 no longer describes the search. Pre-specify candidates or adjust multiplicity.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use multiple pairwise comparisons as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 20 OF 25 · Explore applications

20. Effect size

Back to contents

Direction must remain explicit. The statistic standardises a mean log-likelihood difference but does not express survival-hours improvement or calibration at a mission time. Statistic 2.0 may correspond to a modest practical contrast. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Statistical preference is not operational importance. Report survival and hazard differences.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use effect size as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 21 OF 25 · Study and verify

21. Prediction validation

Back to contents

The reference calculation depends on design. A directional test on development data does not replace held-out predictive evaluation. Model A wins the test but loses on later batches. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Selection optimism remains possible. Use cross-validation or external validation.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use prediction validation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.

Contents · Previous chapter · Next chapter

CHAPTER 22 OF 25 · Study and verify

22. Physical mechanism

Back to contents

Put the two non-nested models side by side. Reliability distributions should remain compatible with failure physics and test design. A lognormal multiplicative-degradation argument may be more credible than a slightly better numerical fit. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Mechanism claims need evidence beyond the test. Separate statistical ranking from engineering interpretation.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use physical mechanism as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 23 OF 25 · Study and verify

23. Decision consequences

Back to contents

Direction must remain explicit. Vuong's statistic contains no downtime cost, safety loss or maintenance threshold. A preferred tail model may not change the action over the mission window. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Likelihood closeness and utility are different. Evaluate decisions separately.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use decision consequences as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Contents · Previous chapter · Next chapter

CHAPTER 24 OF 25 · Study and verify

24. Parent and student learning route

Back to contents

The reference calculation depends on design. The test connects logarithms, means, standard deviation, square roots and conditional probability. Students can verify 10×.08/.40=2.0. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. The deeper skill is deciding whether models are truly non-nested and observations independent. Draw a model-map before calculating.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use parent and student learning route as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Useful next reading: Bukit Timah Mathematics curriculum overview, cross-subject learning approach, nested likelihood-ratio guide, Mathematics Learning Hub, eduKate Mathematics Learning System, approach to learning mathematics. Choose the destination that matches the next question rather than treating links as a checklist.

Contents · Previous chapter · Next chapter

CHAPTER 25 OF 25 · Study and verify

25. Common misconceptions and next reading

Back to contents

Put the two non-nested models side by side. The Vuong test is not the ordinary nested LRT, a positive sign is not proof of truth and p=0.0455 is not a model probability. Overlap and dependence change the reference theory. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Predictive validation remains essential. Read Vuong's paper with NIST reliability model-selection guidance, then reproduce 2.0.

A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.

Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use common misconceptions and next reading as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.

Quick answers

What must be fixed before comparing models? Use the same observations, censoring mechanism, time scale, likelihood convention and predictive unit.

Does a preferred value prove a model is true? No. The comparison is conditional on its candidates, data and assumptions.

Which mathematics matters? Algebra organises identities, logarithms stabilise products, probability represents uncertainty, variance measures instability and graphs expose influential cases.

How should a student practise? Preserve intermediate quantities, predict directions before calculating and change one input at a time.

What follows the comparison? Diagnostics, uncertainty analysis, posterior or predictive checks, later-data validation and a separate decision analysis when costs or safety matter.

Contents · Previous chapter · Mathematics Learning Hub

Extended practice laboratory

Practice case 1: Why the nested LRT does not apply

Setup: Use this chapter’s illustrative case: Weibull and lognormal lifetime families are usually non-nested.

Task: Write each density and test for a restriction mapping.

Checking target: Equal parameter counts do not make models nested.

Practice case 2: Pointwise log-likelihood ratios

Setup: Use this chapter’s illustrative case: A positive contribution means model A assigns more likelihood to that observation.

Task: Preserve the pointwise vector.

Checking target: Total log likelihood alone hides the variability of contributions.

Practice case 3: Censored contributions

Setup: Use this chapter’s illustrative case: A survivor at 500 hours compares two log survival probabilities.

Task: Use the same observation mechanism in both models.

Checking target: Treating censoring as failure changes direction.

Practice case 4: Mean log-likelihood difference

Setup: Use this chapter’s illustrative case: The worked mean is 0.08 in favour of A.

Task: Plot the distribution of m_i.

Checking target: A small mean can arise from large positive and negative cases.

Practice case 5: Sample standard deviation

Setup: Use this chapter’s illustrative case: The worked s_m is 0.40.

Task: Check distinguishability before standardising.

Checking target: Near-zero variance signals overlapping or observationally equivalent models and needs special handling.

Practice case 6: Completing the statistic 2.0

Setup: Use this chapter’s illustrative case: sqrt(100) times .08 divided by .40 equals 2.0.

Task: Write the numerator and denominator separately.

Checking target: Forgetting sqrt(n) changes the scale completely.

Practice case 7: Approximate two-sided p-value

Setup: Use this chapter’s illustrative case: |2.0| gives an approximate two-sided p-value 0.0455.

Task: Report the reference assumptions.

Checking target: The approximation can be poor in small or irregular samples.

Practice case 8: Directional interpretation

Setup: Use this chapter’s illustrative case: Reversing A and B changes the sign but not the two-sided p-value.

Task: Print the definition beside the result.

Checking target: A sign error reverses the narrative.

Practice case 9: Equal closeness is not equal truth

Setup: Use this chapter’s illustrative case: Two wrong lifetime families can be equally close.

Task: Add adequacy checks for each model.

Checking target: Non-rejection does not prove equivalence.

Practice case 10: Distinguishability and overlapping models

Setup: Use this chapter’s illustrative case: Two parameterisations overlap at a special distribution.

Task: Use the framework's distinguishability analysis.

Checking target: Dividing by a tiny s_m is unstable.