Choose your reading route
eduKateSG · Why Mathematics? · Vuong Tests for Non-Nested Reliability Models: Pointwise Log-Likelihood Ratios, Directional Evidence and Model Limits
Start with the question, audit the worked example, or jump to the assumptions and practice. Every chapter stays open for uninterrupted reading.
Understand the question
Define the quantity and follow the mechanism.Route 2 · Chapters 6–10
Reproduce the example
Audit the numbers one step at a time.Route 3 · Chapters 11–15
Check assumptions
See where design and calibration matter.Route 4 · Chapters 16–20
Explore applications
Connect the method to a concrete investigation.Route 5 · Chapters 21–25
Study and verify
Practise, inspect failure cases and read further.
Full chapter index · Practice and checking · Mathematics Learning Hub
The benefits of learning mathematics become concrete when two reliability distributions are plausible but neither is a restricted version of the other. A standard nested likelihood-ratio test cannot compare Weibull and lognormal families directly. Vuong's framework instead studies the observation-level log-likelihood ratio m_i = log p_A(y_i) – log p_B(y_i), asking whether the models are equally close to the data-generating process in Kullback-Leibler terms under stated conditions.
This guide develops non-nestedness, censored pointwise likelihoods, mean log-likelihood differences, variance standardisation, directional interpretation, distinguishability, corrections and validation. With n=100 independent units, mean m=0.08 and sample standard deviation s_m=0.40, the uncorrected statistic is sqrt(100)×0.08/0.40=2.0, giving an approximate two-sided standard-normal p-value of 0.0455. Positive values favour model A in the defined direction. That result is not a universal winner: dependence, overlap, misspecification, small samples, multiple testing and different censoring mechanisms can invalidate a naive calculation.
Full chapter index
Chapters 1–5 · Understand the question
Chapters 6–10 · Reproduce the example
Chapters 11–15 · Check assumptions
Chapters 16–20 · Explore applications
Chapters 21–25 · Study and verify
Put the two non-nested models side by side. A nested test requires one model to arise by restricting parameters of the other. Weibull and lognormal lifetime families are usually non-nested. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Equal parameter counts do not make models nested. Write each density and test for a restriction mapping.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use why the nested lrt does not apply as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.
Direction must remain explicit. For every independent unit compute m_i=log p_A(y_i)-log p_B(y_i). A positive contribution means model A assigns more likelihood to that observation. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Total log likelihood alone hides the variability of contributions. Preserve the pointwise vector.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use pointwise log-likelihood ratios as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
The reference calculation depends on design. An exact failure contributes log f_A(t)-log f_B(t), while a right-censored unit contributes log S_A(c)-log S_B(c). A survivor at 500 hours compares two log survival probabilities. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Treating censoring as failure changes direction. Use the same observation mechanism in both models.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use censored contributions as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Put the two non-nested models side by side. Average m_i across n independent units to estimate the expected relative log-likelihood contribution. The worked mean is 0.08 in favour of A. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. A small mean can arise from large positive and negative cases. Plot the distribution of m_i.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use mean log-likelihood difference as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Primary research: https://doi.org/10.2307/1912557. Read the authors’ definition and conditions before carrying the formula into a censored reliability model.
Direction must remain explicit. Estimate the variability of pointwise log-likelihood ratios with their sample standard deviation. The worked s_m is 0.40. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Near-zero variance signals overlapping or observationally equivalent models and needs special handling. Check distinguishability before standardising.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use sample standard deviation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
The reference calculation depends on design. Multiply the mean by sqrt(n) and divide by s_m under the ordinary independent-observation form. sqrt(100) times .08 divided by .40 equals 2.0. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Forgetting sqrt(n) changes the scale completely. Write the numerator and denominator separately.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use completing the statistic 2.0 as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.
| Quantity | Value |
|---|---|
| Independent units n | 100 |
| Mean log-likelihood ratio | 0.08 |
| Sample standard deviation | 0.40 |
| Statistic | 2.0 |
| Approximate two-sided normal p-value | 0.0455 |
Put the two non-nested models side by side. Under the null and regular non-overlapping conditions, compare the statistic with a standard normal reference. |2.0| gives an approximate two-sided p-value 0.0455. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. The approximation can be poor in small or irregular samples. Report the reference assumptions.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use approximate two-sided p-value as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Direction must remain explicit. A large positive statistic favours model A and a large negative statistic favours model B under the defined m_i direction. Reversing A and B changes the sign but not the two-sided p-value. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. A sign error reverses the narrative. Print the definition beside the result.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use directional interpretation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
The reference calculation depends on design. The null concerns equal Kullback-Leibler closeness within the comparison, not literal truth of both models. Two wrong lifetime families can be equally close. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Non-rejection does not prove equivalence. Add adequacy checks for each model.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use equal closeness is not equal truth as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
CHAPTER 10 OF 25 · Reproduce the example
10. Distinguishability and overlapping models
Put the two non-nested models side by side. If models can generate the same distribution for some parameters, the variance of m_i may vanish and the usual non-nested normal test is not the correct first step. Two parameterisations overlap at a special distribution. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Dividing by a tiny s_m is unstable. Use the framework's distinguishability analysis.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use distinguishability and overlapping models as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Direction must remain explicit. Vuong's paper treats cases where both, one or neither candidate is correctly specified, but each case has conditions and interpretation. Both models omit a load-dependent hazard. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. A preferred approximation can remain scientifically inadequate. Inspect residuals and mechanism plausibility.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use model misspecification as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.
The reference calculation depends on design. Both fitted models must use the same observations, response transformation and likelihood constants. Every candidate includes all 100 units. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Different dropped rows or density units make m_i meaningless. Freeze preprocessing and time units.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use same data and likelihood scale as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Second authoritative source: https://www.itl.nist.gov/div898/handbook/apr/section2/apr21.htm. Compare its prediction target, diagnostics and finite-sample cautions with this worked example.
Put the two non-nested models side by side. The basic variance formula treats pointwise contributions as independent across units. Components from one production batch share conditions. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Ignoring clustering understates uncertainty. Use cluster-robust or resampling methods.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use independence assumption as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Direction must remain explicit. Repeated failures or degradation readings create within-unit dependence and require a predictive-unit or dependence-aware comparison. Many rows belong to one machine trajectory. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Row-level n exaggerates information. Aggregate or model the dependence explicitly.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use serial and recurrent reliability data as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
The reference calculation depends on design. AIC- or BIC-style corrections can adjust the log-likelihood comparison for different parameter counts. Model A has more fitted coefficients than B. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Corrected and uncorrected tests answer slightly different selection questions. State the exact correction formula.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use complexity corrections as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Put the two non-nested models side by side. The normal reference is asymptotic and can be inaccurate with few failures, heavy tails or highly variable m_i. Ten failures drive a hundred-unit comparison. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. A p-value near .05 is especially fragile. Use simulation or bootstrap sensitivity.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use small-sample behaviour as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.
Direction must remain explicit. One unit with a huge log-likelihood ratio can dominate the mean and variance. An extreme early failure strongly favours one tail shape. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Deleting it silently changes the population. Verify provenance and report influence.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use outliers and influential failures as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
The reference calculation depends on design. When most records are censored early, survival contributions may not distinguish late-life tail shapes. Both models assign similar S(c) before wear-out. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. The test may have little power for the operational horizon. Design follow-up around the target difference.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use heavy censoring as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Put the two non-nested models side by side. Testing many model pairs and reporting only a favourable result inflates false-positive risk. Six distributions produce fifteen pairwise tests. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Unadjusted .05 no longer describes the search. Pre-specify candidates or adjust multiplicity.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use multiple pairwise comparisons as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Direction must remain explicit. The statistic standardises a mean log-likelihood difference but does not express survival-hours improvement or calibration at a mission time. Statistic 2.0 may correspond to a modest practical contrast. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Statistical preference is not operational importance. Report survival and hazard differences.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use effect size as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
The reference calculation depends on design. A directional test on development data does not replace held-out predictive evaluation. Model A wins the test but loses on later batches. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Selection optimism remains possible. Use cross-validation or external validation.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Define m_i as model A minus model B beside every signed result so the direction cannot drift. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use prediction validation as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Did You Know? Reversing model A and model B reverses the statistic’s sign while leaving its two-sided normal p-value unchanged. That is why a careful report includes the construction, not only the final scalar.
Put the two non-nested models side by side. Reliability distributions should remain compatible with failure physics and test design. A lognormal multiplicative-degradation argument may be more credible than a slightly better numerical fit. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Mechanism claims need evidence beyond the test. Separate statistical ranking from engineering interpretation.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Both candidates need identical observations, time units, censoring rules and likelihood constants. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use physical mechanism as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Direction must remain explicit. Vuong's statistic contains no downtime cost, safety loss or maintenance threshold. A preferred tail model may not change the action over the mission window. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Likelihood closeness and utility are different. Evaluate decisions separately.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Check distinguishability before dividing by the standard deviation of pointwise log-likelihood ratios. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use decision consequences as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
The reference calculation depends on design. The test connects logarithms, means, standard deviation, square roots and conditional probability. Students can verify 10×.08/.40=2.0. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. The deeper skill is deciding whether models are truly non-nested and observations independent. Draw a model-map before calculating.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. Dependence, clustering and repeated events change the variance calculation and effective sample size. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use parent and student learning route as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Useful next reading: Bukit Timah Mathematics curriculum overview, cross-subject learning approach, nested likelihood-ratio guide, Mathematics Learning Hub, eduKate Mathematics Learning System, approach to learning mathematics. Choose the destination that matches the next question rather than treating links as a checklist.
Put the two non-nested models side by side. The Vuong test is not the ordinary nested LRT, a positive sign is not proof of truth and p=0.0455 is not a model probability. Overlap and dependence change the reference theory. This step matters because non-nested likelihood comparison, direction and robust interpretation require the mathematical object, prediction target and reliability question to stay aligned. Predictive validation remains essential. Read Vuong's paper with NIST reliability model-selection guidance, then reproduce 2.0.
A reproducible audit should record variables, units, observation boundaries, censoring codes, likelihood factorisation and software settings. The test compares relative closeness under assumptions; it does not certify either model as scientifically adequate. Rebuild the displayed number from saved inputs before interpreting it. A result that cannot be reproduced is not ready to support a model comparison.
Try a small learning experiment: write four pointwise log-likelihood ratios, check their sign, calculate their mean and sample deviation, and reproduce the standardised statistic. Use common misconceptions and next reading as the focus. Predict the direction of change before using software, alter one defensible input, and finish with two sentences: what the calculation supports, and what remains uncertain. This habit turns mathematics education into transferable problem-solving rather than formula recall.
Quick answers
What must be fixed before comparing models? Use the same observations, censoring mechanism, time scale, likelihood convention and predictive unit.
Does a preferred value prove a model is true? No. The comparison is conditional on its candidates, data and assumptions.
Which mathematics matters? Algebra organises identities, logarithms stabilise products, probability represents uncertainty, variance measures instability and graphs expose influential cases.
How should a student practise? Preserve intermediate quantities, predict directions before calculating and change one input at a time.
What follows the comparison? Diagnostics, uncertainty analysis, posterior or predictive checks, later-data validation and a separate decision analysis when costs or safety matter.
Extended practice laboratory
Practice case 1: Why the nested LRT does not apply
Setup: Use this chapter’s illustrative case: Weibull and lognormal lifetime families are usually non-nested.
Task: Write each density and test for a restriction mapping.
Checking target: Equal parameter counts do not make models nested.
Practice case 2: Pointwise log-likelihood ratios
Setup: Use this chapter’s illustrative case: A positive contribution means model A assigns more likelihood to that observation.
Task: Preserve the pointwise vector.
Checking target: Total log likelihood alone hides the variability of contributions.
Practice case 3: Censored contributions
Setup: Use this chapter’s illustrative case: A survivor at 500 hours compares two log survival probabilities.
Task: Use the same observation mechanism in both models.
Checking target: Treating censoring as failure changes direction.
Practice case 4: Mean log-likelihood difference
Setup: Use this chapter’s illustrative case: The worked mean is 0.08 in favour of A.
Task: Plot the distribution of m_i.
Checking target: A small mean can arise from large positive and negative cases.
Practice case 5: Sample standard deviation
Setup: Use this chapter’s illustrative case: The worked s_m is 0.40.
Task: Check distinguishability before standardising.
Checking target: Near-zero variance signals overlapping or observationally equivalent models and needs special handling.
Practice case 6: Completing the statistic 2.0
Setup: Use this chapter’s illustrative case: sqrt(100) times .08 divided by .40 equals 2.0.
Task: Write the numerator and denominator separately.
Checking target: Forgetting sqrt(n) changes the scale completely.
Practice case 7: Approximate two-sided p-value
Setup: Use this chapter’s illustrative case: |2.0| gives an approximate two-sided p-value 0.0455.
Task: Report the reference assumptions.
Checking target: The approximation can be poor in small or irregular samples.
Practice case 8: Directional interpretation
Setup: Use this chapter’s illustrative case: Reversing A and B changes the sign but not the two-sided p-value.
Task: Print the definition beside the result.
Checking target: A sign error reverses the narrative.
Practice case 9: Equal closeness is not equal truth
Setup: Use this chapter’s illustrative case: Two wrong lifetime families can be equally close.
Task: Add adequacy checks for each model.
Checking target: Non-rejection does not prove equivalence.
Practice case 10: Distinguishability and overlapping models
Setup: Use this chapter’s illustrative case: Two parameterisations overlap at a special distribution.
Task: Use the framework's distinguishability analysis.
Checking target: Dividing by a tiny s_m is unstable.