VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

Why Mathematics? | Corrected AIC for Small Reliability Samples: Finite-Sample Penalties, Effective n, Censoring and Model Choice

The importance of mathematics becomes clear when a reliability study has only a modest number of units or failures but several parameters are estimated. Ordinary AIC uses a 2k complexity penalty derived from large-sample reasoning. A common corrected form, AICc = AIC + 2k(k+1)/(n-k-1), increases the penalty when the sample size n is not comfortably larger than the parameter count k.

This guide develops the correction, its denominator, effective sample-size questions under censoring, candidate-set discipline, delta AICc and validation. If AIC is 210, n = 40 and k = 5, the correction is 2×5×6/(40-5-1) = 60/34 ≈ 1.7647, so AICc ≈ 211.7647. The arithmetic is simple; the difficult part is deciding whether that formula and the chosen n match the fitted reliability likelihood. AICc is not a universal repair for sparse events, informative censoring or a physically implausible model.

Full chapter index

Chapters 1–5 · Understand the question
  1. Why finite samples change the penalty
  2. The common AICc formula
  3. Completing 211.7647
  4. Why AICc exceeds AIC
  5. The denominator boundary
Chapters 6–10 · Reproduce the example
  1. What counts as k
  2. What counts as n
  3. Censoring does not automatically redefine n
  4. Clustered reliability records
  5. Weighted likelihoods
Chapters 11–15 · Check assumptions
  1. AICc versus AIC rankings
  2. Delta AICc
  3. AICc weights
  4. Small sample does not mean a fixed cutoff
  5. Sparse failures and identifiability
Chapters 16–20 · Explore applications
  1. Candidate models must remain comparable
  2. Model-specific derivation matters
  3. Simulation as a calibration check
  4. Cross-validation as complementary evidence
  5. Bootstrap selection stability
Chapters 21–25 · Study and verify
  1. Extrapolation remains dangerous
  2. External validation
  3. Decision use
  4. Parent and student learning route
  5. Common misconceptions and next reading

CHAPTER 1 OF 25 · Understand the question

1. Why finite samples change the penalty

Back to contents

The optimism in maximised likelihood is larger when many parameters are estimated from limited information, so the large-sample 2k correction can be insufficient. Five parameters fitted to forty records occupy a substantial share of the available information. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. No algebraic correction creates events that were never observed. Treat AICc as a model-selection adjustment, not new data.

The correction is most informative when n, k, censoring structure and the exact finite-sample formula are all stated on the same page. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use why finite samples change the penalty as the focus and test the worked illustration: Five parameters fitted to forty records occupy a substantial share of the available information. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Did You Know? Model-selection mathematics can be perfectly calculated and still be misleading when candidates use different observations, units or likelihood definitions. Fair comparison begins before the formula: one response, one analysis set, one observation model and a documented candidate set.

Contents · Next chapter

CHAPTER 2 OF 25 · Understand the question

2. The common AICc formula

Back to contents

A widely used form is AICc = AIC + 2k(k+1)/(n-k-1), provided its derivation is appropriate for the model and sampling structure. With k=5 and n=40, the numerator is 60 and denominator is 34. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Different model families can require different finite-sample corrections. Cite the formula and software convention.

If the denominator is small, the correct response is to question model complexity and information, not to celebrate a dramatic number. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use the common aicc formula as the focus and test the worked illustration: With k=5 and n=40, the numerator is 60 and denominator is 34. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 3 OF 25 · Understand the question

3. Completing 211.7647

Back to contents

Divide 60 by 34 to obtain about 1.7647 and add it to AIC 210. AICc is approximately 211.7647. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Premature rounding can alter close rankings. Keep full precision until the comparison table is complete.

Sparse failure information can produce weak identification even when the row count satisfies the algebraic denominator condition. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use completing 211.7647 as the focus and test the worked illustration: AICc is approximately 211.7647. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

QuantityValue
AIC210
n40
k5
Correction60/34 = 1.7647
AICc211.7647
AICc worked example.

Contents · Previous chapter · Next chapter

CHAPTER 4 OF 25 · Understand the question

4. Why AICc exceeds AIC

Back to contents

For positive k and a valid positive denominator, the added correction is positive and shrinks toward zero as n grows. At n=40 the correction is 1.7647; at n=400 it is much smaller. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. If n is barely above k+1, the expression becomes unstable. Inspect the denominator before interpreting output.

A simulation designed around the study can reveal whether the chosen correction behaves sensibly under the planned censoring pattern. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use why aicc exceeds aic as the focus and test the worked illustration: At n=40 the correction is 1.7647; at n=400 it is much smaller. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Primary research or authoritative source: https://doi.org/10.1093/biomet/76.2.297. Use it to check the criterion's derivation or reliability procedure rather than copying a rule without its assumptions.

Contents · Previous chapter · Next chapter

CHAPTER 5 OF 25 · Understand the question

5. The denominator boundary

Back to contents

The common formula requires n-k-1 greater than zero; as the denominator approaches zero, the penalty explodes. With n=7 and k=5, the denominator is one and the correction is 60. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. A finite number does not mean the fitted model is estimable or trustworthy. Simplify the model or collect more information.

Treat every effective-sample-size choice as an estimand decision that needs a source, not a convenient plug-in value. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use the denominator boundary as the focus and test the worked illustration: With n=7 and k=5, the denominator is one and the correction is 60. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 6 OF 25 · Reproduce the example

6. What counts as k

Back to contents

Use the number of independently estimated parameters required by the exact likelihood and criterion implementation. Shape, scale, regression slopes and a fitted threshold may all count. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Forgetting a variance or threshold makes the correction too small. Reconcile k with the optimiser's free-parameter vector.

The correction is most informative when n, k, censoring structure and the exact finite-sample formula are all stated on the same page. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use what counts as k as the focus and test the worked illustration: Shape, scale, regression slopes and a fitted threshold may all count. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Did You Know? Model-selection mathematics can be perfectly calculated and still be misleading when candidates use different observations, units or likelihood definitions. Fair comparison begins before the formula: one response, one analysis set, one observation model and a documented candidate set.

Contents · Previous chapter · Next chapter

CHAPTER 7 OF 25 · Reproduce the example

7. What counts as n

Back to contents

In simple independent-record settings, n is commonly the number of observational units, but clustered, weighted or censored designs can make the relevant effective sample size less obvious. Forty independent components produce forty lifetime records. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Substituting the number of failures without a derivation changes the criterion. Follow a model-specific source or software documentation.

If the denominator is small, the correct response is to question model complexity and information, not to celebrate a dramatic number. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use what counts as n as the focus and test the worked illustration: Forty independent components produce forty lifetime records. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 8 OF 25 · Reproduce the example

8. Censoring does not automatically redefine n

Back to contents

Right censoring reduces event information but censored units still contribute survival terms to a likelihood. Twenty failures and twenty censored units create forty likelihood contributions. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Counting only failures is not a universal AICc rule. Describe censoring and justify the chosen n.

Sparse failure information can produce weak identification even when the row count satisfies the algebraic denominator condition. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use censoring does not automatically redefine n as the focus and test the worked illustration: Twenty failures and twenty censored units create forty likelihood contributions. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 9 OF 25 · Reproduce the example

9. Clustered reliability records

Back to contents

Repeated components from the same machine, batch or site may not supply n independent pieces of information. Forty observations come from ten production lots. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Using forty as if all records were independent may understate finite-sample uncertainty. Use a criterion and validation scheme that respect clusters.

A simulation designed around the study can reveal whether the chosen correction behaves sensibly under the planned censoring pattern. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use clustered reliability records as the focus and test the worked illustration: Forty observations come from ten production lots. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 10 OF 25 · Reproduce the example

10. Weighted likelihoods

Back to contents

Survey, inverse-probability or case weights alter how information is represented, so raw row count may not be the correct finite-sample quantity. A few records carry very large censoring weights. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Plugging an ad hoc effective n into the formula has no automatic theoretical guarantee. Seek a derivation for the weighted setting.

Treat every effective-sample-size choice as an estimand decision that needs a source, not a convenient plug-in value. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use weighted likelihoods as the focus and test the worked illustration: A few records carry very large censoring weights. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 11 OF 25 · Check assumptions

11. AICc versus AIC rankings

Back to contents

AICc penalises larger k more strongly, so it can reverse an AIC preference for a flexible model. Model A has AIC 210 with k=5; Model B has AIC 211 with k=2. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. The result depends on the shared n and valid formula. Compute both corrections transparently.

The correction is most informative when n, k, censoring structure and the exact finite-sample formula are all stated on the same page. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use aicc versus aic rankings as the focus and test the worked illustration: Model A has AIC 210 with k=5; Model B has AIC 211 with k=2. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Did You Know? Model-selection mathematics can be perfectly calculated and still be misleading when candidates use different observations, units or likelihood definitions. Fair comparison begins before the formula: one response, one analysis set, one observation model and a documented candidate set.

Contents · Previous chapter · Next chapter

CHAPTER 12 OF 25 · Check assumptions

12. Delta AICc

Back to contents

Subtract the smallest AICc from each candidate value to express relative finite-sample information loss. Values 211.76 and 212.20 give deltas 0 and 0.44. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Small differences imply meaningful selection uncertainty. Do not force a dramatic winner from a tiny delta.

If the denominator is small, the correct response is to question model complexity and information, not to celebrate a dramatic number. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use delta aicc as the focus and test the worked illustration: Values 211.76 and 212.20 give deltas 0 and 0.44. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Second authoritative source: https://itl.nist.gov/div898/software/dataplot/refman1/auxillar/bestfit.htm. Compare its definitions, data structure and limitations with the worked reliability example here.

Contents · Previous chapter · Next chapter

CHAPTER 13 OF 25 · Check assumptions

13. AICc weights

Back to contents

Relative likelihoods and weights can be formed from AICc deltas using exp(-Delta/2) when the candidate comparison is coherent. Delta .44 gives relative support about .803. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Weights remain conditional on the candidate set and criterion assumptions. Keep raw AICc values visible.

Sparse failure information can produce weak identification even when the row count satisfies the algebraic denominator condition. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use aicc weights as the focus and test the worked illustration: Delta .44 gives relative support about .803. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 14 OF 25 · Check assumptions

14. Small sample does not mean a fixed cutoff

Back to contents

The need for correction depends on the ratio of information to parameters, not only a universal n threshold. n=100 can still be small for k=30. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. A rule such as n under 50 ignores model dimension and censoring. Report n, k and their relation.

A simulation designed around the study can reveal whether the chosen correction behaves sensibly under the planned censoring pattern. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use small sample does not mean a fixed cutoff as the focus and test the worked illustration: n=100 can still be small for k=30. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 15 OF 25 · Check assumptions

15. Sparse failures and identifiability

Back to contents

A model can be weakly identified when few failures locate shape or tail parameters even if the row count seems adequate. Most components are censored before wear-out begins. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. AICc cannot stabilise a flat likelihood surface. Inspect profiles, standard errors and convergence.

Treat every effective-sample-size choice as an estimand decision that needs a source, not a convenient plug-in value. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use sparse failures and identifiability as the focus and test the worked illustration: Most components are censored before wear-out begins. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 16 OF 25 · Explore applications

16. Candidate models must remain comparable

Back to contents

Every AICc value must use the same observations, response scale and comparable likelihood. All lifetime models use the same forty records and censoring times. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Changing the analysis set changes both n and fit. Freeze data and preprocessing.

The correction is most informative when n, k, censoring structure and the exact finite-sample formula are all stated on the same page. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use candidate models must remain comparable as the focus and test the worked illustration: All lifetime models use the same forty records and censoring times. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Did You Know? Model-selection mathematics can be perfectly calculated and still be misleading when candidates use different observations, units or likelihood definitions. Fair comparison begins before the formula: one response, one analysis set, one observation model and a documented candidate set.

Contents · Previous chapter · Next chapter

CHAPTER 17 OF 25 · Explore applications

17. Model-specific derivation matters

Back to contents

Hurvich and Tsai derived finite-sample corrections for particular regression and autoregressive settings; later applications require care rather than automatic transplantation. A formula printed by software may be a conventional extension. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Censored nonlinear lifetime models can fall outside the original derivation. State whether the use is exact, derived or heuristic.

If the denominator is small, the correct response is to question model complexity and information, not to celebrate a dramatic number. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use model-specific derivation matters as the focus and test the worked illustration: A formula printed by software may be a conventional extension. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 18 OF 25 · Explore applications

18. Simulation as a calibration check

Back to contents

A parametric simulation can reveal whether a proposed criterion tends to choose overly flexible models under the study's sample size and censoring. Generate lifetimes from a known Weibull model and repeat selection. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Simulation reflects only the scenarios programmed. Vary censoring, parameters and misspecification.

Sparse failure information can produce weak identification even when the row count satisfies the algebraic denominator condition. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use simulation as a calibration check as the focus and test the worked illustration: Generate lifetimes from a known Weibull model and repeat selection. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 19 OF 25 · Explore applications

19. Cross-validation as complementary evidence

Back to contents

Held-out predictive log scores test performance more directly and can reveal whether the AICc ranking transfers. Leave-one-unit-out prediction compares two candidate distributions. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Naive folds leak information when records are clustered or temporal. Split by the independent deployment unit.

A simulation designed around the study can reveal whether the chosen correction behaves sensibly under the planned censoring pattern. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use cross-validation as complementary evidence as the focus and test the worked illustration: Leave-one-unit-out prediction compares two candidate distributions. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 20 OF 25 · Explore applications

20. Bootstrap selection stability

Back to contents

Bootstrap the full fit-and-select process to see how often each candidate wins under resampled data. A model wins 55 percent rather than every resample. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Selection frequency is not a posterior probability. Report instability honestly.

Treat every effective-sample-size choice as an estimand decision that needs a source, not a convenient plug-in value. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use bootstrap selection stability as the focus and test the worked illustration: A model wins 55 percent rather than every resample. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 21 OF 25 · Study and verify

21. Extrapolation remains dangerous

Back to contents

AICc evaluates candidates using observed information and does not guarantee correct remote-tail predictions. Two models agree through 1,000 hours but differ at 10,000. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Sparse data cannot identify an extreme tail merely through a penalty. Use physics, stress tests and tail sensitivity.

The correction is most informative when n, k, censoring structure and the exact finite-sample formula are all stated on the same page. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use extrapolation remains dangerous as the focus and test the worked illustration: Two models agree through 1,000 hours but differ at 10,000. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Did You Know? Model-selection mathematics can be perfectly calculated and still be misleading when candidates use different observations, units or likelihood definitions. Fair comparison begins before the formula: one response, one analysis set, one observation model and a documented candidate set.

Contents · Previous chapter · Next chapter

CHAPTER 22 OF 25 · Study and verify

22. External validation

Back to contents

A model selected under small-sample correction should be tested on new units when data become available. The chosen curve is frozen before the next production batch. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Later conditions may differ from the development sample. Track calibration and decision consequences over time.

If the denominator is small, the correct response is to question model complexity and information, not to celebrate a dramatic number. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use external validation as the focus and test the worked illustration: The chosen curve is frozen before the next production batch. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 23 OF 25 · Study and verify

23. Decision use

Back to contents

AICc ranks probabilistic models; it does not price downtime, spare inventory or safety risk. A 0.5-point AICc advantage may have no operational consequence. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Selection metrics and utility functions answer different questions. Evaluate the actual maintenance action separately.

Sparse failure information can produce weak identification even when the row count satisfies the algebraic denominator condition. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use decision use as the focus and test the worked illustration: A 0.5-point AICc advantage may have no operational consequence. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Contents · Previous chapter · Next chapter

CHAPTER 24 OF 25 · Study and verify

24. Parent and student learning route

Back to contents

AICc is a useful lesson in rational expressions, denominator restrictions, asymptotic ideas and responsible modelling. Students can compare corrections for n=40 and n=80 while holding k=5. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. The formula should not become a context-free substitution exercise. Ask why the correction shrinks and where it breaks.

A simulation designed around the study can reveal whether the chosen correction behaves sensibly under the planned censoring pattern. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use parent and student learning route as the focus and test the worked illustration: Students can compare corrections for n=40 and n=80 while holding k=5. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Useful next reading: Mathematics Learning Hub, approach to learning mathematics, right-censored log-likelihood guide, eduKate Mathematics Learning System, Bukit Timah Mathematics curriculum overview. Follow the link that matches the next question: subject navigation, learning method, school-to-advanced progression or continuity with the preceding reliability score.

Contents · Previous chapter · Next chapter

CHAPTER 25 OF 25 · Study and verify

25. Common misconceptions and next reading

Back to contents

AICc is not always superior by magic, n is not automatically the failure count, and a small corrected score does not certify model adequacy. The correction tends toward AIC as information grows. This chapter isolates that step because finite-sample correction, denominator discipline and sparse reliability evidence depend on keeping the mathematical object and the engineering question aligned. Model-specific assumptions remain decisive. Read Hurvich and Tsai with the NIST implementation notes, then reproduce 211.7647.

Treat every effective-sample-size choice as an estimand decision that needs a source, not a convenient plug-in value. Write the variables, units, data subset and likelihood convention before opening software. Then reproduce the displayed number from the saved inputs. If the result cannot be rebuilt, the comparison is not ready to guide a conclusion.

For a practical check, Repeat the correction at two sample sizes while holding k fixed, then hold n fixed and increase k. Explain the denominator behaviour before using a calculator. In this chapter, use common misconceptions and next reading as the focus and test the worked illustration: The correction tends toward AIC as information grows. Change one defensible input, predict the direction first, and finish by stating what the calculation supports and what remains uncertain.

Quick answers

What should be checked before the calculation? Confirm the same observations, outcome, time scale, likelihood convention and independently estimated parameters.

Does the smallest criterion or p-value prove the model is true? No. It is conditional on the candidates, data and assumptions.

Which school mathematics is doing the work? Algebra organises the formula, logarithms transform products, functions describe distributions, probability represents uncertainty and graphs expose fit.

How can a student practise safely? Use a fictional candidate table, preserve every intermediate value and change one input at a time.

What should follow model selection? Diagnostics, uncertainty analysis, external validation where possible, and a separate decision model when action costs matter.

Contents · Previous chapter · Mathematics Learning Hub

Extended practice laboratory

Practice case 1: Why finite samples change the penalty

Setup: Use this chapter’s illustrative case: Five parameters fitted to forty records occupy a substantial share of the available information.

Task: Treat AICc as a model-selection adjustment, not new data.

Checking target: No algebraic correction creates events that were never observed.

Practice case 2: The common AICc formula

Setup: Use this chapter’s illustrative case: With k=5 and n=40, the numerator is 60 and denominator is 34.

Task: Cite the formula and software convention.

Checking target: Different model families can require different finite-sample corrections.

Practice case 3: Completing 211.7647

Setup: Use this chapter’s illustrative case: AICc is approximately 211.7647.

Task: Keep full precision until the comparison table is complete.

Checking target: Premature rounding can alter close rankings.

Practice case 4: Why AICc exceeds AIC

Setup: Use this chapter’s illustrative case: At n=40 the correction is 1.7647; at n=400 it is much smaller.

Task: Inspect the denominator before interpreting output.

Checking target: If n is barely above k+1, the expression becomes unstable.

Practice case 5: The denominator boundary

Setup: Use this chapter’s illustrative case: With n=7 and k=5, the denominator is one and the correction is 60.

Task: Simplify the model or collect more information.

Checking target: A finite number does not mean the fitted model is estimable or trustworthy.

Practice case 6: What counts as k

Setup: Use this chapter’s illustrative case: Shape, scale, regression slopes and a fitted threshold may all count.

Task: Reconcile k with the optimiser's free-parameter vector.

Checking target: Forgetting a variance or threshold makes the correction too small.

Practice case 7: What counts as n

Setup: Use this chapter’s illustrative case: Forty independent components produce forty lifetime records.

Task: Follow a model-specific source or software documentation.

Checking target: Substituting the number of failures without a derivation changes the criterion.

Practice case 8: Censoring does not automatically redefine n

Setup: Use this chapter’s illustrative case: Twenty failures and twenty censored units create forty likelihood contributions.

Task: Describe censoring and justify the chosen n.

Checking target: Counting only failures is not a universal AICc rule.

Practice case 9: Clustered reliability records

Setup: Use this chapter’s illustrative case: Forty observations come from ten production lots.

Task: Use a criterion and validation scheme that respect clusters.

Checking target: Using forty as if all records were independent may understate finite-sample uncertainty.

Practice case 10: Weighted likelihoods

Setup: Use this chapter’s illustrative case: A few records carry very large censoring weights.

Task: Seek a derivation for the weighted setting.

Checking target: Plugging an ad hoc effective n into the formula has no automatic theoretical guarantee.