VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

Why Mathematics? | Standard Errors: Sampling Precision and Repeated Samples

Why is mathematics important when two samples from the same population give slightly different answers? A standard error describes how much an estimator would vary across repeated samples under a stated design. It turns sampling variability into the same units as the estimate, making precision visible.

Did You Know? Standard deviation describes variation among observed values. Standard error describes variation of an estimate across possible samples. They answer different questions.

Full chapter index

Chapters 1–7 · Understand the question
  1. The repeated-sample question
  2. The simple mean formula
  3. An official explanation
  4. A worked sample
  5. Calculate the standard error
  6. Interpret the units
  7. The square-root law
Chapters 8–14 · Reproduce the example
  1. Unknown population spread
  2. Finite populations
  3. Complex surveys
  4. Replicate standard errors
  5. Linearisation standard errors
  6. Model-based standard errors
  7. Measurement error is separate
Chapters 15–21 · Check assumptions
  1. Nonresponse bias is separate
  2. Standard error of a proportion
  3. Standard error of a difference
  4. Comparison with standard deviation
  5. Diagnostics
  6. Validation plan
  7. Limits
Chapters 22–28 · Explore applications
  1. A spreadsheet workflow
  2. A coding workflow
  3. Applications and careers
  4. A student investigation
  5. Common misconceptions
  6. Connection to recent mathematics articles
  7. Guidance for students and parents
Chapters 29–34 · Study and verify
  1. Practice questions
  2. Frequently asked questions
  3. A reporting checklist
  4. The sampling-distribution bridge
  5. Final standard-error audit
  6. Useful next reading

CHAPTER 1 OF 34 · Understand the question

1. The repeated-sample question

Back to contents

A sample mean is one outcome of a random design. Another valid sample would usually produce another mean. Standard error measures the spread of that sampling distribution.

Contents · Next chapter

CHAPTER 2 OF 34 · Understand the question

2. The simple mean formula

Back to contents

For independent observations with standard deviation s and sample size n, the estimated standard error of the mean is s/sqrt(n).

Contents · Previous chapter · Next chapter

CHAPTER 3 OF 34 · Understand the question

3. An official explanation

Back to contents

The UK Office for National Statistics describes standard error as a measure of how precise a survey estimate is and notes that it uses the same units as the estimate. Read the official uncertainty guide.

Contents · Previous chapter · Next chapter

CHAPTER 4 OF 34 · Understand the question

4. A worked sample

Back to contents

Suppose s=12 marks and n=36 students.

SDSample nSE
12362
Standard error of a mean.

Contents · Previous chapter · Next chapter

CHAPTER 5 OF 34 · Understand the question

5. Calculate the standard error

Back to contents

SE=12/sqrt(36)=12/6=2 marks.

Contents · Previous chapter · Next chapter

CHAPTER 6 OF 34 · Understand the question

6. Interpret the units

Back to contents

The estimate may be a mean mark, and its standard error is also measured in marks. It is not 2% unless the scale has been explicitly converted.

Contents · Previous chapter · Next chapter

CHAPTER 7 OF 34 · Understand the question

7. The square-root law

Back to contents

Quadrupling n from 36 to 144 halves the independent-sample standard error from 2 to 1. Precision improves more slowly than sample size.

Sample nSE
362
1441
Square-root scaling.

Contents · Previous chapter · Next chapter

CHAPTER 8 OF 34 · Reproduce the example

8. Unknown population spread

Back to contents

The population standard deviation is usually unknown, so s estimates it. The standard error is therefore itself estimated.

Contents · Previous chapter · Next chapter

CHAPTER 9 OF 34 · Reproduce the example

9. Finite populations

Back to contents

Sampling without replacement from a substantial fraction of a finite list multiplies the SRS variance by 1-n/N.

Contents · Previous chapter · Next chapter

CHAPTER 10 OF 34 · Reproduce the example

10. Complex surveys

Back to contents

Clustering, stratification and unequal weights change the sampling variance. Ordinary s/sqrt(n) may be wrong even when the sample is large.

Contents · Previous chapter · Next chapter

CHAPTER 11 OF 34 · Reproduce the example

11. Replicate standard errors

Back to contents

Repeatedly perturb weights according to the design, recalculate the estimate and use the variation among replicates with the method’s scaling factor.

Contents · Previous chapter · Next chapter

CHAPTER 12 OF 34 · Reproduce the example

12. Linearisation standard errors

Back to contents

Approximate a nonlinear estimator by a weighted linear influence variable, then apply design-based variance formulas.

Contents · Previous chapter · Next chapter

CHAPTER 13 OF 34 · Reproduce the example

13. Model-based standard errors

Back to contents

Regression software reports uncertainty conditional on model assumptions. Heteroskedasticity, dependence and misspecification require suitable alternatives.

Contents · Previous chapter · Next chapter

CHAPTER 14 OF 34 · Reproduce the example

14. Measurement error is separate

Back to contents

A tiny standard error can accompany a systematically mismeasured outcome. Precision does not guarantee accuracy.

Contents · Previous chapter · Next chapter

CHAPTER 15 OF 34 · Check assumptions

15. Nonresponse bias is separate

Back to contents

More respondents may lower sampling error while leaving bias if nonrespondents differ after adjustment.

Contents · Previous chapter · Next chapter

CHAPTER 16 OF 34 · Check assumptions

16. Standard error of a proportion

Back to contents

Under simple random sampling, approximate SE=sqrt[p(1-p)/n], with design and finite-population modifications where applicable.

Contents · Previous chapter · Next chapter

CHAPTER 17 OF 34 · Check assumptions

17. Standard error of a difference

Back to contents

For independent estimates, variances add. For overlapping samples, covariance matters and can reduce or increase uncertainty.

Contents · Previous chapter · Next chapter

CHAPTER 18 OF 34 · Check assumptions

18. Comparison with standard deviation

Back to contents

SD answers how spread individual values are. SE answers how spread the estimator is under repeated sampling.

Contents · Previous chapter · Next chapter

CHAPTER 19 OF 34 · Check assumptions

19. Diagnostics

Back to contents

Name the estimator, target population, sampling design, weight variables, cluster and stratum IDs, variance method and degrees of freedom.

Contents · Previous chapter · Next chapter

CHAPTER 20 OF 34 · Check assumptions

20. Validation plan

Back to contents

Reproduce 2 marks, simulate repeated samples, quadruple n, introduce clustering and compare naive with design-aware SE.

Contents · Previous chapter · Next chapter

CHAPTER 21 OF 34 · Check assumptions

21. Limits

Back to contents

A standard error cannot summarise coverage error, response bias, measurement bias, model misspecification or practical importance by itself.

Contents · Previous chapter · Next chapter

CHAPTER 22 OF 34 · Explore applications

22. A spreadsheet workflow

Back to contents

List estimate, SD, n, design variables, variance and SE. Keep units and method beside every value.

Contents · Previous chapter · Next chapter

CHAPTER 23 OF 34 · Explore applications

23. A coding workflow

Back to contents

Simulate sampling distributions, unit-test s/sqrt(n), compare linearisation and replicate methods, and preserve survey design metadata.

Contents · Previous chapter · Next chapter

CHAPTER 24 OF 34 · Explore applications

24. Applications and careers

Back to contents

Researchers, engineers, economists and education analysts use standard errors to judge precision.

Contents · Previous chapter · Next chapter

CHAPTER 25 OF 34 · Explore applications

25. A student investigation

Back to contents

Generate repeated samples from known student marks and compare empirical mean spread with calculated SE under independent and clustered designs.

Contents · Previous chapter · Next chapter

CHAPTER 26 OF 34 · Explore applications

26. Common misconceptions

Back to contents

SE is not SD, a small SE does not prove truth, and doubling sample size does not halve SE.

Contents · Previous chapter · Next chapter

CHAPTER 27 OF 34 · Explore applications

27. Connection to recent mathematics articles

Back to contents

The finite-population guide explains depletion. The design-effect guide explains complex-design variance.

Contents · Previous chapter · Next chapter

CHAPTER 28 OF 34 · Explore applications

28. Guidance for students and parents

Back to contents

Students should write units after the SE. Parents can ask whether a reported school-survey precision measure accounts for classes and weights.

Contents · Previous chapter · Next chapter

CHAPTER 29 OF 34 · Study and verify

29. Practice questions

Back to contents

  • Reproduce 2 marks.
  • Quadruple n.
  • Compare SD and SE.
  • Add a finite-population correction.
  • Diagnose clustering.

Contents · Previous chapter · Next chapter

CHAPTER 30 OF 34 · Study and verify

30. Frequently asked questions

Back to contents

### Is SE the spread of students? No.

### Does a larger n help? Usually.

### Does SE measure bias? No.

### Can survey design change SE? Yes.

Contents · Previous chapter · Next chapter

CHAPTER 31 OF 34 · Study and verify

31. A reporting checklist

Back to contents

Report estimate, units, target population, design, n and effective n where relevant, variance method, SE, degrees of freedom and nonsampling-error limits.

Contents · Previous chapter · Next chapter

CHAPTER 32 OF 34 · Study and verify

32. The sampling-distribution bridge

Back to contents

Standard error connects one observed estimate to the variability expected across repeated valid samples.

Contents · Previous chapter · Next chapter

CHAPTER 33 OF 34 · Study and verify

33. Final standard-error audit

Back to contents

Confirm the estimator and units, match variance to design and dependence, include finite-population and replicate rules, separate precision from bias and preserve enough metadata to reproduce the result.

Contents · Previous chapter · Next chapter

CHAPTER 34 OF 34 · Study and verify

34. Useful next reading

Back to contents

Continue through the Mathematics Learning Hub. Recalculate one uncertainty measure and explain which decision it can and cannot support.

Contents · Previous chapter · Mathematics Learning Hub

Extended practice laboratory

Practice case 1: Define estimator

Setup: Start from the article’s standard-error mechanism for case 1. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 2: Record units

Setup: Start from the article’s standard-error mechanism for case 2. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 3: Set SD

Setup: Start from the article’s standard-error mechanism for case 3. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 4: Set n

Setup: Start from the article’s standard-error mechanism for case 4. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 5: Calculate square root

Setup: Start from the article’s standard-error mechanism for case 5. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 6: Calculate SE

Setup: Start from the article’s standard-error mechanism for case 6. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 7: Quadruple n

Setup: Start from the article’s standard-error mechanism for case 7. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 8: Recalculate SE

Setup: Start from the article’s standard-error mechanism for case 8. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 9: Add FPC

Setup: Start from the article’s standard-error mechanism for case 9. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 10: Add design effect

Setup: Start from the article’s standard-error mechanism for case 10. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 11: Add cluster

Setup: Start from the article’s standard-error mechanism for case 11. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 12: Add stratum

Setup: Start from the article’s standard-error mechanism for case 12. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 13: Add weights

Setup: Start from the article’s standard-error mechanism for case 13. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 14: Use linearisation

Setup: Start from the article’s standard-error mechanism for case 14. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 15: Use replicates

Setup: Start from the article’s standard-error mechanism for case 15. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 16: Estimate proportion SE

Setup: Start from the article’s standard-error mechanism for case 16. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 17: Estimate difference SE

Setup: Start from the article’s standard-error mechanism for case 17. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 18: Add covariance

Setup: Start from the article’s standard-error mechanism for case 18. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 19: Add measurement bias

Setup: Start from the article’s standard-error mechanism for case 19. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 20: Add nonresponse bias

Setup: Start from the article’s standard-error mechanism for case 20. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 21: Audit design

Setup: Start from the article’s standard-error mechanism for case 21. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 22: Audit units

Setup: Start from the article’s standard-error mechanism for case 22. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 23: Audit variance

Setup: Start from the article’s standard-error mechanism for case 23. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 24: Name limits

Setup: Start from the article’s standard-error mechanism for case 24. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.

Practice case 25: Write conclusion

Setup: Start from the article’s standard-error mechanism for case 25. Task: Change the named quantity, recompute the dependent result and compare with the original.

Check: Preserve the target population and sampling design, verify the uncertainty identity, state one diagnostic, record units and compare one defensible alternative with clear reasoning. Show the arithmetic, name the response and predictor units, and separate the numerical result from the claim it supports. Then vary one defensible assumption, calculate again and explain whether the conclusion changed because of the data, the fitted model or the validation purpose. Finish with one compact table or graph that could reveal a failure hidden by the summary.