Did you know that a headline can contain real numbers yet still make a claim the numbers do not support? This happens in school newsletters, science posters, online news and student presentations. The issue is not always fabricated information. Sometimes a writer turns “the average increased” into “everyone improved”, or “after” into “because of”.
Checking a headline against its evidence means identifying the headline’s precise claim, locating the original measurements or statements, and asking whether those records justify its scope and certainty. A reliable headline must preserve the people, time period, measurement, comparison and limitations of the source. If the evidence shows less, the heading must claim less.
Start by diagnosing the hidden claim
Consider a fictional school-newsletter headline: “New Reading Sessions Make Every Pupil Read Faster.” Underneath is a table of reading speeds measured before and after several sessions. The words new, make, every, and faster each make a different promise. “Every” requires evidence for each pupil. “Make” suggests causation. “Faster” requires a defined speed measure. “New” tells us when a programme appeared, not whether it alone caused a result.
Before reading the table, ask a learner to underline each word that could be disproved separately. If the learner says “The numbers went up, so it is true,” that reveals a diagnosis: the student is treating a summary as proof of every part of a sentence.
Worked example: an average rises but not everyone improves
The next figures are an invented lesson example, not observed student outcomes. Six pupils read the same kind of short, unfamiliar passage in two practice sessions. Speed is recorded in correctly read words per minute (wpm), assuming a consistent scoring method. Their first and second readings are: A 70→80, B 80→78, C 90→96, D 100→100, E 110→123 and F 120→125 wpm.
- Count individual directions: A, C, E and F improve (four pupils). B falls from 80 to 78. D stays at 100. Therefore “every pupil” is false in this example.
- Calculate the first mean: (70 + 80 + 90 + 100 + 110 + 120) ÷ 6 = 570 ÷ 6 = 95 wpm.
- Calculate the second mean: (80 + 78 + 96 + 100 + 123 + 125) ÷ 6 = 602 ÷ 6 ≈ 100.3 wpm.
- Calculate mean change: (602 − 570) ÷ 6 ≈ 5.3 wpm. Relative to the 95 wpm starting mean, 5.3 ÷ 95 × 100 ≈ 5.6%.
- Check causation: two readings and an observed improvement do not, by themselves, establish that the sessions caused the change. Practice familiarity, passage variation and other changes could matter.
An accurate alternative headline would be: “Average Reading Speed Rose in Six-Pupil Practice Example; Results Varied.” A plain-language caption could add: “Four pupils read faster in the second session, one was unchanged and one read more slowly.” If this were a real report, the writer should name the measurement procedure and acknowledge the small sample.
Notice that speed and comprehension are different outcomes. A faster reading rate does not automatically show improved understanding. To claim a comprehension gain, the source would need an appropriate comprehension measure. This is how one original table can answer several questions while supporting fewer claims than a dramatic headline suggests.
The five-question evidence check
- Who? Does the headline claim “students” generally when the data involve only one class, a subgroup, or respondents to a particular survey?
- What? Is the outcome measured in speed, accuracy, marks, satisfaction, frequency or something else? Do not silently substitute a more desirable skill.
- Compared with what? Is the source comparing two moments, two groups or two differently designed tasks? Check units and denominators.
- How certain? Does the source report individual observations, averages, estimates or an interpretation? Ask whether the headline adds “all”, “proven” or “caused” without support.
- What is missing? Look for selection criteria, methods, nonrespondents, test conditions, conflicts of interest, uncertainties or alternative explanations.
Read the full source and its method rather than relying on the headline and an attractive figure. When the source is unfamiliar, check who published it and whether independent evidence exists. Stanford Graduate School of Education describes lateral reading and source checking as practical digital-literacy skills. Here we combine that outside check with a close examination of what the source’s own data actually say.
Why a source can be genuine and a headline still be wrong
A credible publication may report a carefully measured mean, yet a student reusing its figure may accidentally generalise from “sample” to “population”. A school project might faithfully copy a chart but crop out a footnote about missing values. A headline can also be technically defensible and still conceal an important denominator. Verification has two jobs: first, establish that the source is authentic and trustworthy for the question; second, test whether the headline is a faithful summary of that particular source.
A learner should not reject an article merely because its claim is surprising. Nor should a teacher label all strong headlines “fake news”. Strong evidence can justify a strong claim. The task is proportionality: the strength of the wording must match the strength of the support.
Practice from guided checking to independent editing
Begin with a headline and two marked statements from its source. Give the learner a highlighter and ask them to match each part of the headline to the source sentence or table cell that warrants it. Any unmatched phrase becomes a question, not immediately an accusation.
For guided practice, use a made-up table for four pupils whose scores change from 5, 6, 7 and 8 marks to 7, 6, 7 and 10 marks on equivalent ten-mark quizzes. The first mean is (5 + 6 + 7 + 8) ÷ 4 = 6.5/10; the second mean is (7 + 6 + 7 + 10) ÷ 4 = 7.5/10. The class mean rises by one mark, but two pupils are unchanged. Ask learners to repair “All pupils improved one mark.” A valid revision is “The average rose one mark; two of four pupils improved.”
For independent practice, provide a short article with a table, a description of the sample and a headline containing one unsupported word. Do not announce which word is at fault. Ask the pupil to produce a corrected headline plus a one-sentence evidence note. Finally, present a genuine source whose strong headline is supported, so learners learn to verify rather than reflexively doubt.
Parent and teacher next steps
A parent reading school progress reports can ask “Is this improvement an average, an individual change or a comparison with another class?” A teacher can ask pupils to attach a brief evidence trail to each presentation headline: original source link, measurement, sample and one limitation. The learner’s progress is observable when they can revise the strength of a claim without being told which word to remove.
This grows naturally from cross-checking group-project evidence and reconciling disagreeing sources. The wider eduKate Education Hub connects it to literacy across subjects. For the value of guided correction followed by independent checking, see the immutable Secondary 1 Mathematics Clementi reference.
Frequently asked questions
Does a higher average prove every student improved? No. Some values can fall or remain unchanged while the mean rises. Check individuals when making an “every” claim.
Can we write that the programme caused the increase? Not from a simple before-and-after comparison alone. Consider design, alternative explanations and what the measurements actually permit.
Should a headline include every limitation? No. A concise headline can be fair, with the scope made explicit and important qualifications available immediately in the subheading or body.
Is checking the publisher enough? No. A trustworthy source can still be misquoted or stretched. Compare each claim with the original evidence.
The real education objective
Learning to check a headline is learning to separate attention from proof. The pupil who can explain why “the average rose” differs from “everyone improved” is not merely practising literacy. That pupil is gaining a habit of careful, independent judgement that will remain valuable long after the particular lesson is forgotten.