A responsive marker is not automatically a meaningful outcome
A surrogate must support inference about treatment benefit. Association with the outcome—or even mediation within one trial—is not enough by itself.
Experiments often use an earlier or easier measure because the outcome that matters takes longer, costs more or is rarer. That substitution can accelerate learning, but it can also produce a confident answer to the wrong question. The gold standard distinguishes biomarkers, intermediates and validated surrogates, then tests whether treatment effects transfer across mechanisms, trials and contexts.
Frame the claimROUTE 02 · CHAPTERS 4–6
Work the evidenceROUTE 03 · CHAPTERS 7–9
Test transferROUTE 04 · CHAPTERS 10–12
Audit and continue
Open the chapter contents · Visit the Experimental Design root
Chapter contents
01 · Frame the claim
02 · Work the evidence
03 · Test transfer
Begin with the clinical, behavioural or functional outcome the decision is meant to improve: survival, symptoms, mobility, learning or quality of life. A laboratory value, image or intermediate event may be informative, but it is not the benefit merely because it is measurable.
Write the target outcome, time horizon and decision context before proposing a surrogate. This prevents convenience from silently redefining success.
A biomarker indicates a biological or other process. A mediator lies on a causal pathway from treatment to outcome under stated assumptions. A surrogate endpoint is intended to substitute for the meaningful outcome when estimating treatment benefit. One measure can occupy different roles in different settings.
Correlation with outcome risk does not establish surrogacy. A prognostic marker may identify high-risk people while failing to predict how changing the marker changes the outcome.
Contents · Previous chapter · Experimental Design root · Next chapter
Represent treatment T, surrogate S and outcome Y. The hoped-for pathway is T→S→Y. But treatment may also affect Y through another path, create harm not captured by S, or alter S without changing the process that determines Y. Common causes can associate S and Y without making S a valid substitute.
Use the diagram to specify estimands and assumptions, not as decoration.
| Path | Meaning | Threat to substitution |
|---|---|---|
| T→S→Y | Mediated benefit | May be only part of total effect |
| T→Y outside S | Direct or alternative pathway | Surrogate misses benefit or harm |
| U→S and U→Y | Common cause | Association mistaken for causation |
Contents · Previous chapter · Experimental Design root · Next chapter
A candidate surrogate is still under evaluation. A reasonably likely surrogate has strong mechanistic or epidemiologic support but incomplete clinical validation. A validated surrogate has strong evidence that an effect on it predicts a specific clinical benefit in a defined context.
Validation is not a permanent badge. It depends on treatment class, population, disease stage, comparator and outcome. State the exact context in which substitution is proposed.
Contents · Previous chapter · Experimental Design root · Next chapter
5. Test both individual-level and trial-level relationships
Individual-level association asks whether people with better surrogate values tend to have better outcomes. Trial-level association asks whether treatment effects on the surrogate predict treatment effects on the meaningful outcome across trials. The second is essential for substitution.
A single large trial can estimate treatment effects, but it cannot reveal how those effects co-vary across diverse interventions. Meta-analytic validation needs enough trials and mechanisms to test transport.
| Evidence level | Question | Insufficient conclusion |
|---|---|---|
| Individual | Do S and Y track within people? | Changing S will change Y |
| Within trial | Does treatment affect S and Y here? | S predicts effects elsewhere |
| Across trials | Do treatment effects co-vary? | Universal validation |
Contents · Previous chapter · Experimental Design root · Next chapter
6. Worked example: the marker improves but the outcome does not
A randomised treatment improves a biomarker by ten units compared with control. The biomarker is strongly associated with later complications in untreated cohorts. Yet the meaningful outcome occurs in 10% of both arms.
The pathway analysis reveals two effects: the treatment improves the biomarker through the intended mechanism, but it also causes an off-target harm that raises outcome risk. The mediated benefit and unmeasured harm cancel. A biomarker-only trial would have declared success.
The correct conclusion is not that biomarkers are useless. It is that this marker did not capture the total treatment effect in this intervention context. Follow-up on the meaningful outcome and harms remains necessary.
Contents · Previous chapter · Experimental Design root · Next chapter
Mediation analysis can decompose a treatment effect into pathways under assumptions about post-randomisation confounding, consistency, interference and measurement. Those assumptions are demanding because the mediator is not randomly assigned even when treatment is.
A large mediated proportion in one trial does not prove the endpoint can replace outcomes across new treatments. It describes a pathway under one intervention and population.
| Mediation issue | Why it matters | Required response |
|---|---|---|
| Post-treatment confounding | Mediator-outcome link is biased | Measure, model and assess sensitivity |
| Measurement error | Pathway effect is distorted | Validate timing and reliability |
| Treatment–mediator interaction | Effects differ by mediator level | Use a compatible estimand |
Contents · Previous chapter · Experimental Design root · Next chapter
8. Changed-context transfer check: attendance and learning
Move the logic to an education trial. A tutoring programme increases attendance, and attendance predicts examination performance. It is tempting to use attendance as a surrogate for learning.
But the programme might increase attendance through rewards without improving instruction, while stress or curriculum narrowing affects learning through paths attendance does not capture. Measure mastery directly and test whether programme effects on attendance predict effects on learning across settings and interventions.
Contents · Previous chapter · Experimental Design root · Next chapter
9. Recognise the surrogate paradox and transport limits
The surrogate paradox occurs when treatment benefits the surrogate yet harms or fails to benefit the outcome. It can arise from unmeasured pathways, competing risks or a surrogate that captures only one disease mechanism.
Do not transfer a surrogate validated for one drug class to another without evidence, use a composite proxy whose dominant component is less meaningful, or stop confirmatory follow-up because an early marker moved. Outcome substitution narrows what the experiment can establish.
Contents · Previous chapter · Experimental Design root · Next chapter
For every surrogate-based claim, trace the meaningful outcome, proposed mechanism, validation category, population, treatment class, comparator, time horizon and evidence across trials. Prespecify the surrogate, analysis and handling of missingness.
Search for discordant trials, not only supportive associations. Reanalyse conclusions under weaker surrogate assumptions and include direct outcome and safety evidence whenever available.
| Audit item | Minimum evidence | Warning sign |
|---|---|---|
| Target outcome | Meaningful endpoint and horizon | Proxy presented as benefit |
| Validation | Individual and trial-level evidence | One cohort correlation |
| Transport | Population and treatment class | Context omitted |
Contents · Previous chapter · Experimental Design root · Next chapter
Is a biomarker a surrogate endpoint?
Only when it is used to substitute for a meaningful endpoint and has evidence appropriate to that use.
Does mediation prove surrogacy?
No. Mediation within one trial does not show that treatment effects on the mediator predict outcome effects across interventions.
Can accelerated decisions use uncertainty?
Yes, but the evidentiary category and need for confirmatory outcome data must be explicit.
Contents · Previous chapter · Experimental Design root · Next chapter
12. The gold standard keeps the real outcome in view
Surrogate endpoints can shorten trials and expose mechanisms, but their value rests on an evidence chain: meaningful target outcome, plausible pathways, treatment-effect validation and bounded transport. A responsive proxy is a clue, not a verdict.
Before substituting, ask whether the measure predicts treatment effects, captures important harms and remains valid for this population and intervention. If those questions are unanswered, measure the outcome that matters.
Contents · Previous chapter · Experimental Design root · Return to Experimental Design
Continue through verified routes
Core route
- Experimental Design: subject root and specialist index
- The Gold Standard of Education: learning transfers into life
- The Gold Standard: eduKate Singapore
- How X Works: systems and first-principles hub
Specialist route
- Composite endpoints, component dominance and interpretability
- Missing outcomes, intercurrent events and estimand alignment
- Negative controls, falsification tests and residual bias
- Treatment effect heterogeneity, subgroup multiplicity and interaction tests
- Multi-arm trials, shared controls and multiplicity
