VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

The Gold Standard of Experimental Design | Surrogate Endpoints, Causal Mediation and Outcome Substitution

Original illustration of university researchers discussing a laboratory notebook, sample containers and an abstract chart; not an actual study or result.
THE GOLD STANDARD · EXPERIMENTAL DESIGN

A responsive marker is not automatically a meaningful outcome

A surrogate must support inference about treatment benefit. Association with the outcome—or even mediation within one trial—is not enough by itself.

Experiments often use an earlier or easier measure because the outcome that matters takes longer, costs more or is rarer. That substitution can accelerate learning, but it can also produce a confident answer to the wrong question. The gold standard distinguishes biomarkers, intermediates and validated surrogates, then tests whether treatment effects transfer across mechanisms, trials and contexts.

ROUTE 01 · CHAPTERS 1–3
Frame the claim
ROUTE 02 · CHAPTERS 4–6
Work the evidence
ROUTE 03 · CHAPTERS 7–9
Test transfer
ROUTE 04 · CHAPTERS 10–12
Audit and continue

Open the chapter contents · Visit the Experimental Design root

CHAPTER 1 OF 12 · FRAME THE CLAIM

1. Name the outcome people actually care about

Back to contents

Begin with the clinical, behavioural or functional outcome the decision is meant to improve: survival, symptoms, mobility, learning or quality of life. A laboratory value, image or intermediate event may be informative, but it is not the benefit merely because it is measurable.

Write the target outcome, time horizon and decision context before proposing a surrogate. This prevents convenience from silently redefining success.

Contents · Experimental Design root · Next chapter

CHAPTER 2 OF 12 · FRAME THE CLAIM

2. Separate biomarker, mediator and surrogate

Back to contents

A biomarker indicates a biological or other process. A mediator lies on a causal pathway from treatment to outcome under stated assumptions. A surrogate endpoint is intended to substitute for the meaningful outcome when estimating treatment benefit. One measure can occupy different roles in different settings.

Correlation with outcome risk does not establish surrogacy. A prognostic marker may identify high-risk people while failing to predict how changing the marker changes the outcome.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 3 OF 12 · FRAME THE CLAIM

3. Draw the pathways before fitting the model

Back to contents

Represent treatment T, surrogate S and outcome Y. The hoped-for pathway is T→S→Y. But treatment may also affect Y through another path, create harm not captured by S, or alter S without changing the process that determines Y. Common causes can associate S and Y without making S a valid substitute.

Use the diagram to specify estimands and assumptions, not as decoration.

PathMeaningThreat to substitution
T→S→YMediated benefitMay be only part of total effect
T→Y outside SDirect or alternative pathwaySurrogate misses benefit or harm
U→S and U→YCommon causeAssociation mistaken for causation
A surrogate claim concerns treatment effects across pathways, not correlation alone.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 4 OF 12 · WORK THE EVIDENCE

4. Match validation strength to the intended use

Back to contents

A candidate surrogate is still under evaluation. A reasonably likely surrogate has strong mechanistic or epidemiologic support but incomplete clinical validation. A validated surrogate has strong evidence that an effect on it predicts a specific clinical benefit in a defined context.

Validation is not a permanent badge. It depends on treatment class, population, disease stage, comparator and outcome. State the exact context in which substitution is proposed.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 5 OF 12 · WORK THE EVIDENCE

5. Test both individual-level and trial-level relationships

Back to contents

Individual-level association asks whether people with better surrogate values tend to have better outcomes. Trial-level association asks whether treatment effects on the surrogate predict treatment effects on the meaningful outcome across trials. The second is essential for substitution.

A single large trial can estimate treatment effects, but it cannot reveal how those effects co-vary across diverse interventions. Meta-analytic validation needs enough trials and mechanisms to test transport.

Evidence levelQuestionInsufficient conclusion
IndividualDo S and Y track within people?Changing S will change Y
Within trialDoes treatment affect S and Y here?S predicts effects elsewhere
Across trialsDo treatment effects co-vary?Universal validation
Surrogacy requires more than a strong person-level association.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 6 OF 12 · WORK THE EVIDENCE

6. Worked example: the marker improves but the outcome does not

Back to contents

A randomised treatment improves a biomarker by ten units compared with control. The biomarker is strongly associated with later complications in untreated cohorts. Yet the meaningful outcome occurs in 10% of both arms.

The pathway analysis reveals two effects: the treatment improves the biomarker through the intended mechanism, but it also causes an off-target harm that raises outcome risk. The mediated benefit and unmeasured harm cancel. A biomarker-only trial would have declared success.

The correct conclusion is not that biomarkers are useless. It is that this marker did not capture the total treatment effect in this intervention context. Follow-up on the meaningful outcome and harms remains necessary.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 7 OF 12 · TEST TRANSFER

7. Use causal mediation without overclaiming

Back to contents

Mediation analysis can decompose a treatment effect into pathways under assumptions about post-randomisation confounding, consistency, interference and measurement. Those assumptions are demanding because the mediator is not randomly assigned even when treatment is.

A large mediated proportion in one trial does not prove the endpoint can replace outcomes across new treatments. It describes a pathway under one intervention and population.

Mediation issueWhy it mattersRequired response
Post-treatment confoundingMediator-outcome link is biasedMeasure, model and assess sensitivity
Measurement errorPathway effect is distortedValidate timing and reliability
Treatment–mediator interactionEffects differ by mediator levelUse a compatible estimand
Causal mediation can inform surrogacy, but it does not automatically validate it.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 8 OF 12 · TEST TRANSFER

8. Changed-context transfer check: attendance and learning

Back to contents

Move the logic to an education trial. A tutoring programme increases attendance, and attendance predicts examination performance. It is tempting to use attendance as a surrogate for learning.

But the programme might increase attendance through rewards without improving instruction, while stress or curriculum narrowing affects learning through paths attendance does not capture. Measure mastery directly and test whether programme effects on attendance predict effects on learning across settings and interventions.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 9 OF 12 · TEST TRANSFER

9. Recognise the surrogate paradox and transport limits

Back to contents

The surrogate paradox occurs when treatment benefits the surrogate yet harms or fails to benefit the outcome. It can arise from unmeasured pathways, competing risks or a surrogate that captures only one disease mechanism.

Do not transfer a surrogate validated for one drug class to another without evidence, use a composite proxy whose dominant component is less meaningful, or stop confirmatory follow-up because an early marker moved. Outcome substitution narrows what the experiment can establish.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 10 OF 12 · AUDIT AND CONTINUE

10. Audit the substitution decision

Back to contents

For every surrogate-based claim, trace the meaningful outcome, proposed mechanism, validation category, population, treatment class, comparator, time horizon and evidence across trials. Prespecify the surrogate, analysis and handling of missingness.

Search for discordant trials, not only supportive associations. Reanalyse conclusions under weaker surrogate assumptions and include direct outcome and safety evidence whenever available.

Audit itemMinimum evidenceWarning sign
Target outcomeMeaningful endpoint and horizonProxy presented as benefit
ValidationIndividual and trial-level evidenceOne cohort correlation
TransportPopulation and treatment classContext omitted
Minimum audit for replacing a meaningful outcome.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 11 OF 12 · AUDIT AND CONTINUE

11. Frequently asked questions

Back to contents

Is a biomarker a surrogate endpoint?

Only when it is used to substitute for a meaningful endpoint and has evidence appropriate to that use.

Does mediation prove surrogacy?

No. Mediation within one trial does not show that treatment effects on the mediator predict outcome effects across interventions.

Can accelerated decisions use uncertainty?

Yes, but the evidentiary category and need for confirmatory outcome data must be explicit.

Contents · Previous chapter · Experimental Design root · Next chapter

CHAPTER 12 OF 12 · AUDIT AND CONTINUE

12. The gold standard keeps the real outcome in view

Back to contents

Surrogate endpoints can shorten trials and expose mechanisms, but their value rests on an evidence chain: meaningful target outcome, plausible pathways, treatment-effect validation and bounded transport. A responsive proxy is a clue, not a verdict.

Before substituting, ask whether the measure predicts treatment effects, captures important harms and remains valid for this population and intervention. If those questions are unanswered, measure the outcome that matters.

Contents · Previous chapter · Experimental Design root · Return to Experimental Design