The headline result of a trial is only useful after you ask who participated, what was measured and whether the finding applies to the people and products being discussed.
Start with the participants
A randomized trial in people with a medical condition can answer a narrow treatment question. Rothwell's discussion of external validity explains why trial eligibility, setting and background care matter when applying results to other populations.
A result in children with growth disorders, for example, cannot be silently converted into an adult physique claim. The intervention's source, monitoring and duration also matter.
Read the outcome, not just the headline
A change in blood concentration, lean-mass estimate or imaging measure is not automatically better strength, health or survival. Fleming and DeMets explain why surrogate endpoints can mislead when they fail to capture the outcomes people actually care about.
Look for the prespecified primary outcome, the comparison group and the size of the difference. A statistically detectable change may still be small or clinically irrelevant.
Notice what a trial cannot answer
Short trials rarely establish the consequences of years of use. Small samples can miss rare harms, and exclusions may leave out people with the very conditions that raise concern.
An apparently positive study is a starting point for careful interpretation, not permission to assume that a different product, population or pattern of use will have the same result.
In short
- Ask who was studied and under what conditions.
- A surrogate measure is not automatically a meaningful health or performance outcome.
- Do not transfer clinical trial findings to unregulated products or other populations without evidence.
Cited studies
These studies provide context for the article; findings may not apply to non-medical use or products sold online.
Rothwell PM. (2005). External validity of randomised controlled trials: to whom do the results of this trial apply?. The Lancet.
Read the study ↗Fleming TR, DeMets DL. (1996). Surrogate end points in clinical trials: are we being misled?. Annals of Internal Medicine.
Read the study ↗
Unfamiliar terminology is defined in our glossary. How we research and grade evidence is set out in our editorial standards, and errors can be reported through corrections.
This article is educational. It is not medical advice, a dosing recommendation, or an endorsement of use. Speak with a qualified medical practitioner about your circumstances.