How to read a brain study: causality, reproducibility and hype
September 29, 2026 · 24 min read
Peter Attia's journal clubs on epidemiology and statistics, Mark Gordon on research fraud, and placebo research on where effects stop all teach readers to question associations and small studies. It helps people judge health claims instead of chasing each headline.
The rules, numbers and steps worth keeping in front of you.
- One study rarely shows what its headline claims.
- Attia: ask whether the outcome could be causing the behavior.
- Attia: only randomization can settle cause in an association.
- An odds ratio minus one gives the percent change in risk.
- Huge studies can make clinically trivial differences look significant.
- A null result only rules out effects the study was powered to find.
- Metformin looked life-extending because people who did badly were dropped from the analysis.
- Check the baseline table and the supplements.
- Huberman's four questions end with the key one: do the conclusions follow?
- Gordon and Rogan: a fraud case put 132 Alzheimer's papers in doubt.
- Unnamed statistics and single patient stories deserve the same doubt.
- Huberman: expectation moves dopamine, hormones and pain, so placebo controls matter.
- Placebo eased asthma discomfort but did not change breathing or shrink tumors.
- Act on cheap, safe habits now. Ask a physician before changing drugs or supplements.
This is the short form. The full insight has every expert's reasoning, their own words and the sources.