GloNeuro

Learn / Research design

Causation

A causal claim states what would happen if one variable were changed. An association alone rarely justifies such a claim.

The counterfactual idea

To say that a treatment caused an improvement is to compare what happened with the treatment with what would have happened to the same person without it.

Each person has two potential outcomes, and the causal effect for that person is the difference between them (Rubin, 1974). Only one can ever be observed; the other is the counterfactual. An average effect can nevertheless be estimated when the treated and untreated groups are comparable, which randomisation ensures.

Eight simulated people, each with two potential memory scores: without a drug (open circle) and with it (filled circle). In reality each person reveals only one score.

Causal diagrams

A causal diagram, or directed acyclic graph (DAG), represents each variable as a point and each assumed causal effect as an arrow (Greenland et al., 1999). Association passes along any unblocked path between two variables, whatever the direction of the arrows. Four structures account for most differences between association and causation.

Structure

Four causal structures. X is the exposure and Y the outcome. The moving pulse marks the path along which association passes. The examples are hypothetical.
Confounding: a fork, X ← C → Y
A common cause associates its effects. Age, for example, reduces grey-matter volume and slows reaction times. Comparing people of the same age blocks the path.
Reverse causation, X ← Y
The outcome causes the exposure, as when the undiagnosed early stage of a condition reduces physical activity.
Mediation: a chain, X → M → Y
The exposure acts through an intermediate step. Adjusting for the mediator removes part of the effect being studied.
A collider, X → S ← Y
Two variables both cause a third. Selecting on the collider, or adjusting for it, creates an association that does not exist in the population (Cole et al., 2010). Berkson’s bias in hospital samples is an example.

Collider bias

In the simulation, an anxiety score and a memory-problem score are independent, and people are referred to a memory clinic when their sum is high. Among referred patients the two scores are negatively correlated, because those with little anxiety must have had marked memory problems to be referred.

Show

Simulated scores for 300 people, independent in the population. People above the referral line are referred.

Randomisation

When people choose their own treatment, those who receive it usually differ from those who do not, and these differences can explain a difference in outcomes. Random allocation breaks this link: every characteristic, measured or not, is expected to be balanced between the groups, and any imbalance is due to chance, which the statistical analysis allows for.

Allocation

Forty simulated patients. Filled figures are older; a ring marks an unmeasured characteristic. When patients choose, older patients choose the treatment more often. Over repeated random allocations, the differences between groups cluster around zero.

A trial also needs a control group, which differs only in not receiving the treatment, and often a placebo, an inactive treatment that looks the same. Expectation alone can have biological effects: in people with Parkinson’s disease, a placebo was followed by a substantial release of dopamine in the striatum (de la Fuente-Fernández et al., 2001). Blinding keeps participants, clinicians and assessors unaware of who received what, and allocation concealment prevents those enrolling participants from predicting the next allocation (Schulz et al., 2010).

Experimental manipulation in neuroscience

Functional MRI and EEG record which brain regions are active during a task, but activity can accompany a behaviour without being needed for it. To test whether a region is necessary or sufficient, neuroscientists change its activity and measure the consequences.

Experiment

Observation and intervention (schematic). Silencing region R tests whether it is necessary; activating it tests whether it is sufficient.
Lesions
Damaging a region and observing what is lost. Rats with hippocampal lesions were impaired at finding a hidden platform (Morris et al., 1982).
Optogenetics
Neurons are made to express light-sensitive proteins such as channelrhodopsin-2, so that light makes them fire with millisecond precision (Boyden et al., 2005) or, with other proteins, silences them.
Drugs
Agonists activate a receptor and antagonists block it. Few drugs act on only one target, so specificity must be shown.
Transcranial magnetic stimulation (TMS)
A magnetic pulse through the scalp induces currents in the cortex (Barker et al., 1985), briefly exciting or disrupting a region in healthy volunteers. Sham stimulation is the usual control.

When experiments are not possible

Many causal questions cannot be answered by randomising people, for example questions about head injury or genotype. Quasi-experimental designs use features of the world that act like randomisation; each is persuasive only when its assumptions are plausible (Craig et al., 2017).

Design

Three quasi-experimental designs, with simulated data.
Instrumental variables and Mendelian randomisation
An instrument influences the exposure, affects the outcome only through it, and is unrelated to confounders. In Mendelian randomisation the instrument is a genetic variant, inherited essentially by chance (Davey Smith and Ebrahim, 2003). A variant may, however, affect the outcome by other routes (pleiotropy).
Difference-in-differences
The change over time in an exposed group is compared with the change in an unexposed group, assuming that both would otherwise have changed in parallel (Dimick and Ryan, 2014).
Regression discontinuity
When treatment is given to everyone above a cut-off score, people just either side are similar, so a jump in outcomes at the cut-off estimates the effect (Imbens and Lemieux, 2008).

The Bradford Hill considerations

Bradford Hill described nine aspects of an association to weigh before judging it causal, and stressed that none is decisive on its own (Hill, 1965). The exception is temporality: a cause must precede its effect (Rothman and Greenland, 2005).

ConsiderationMeaningLimitation
StrengthA strong association is harder to explain by confounding.Weak associations can be causal, and strong ones confounded.
ConsistencyThe association is seen repeatedly, in different places and designs.Studies can share the same bias.
SpecificityThe exposure is linked to one outcome rather than many.Many causes have many effects.
TemporalityThe cause comes before the effect.Essential, but hard to establish when a disease begins long before diagnosis.
Biological gradientMore exposure goes with more of the outcome.Some effects have thresholds, and confounders can produce gradients.
PlausibilityA credible mechanism exists.It depends on current knowledge.
CoherenceThe causal interpretation does not conflict with what is known.Absence of conflict is weak evidence.
ExperimentChanging the exposure changes the outcome.The experiment may test a different question.
AnalogySimilar causes are known to have similar effects.Analogies can be found for almost anything.

Assessing a causal claim: smoking and Parkinson’s disease

The claim that smoking protects against Parkinson’s disease shows how a causal claim is assessed. Smoking causes many serious diseases; nothing here suggests that anyone should smoke.

  1. The association

    A meta-analysis of 44 case–control and 4 cohort studies found a relative risk of 0.59 (95% CI 0.54 to 0.63) for people who had ever smoked and 0.39 (0.32 to 0.47) for current smokers, compared with people who had never smoked, and the risk fell with each additional 10 pack-years (Hernán et al., 2002). The association is strong, consistent and graded, and unlikely to be due to chance.

  2. Alternative explanations

    Parkinson’s disease begins years before diagnosis, and its early changes might make people less inclined to smoke (reverse causation). Smokers also die earlier of other causes, before a diagnosis can be made (survivorship bias).

  3. Experimental evidence

    In a randomised, placebo-controlled trial, 163 people with recently diagnosed Parkinson’s disease wore nicotine or placebo patches for a year. Nicotine did not slow progression (Oertel et al., 2023).

  4. Conclusion

    The trial tested progression, not onset, and one component of tobacco, so whether smoking affects the risk of developing the disease remains open. A fair summary is: “strongly associated; causal explanation not established”.

References

  1. Barker, A. T., Jalinous, R., & Freeston, I. L. (1985). Non-invasive magnetic stimulation of human motor cortex. The Lancet, 325(8437), 1106–1107. https://doi.org/10.1016/S0140-6736(85)92413-4
  2. Boyden, E. S., Zhang, F., Bamberg, E., Nagel, G., & Deisseroth, K. (2005). Millisecond-timescale, genetically targeted optical control of neural activity. Nature Neuroscience, 8(9), 1263–1268. https://doi.org/10.1038/nn1525
  3. Cole, S. R., Platt, R. W., Schisterman, E. F., Chu, H., Westreich, D., Richardson, D., & Poole, C. (2010). Illustrating bias due to conditioning on a collider. International Journal of Epidemiology, 39(2), 417–420. https://doi.org/10.1093/ije/dyp334
  4. Craig, P., Katikireddi, S. V., Leyland, A., & Popham, F. (2017). Natural experiments: an overview of methods, approaches, and contributions to public health intervention research. Annual Review of Public Health, 38, 39–56. https://doi.org/10.1146/annurev-publhealth-031816-044327
  5. Davey Smith, G., & Ebrahim, S. (2003). ‘Mendelian randomization’: can genetic epidemiology contribute to understanding environmental determinants of disease? International Journal of Epidemiology, 32(1), 1–22. https://doi.org/10.1093/ije/dyg070
  6. de la Fuente-Fernández, R., Ruth, T. J., Sossi, V., Schulzer, M., Calne, D. B., & Stoessl, A. J. (2001). Expectation and dopamine release: mechanism of the placebo effect in Parkinson’s disease. Science, 293(5532), 1164–1166. https://doi.org/10.1126/science.1060937
  7. Dimick, J. B., & Ryan, A. M. (2014). Methods for evaluating changes in health care policy: the difference-in-differences approach. JAMA, 312(22), 2401–2402. https://doi.org/10.1001/jama.2014.16153
  8. Greenland, S., Pearl, J., & Robins, J. M. (1999). Causal diagrams for epidemiologic research. Epidemiology, 10(1), 37–48. https://doi.org/10.1097/00001648-199901000-00008
  9. Hernán, M. A., Takkouche, B., Caamaño-Isorna, F., & Gestal-Otero, J. J. (2002). A meta-analysis of coffee drinking, cigarette smoking, and the risk of Parkinson’s disease. Annals of Neurology, 52(3), 276–284. https://doi.org/10.1002/ana.10277
  10. Hill, A. B. (1965). The environment and disease: association or causation? Proceedings of the Royal Society of Medicine, 58(5), 295–300. https://doi.org/10.1177/003591576505800503
  11. Imbens, G. W., & Lemieux, T. (2008). Regression discontinuity designs: a guide to practice. Journal of Econometrics, 142(2), 615–635. https://doi.org/10.1016/j.jeconom.2007.05.001
  12. Morris, R. G., Garrud, P., Rawlins, J. N., & O’Keefe, J. (1982). Place navigation impaired in rats with hippocampal lesions. Nature, 297(5868), 681–683. https://doi.org/10.1038/297681a0
  13. Oertel, W. H., Müller, H.-H., Unger, M. M., et al. (2023). Transdermal nicotine treatment and progression of early Parkinson’s disease. NEJM Evidence, 2(9), EVIDoa2200311. https://doi.org/10.1056/EVIDoa2200311
  14. Rothman, K. J., & Greenland, S. (2005). Causation and causal inference in epidemiology. American Journal of Public Health, 95(Suppl. 1), S144–S150. https://doi.org/10.2105/AJPH.2004.059204
  15. Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5), 688–701. https://doi.org/10.1037/h0037350
  16. Schulz, K. F., Altman, D. G., & Moher, D., for the CONSORT Group (2010). CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ, 340, c332. https://doi.org/10.1136/bmj.c332

Last updated