2013International Journal of Clinical PracticeRequires access

When does a difference make a difference? Interpretation of number needed to treat, number needed to harm, and likelihood to be helped or harmed

Leslie Citrome, Terence A. Ketter

Open publisher page 253 citations

Abstract

Although great effort is made in clinical trials to demonstrate statistical superiority of one intervention vs. another, insufficient attention is paid regarding the clinical relevance or clinical significance of the observed outcomes. Effect sizes are not always reported. Available absolute effect size measures include Cohen's d, area under the curve, success rate difference, attributable risk and number needed to treat (NNT). Of all of these measures, NNT is arguably the most clinically intuitive and helps relate effect size difference back to real-world concerns of clinical practice. This commentary reviews the formula for NNT, and proposes acceptable values for NNT and its analogue, number needed to harm (NNH), using examples from the medical literature. The concept of likelihood to be helped or harmed (LHH), calculated as the ratio of NNH to NNT, is used to illustrate trade-offs between benefits and harms. Additional considerations in interpreting NNT are discussed, including the importance of defining acceptable response, adverse outcomes of interest, the effect of time, and the importance of individual baseline characteristics.

About this research paper

What this paper is about

Although great effort is made in clinical trials to demonstrate statistical superiority of one intervention vs. another, insufficient attention is paid regarding the clinical relevance or clinical significance of the observed outcomes. Effect sizes are not always reported. Available absolute effect size measures include Cohen's d, area under the curve, success rate difference, attributable risk and number needed to treat (NNT). Of all of these measures, NNT is arguably the most clinically intuitive and helps relate effect size difference back to real-world concerns of clinical practice. This commentary reviews the formula for NNT, and proposes acceptable values for NNT and its analogue, number needed to harm (NNH), using examples from the medical literature. The concept of likelihood to be helped or harmed (LHH), calculated as the ratio of NNH to NNT, is used to illustrate trade-offs between benefits and harms. Additional considerations in interpreting NNT are discussed, including the importance of defining acceptable response, adverse outcomes of interest, the effect of time, and the importance of individual baseline characteristics.

Why it matters

OpenAlex reports 253 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Although great effort is made in clinical trials to demonstrate statistical superiority of one intervention vs. another, insufficient attention is paid regarding the clinical relevance or clinical significance of the observed outcomes. Effect sizes are not always reported. Available absolute effect size measures include Cohen's d, area under the curve, success rate difference, attributable risk and number needed to treat (NNT). Of all of these measures, NNT is arguably the most clinically intuitive and helps relate effect size difference back to real-world concerns of clinical practice. This commentary reviews the formula for NNT, and proposes acceptable values for NNT and its analogue, number needed to harm (NNH), using examples from the medical literature. The concept of likelihood to be helped or harmed (LHH), calculated as the ratio of NNH to NNT, is used to illustrate trade-offs between benefits and harms. Additional considerations in interpreting NNT are discussed, including the importance of defining acceptable response, adverse outcomes of interest, the effect of time, and the importance of individual baseline characteristics.

Key concepts: Number needed to treat, Number needed to harm, Medicine, Harm, Absolute risk reduction, Actuarial science, Relative risk, Confidence interval

Related papers

Back to paper searchBrowse research topicsOriginal source
When does a difference make a difference? Interpretation of number needed to treat, number needed to harm, and likelihood to be helped or harmed — Research Paper | ScholarLens