KONSİL

Glossary · Statistics

What is a non-inferiority trial?

A non-inferiority trial aims to show that a new treatment is not worse than a control by more than a pre-specified margin. The question is one-sided: the new treatment may be better, and non-inferiority is concluded when the unfavourable end of the confidence interval stays within the margin.

According to the FDA guidance, a non-inferiority trial aims to show that the new drug falls short of the active control by no more than a pre-specified amount, the margin M. The null hypothesis is that control minus new drug is at least M; the test checks whether the upper bound of the two-sided 95% confidence interval for that difference is below M, which corresponds to a one-sided significance level of 0.025. According to Schumi and Wittes (2011), an equivalence trial instead requires both ends of the interval to lie within the margin.

The guidance separates two levels of margin. M1 is the whole effect of the active control over placebo, estimated from past trials and, unless the trial has a placebo arm, not measured in the current one; M2 is the largest clinically acceptable loss of effect and is usually chosen smaller than M1. Schumi and Wittes describe a ‘95-95’ approach: M1 taken from the lower limit of the 95% confidence interval of the control’s effect against placebo, and M2 set to preserve a fraction of that effect, for example 50% or 75%.

The non-inferiority and equivalence checklist on the CONSORT website (2006 version) asks, in the sample-size item, whether the calculation used a non-inferiority or equivalence criterion and for the margin and the rationale for its choice. Piaggio et al. (2012) present the updated extension based on CONSORT 2010.

Example

In a hypothetical trial a new drug is compared with a standard drug, with the difference defined as the standard drug’s blood-pressure reduction minus the new drug’s (a positive value means the new drug is less effective) and the margin fixed beforehand at 3 mmHg. A 95% confidence interval of −1.0 to +2.1 mmHg for this difference shows non-inferiority because its upper bound is below 3 mmHg; an interval of −1.0 to +3.8 mmHg would not.

A point to watch

According to Altman and Bland (1995), a lack of significant difference usually shows only an absence of evidence of a difference, while according to the FDA guidance non-inferiority is shown when the upper bound of the confidence interval is below the pre-specified margin. On the reading of these two statements, a non-significant superiority test (P > 0.05) alone is not evidence of non-inferiority.

Related terms

Guides and tools

Sources

  1. Non-Inferiority Clinical Trials to Establish Effectiveness: Guidance for Industry — U.S. Food and Drug Administration (CDER/CBER), 2016
  2. Through the looking glass: understanding non-inferiority — Trials (BioMed Central), 2011
  3. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement — JAMA, 2012
  4. CONSORT Extension for Non-inferiority and Equivalence Trials: Checklist (2006 version on the CONSORT website) — CONSORT Group (consort-spirit.org), 2006
  5. Absence of evidence is not evidence of absence — BMJ, 1995