On estimating efficacy from clinical trials

We define ‘biologic efficacy’ as the effect of treatment for all persons who receive the therapeutic agent to which they were assigned. It measures the biologic action of treatment among compliant persons. In a randomized trial with one treatment and one placebo control, one can theoretically estimate efficacy by comparing persons who complete the treatment regimen with controls who similarly complete the control regimen. In practice, however, we make this comparison with reservation because a control protocol often presents a different challenge for compliance than does the treatment, so that the compliant subgroups are not comparable. Standard practice employs intent‐to‐treat comparisons in which one compares those randomized to treatment and control without reference to whether they actually received the treatment. Intent‐to‐treat comparisons estimate the ‘programmatic effectiveness’ of a treatment rather than its biologic efficacy. This paper introduces and derives the statistical properties of an alternative estimator of biologic efficacy that avoids the potential selection bias inherent in a comparison of compliant subgroups. The method applies to randomized trials with a dichotomous outcome measure, whether or not a placebo is given to the control group. The idea is to compare the compliers in the treatment group to an inferred control subgroup chosen to eliminate selection bias. The methodology was motivated by and is illustrated in the analysis of a randomized community trial of the impact of vitamin A supplementation on children's mortality.