Incorporating single-arm evidence into a network meta-analysis using aggregate level matching: Assessing the impact

Increasingly, single-armed evidence is included in health technology assessment submissions when companies are seeking reimbursement for new drugs. While it is recognized that randomized controlled trials provide a higher standard of evidence, these are not available for many new agents that have been granted licenses in recent years. Therefore, it is important to examine whether alternative strategies for assessing this evidence may be used. In this work, we examine approaches to incorporating single-armed evidence formally in the evaluation process. We consider matching aggregate level covariates to comparator arms or trials and including this evidence in a network meta-analysis. We consider two methods of matching: (i) we include the chosen matched arm in the data set itself as a comparator for the single-arm trial; (ii) we use the baseline odds of an event in a chosen matched trial to use as a plug-in estimator for the single-arm trial. We illustrate that the synthesis of evidence resulting from such a setup is sensitive to the between-study variability, formulation of the prior for the between-design effect, weight given to the single-arm evidence, and extent of the bias in single-armed evidence. We provide a flowchart for the process involved in such a synthesis and highlight additional sensitivity analyses that should be carried out. This work was motivated by a hepatitis C data set, where many agents have only been examined in single-arm studies. We present the results of our methods applied to this data set.