Optimizing matching and analysis combinations for estimating causal effects

K. Ellicott Colson, Kara E. Rudolph, Scott C. Zimmerman, Dana E. Goin, Elizabeth A. Stuart, Mark Van Der Laan, Jennifer Ahern

Research output: Contribution to journalArticle

Abstract

Matching methods are common in studies across many disciplines. However, there is limited evidence on how to optimally combine matching with subsequent analysis approaches to minimize bias and maximize efficiency for the quantity of interest. We conducted simulations to compare the performance of a wide variety of matching methods and analysis approaches in terms of bias, variance, and mean squared error (MSE). We then compared these approaches in an applied example of an employment training program. The results indicate that combining full matching with double robust analysis performed best in both the simulations and the applied example, particularly when combined with machine learning estimation methods. To reduce bias, current guidelines advise researchers to select the technique with the best post-matching covariate balance, but this work finds that such an approach does not always minimize mean squared error (MSE). These findings have important implications for future research utilizing matching. To minimize MSE, investigators should consider additional diagnostics, and use of simulations tailored to the study of interest to identify the optimal matching and analysis combination.

Original languageEnglish (US)
Article number23222
JournalScientific reports
Volume6
DOIs
StatePublished - Mar 16 2016

ASJC Scopus subject areas

  • General

Fingerprint Dive into the research topics of 'Optimizing matching and analysis combinations for estimating causal effects'. Together they form a unique fingerprint.

  • Cite this

    Colson, K. E., Rudolph, K. E., Zimmerman, S. C., Goin, D. E., Stuart, E. A., Laan, M. V. D., & Ahern, J. (2016). Optimizing matching and analysis combinations for estimating causal effects. Scientific reports, 6, [23222]. https://doi.org/10.1038/srep23222