Propensity score estimation: neural networks, support vector machines, decision trees (CART), and meta-classifiers as alternatives to logistic regression

Daniel Westreich, Justin Lessler, Michele Jonsson Funk

Research output: Contribution to journalReview article

Abstract

Objective: Propensity scores for the analysis of observational data are typically estimated using logistic regression. Our objective in this review was to assess machine learning alternatives to logistic regression, which may accomplish the same goals but with fewer assumptions or greater accuracy. Study Design and Setting: We identified alternative methods for propensity score estimation and/or classification from the public health, biostatistics, discrete mathematics, and computer science literature, and evaluated these algorithms for applicability to the problem of propensity score estimation, potential advantages over logistic regression, and ease of use. Results: We identified four techniques as alternatives to logistic regression: neural networks, support vector machines, decision trees (classification and regression trees [CART]), and meta-classifiers (in particular, boosting). Conclusion: Although the assumptions of logistic regression are well understood, those assumptions are frequently ignored. All four alternatives have advantages and disadvantages compared with logistic regression. Boosting (meta-classifiers) and, to a lesser extent, decision trees (particularly CART), appear to be most promising for use in the context of propensity score analysis, but extensive simulation studies are needed to establish their utility in practice.

Original languageEnglish (US)
Pages (from-to)826-833
Number of pages8
JournalJournal of Clinical Epidemiology
Volume63
Issue number8
DOIs
StatePublished - Aug 2010

    Fingerprint

Keywords

  • Classification and regression trees (CART)
  • Logistic regression
  • Neural networks
  • Propensity scores
  • Recursive partitioning algorithms
  • Review

ASJC Scopus subject areas

  • Epidemiology

Cite this