It's all about balance: Propensity score matching in the context of complex survey data

David Lenis, Trang Quynh Nguyen, Nianbo Dong, Elizabeth A. Stuart

Research output: Contribution to journalArticle

Abstract

Many research studies aim to draw causal inferences using data from large, nationally representative survey samples, and many of these studies use propensity score matching to make those causal inferences as rigorous as possible given the non-experimental nature of the data. However, very fewapplied studies are careful about incorporating the survey design with the propensity score analysis, which may mean that the results do not generate population inferences. This may be because few methodological studies examine how to best combine these methods. Furthermore, even fewer of them investigate different non-response mechanisms. This study examines methods for handling survey weights in propensity score matching analyses of survey data under different non-response mechanisms. Our main conclusions are: (i) whether the survey weights are incorporated in the estimation of the propensity score does not impact estimation of the population treatment effect, as long as good population treated-comparison balance is achieved on confounders, (ii) survey weights must be used in the outcome analysis, and (iii) the transferring of survey weights (i.e., assigning the weights of the treated units to the comparison units matched to them) can be beneficial under certain non-response mechanisms.

Original languageEnglish (US)
Pages (from-to)147-163
Number of pages17
JournalBiostatistics
Volume20
Issue number1
DOIs
StatePublished - Jan 1 2019

Keywords

  • Complex survey data
  • Non-response
  • PATE
  • PATT
  • Propensity score
  • Propensity score matching
  • SATE
  • SATT
  • Survey weights.

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint Dive into the research topics of 'It's all about balance: Propensity score matching in the context of complex survey data'. Together they form a unique fingerprint.

Cite this