Examining moderation analyses in propensity score methods: Application to depression and substance use

Kerry M. Green, Elizabeth Stuart

Research output: Contribution to journalArticle

Abstract

Objective: This study provides guidance on how propensity score methods can be combined with moderation analyses (i.e., effect modification) to examine subgroup differences in potential causal effects in nonexperimental studies. As a motivating example, we focus on how depression may affect subsequent substance use differently for men and women. Method: Using data from a longitudinal community cohort study (N = 952) of urban African Americans with assessments in childhood, adolescence, young adulthood, and midlife, we estimate the influence of depression by young adulthood on substance use outcomes in midlife, and whether that influence varies by gender. We illustrate and compare 5 different techniques for estimating subgroup effects using propensity score methods, including separate propensity score models and matching for men and women, a joint propensity score model for men and women with matching separately and together by gender, and a joint male/female propensity score model that includes theoretically important gender interactions with matching separately and together by gender. Results: Analyses showed that estimating separate models for men and women yielded the best balance and, therefore, is a preferred technique when subgroup analyses are of interest, at least in this data. Results also showed substance use consequences of depression but no significant gender differences. Conclusions: It is critical to prespecify subgroup effects before the estimation of propensity scores and to check balance within subgroups regardless of the type of propensity score model used. Results also suggest that depression may affect multiple substance use outcomes in midlife for both men and women relatively equally.

Original languageEnglish (US)
Pages (from-to)773-783
Number of pages11
JournalJournal of Consulting and Clinical Psychology
Volume82
Issue number5
DOIs
StatePublished - 2014

Fingerprint

Propensity Score
Joints
Substance Use
Moderation
African Americans
Cohort Studies

Keywords

  • Causal effects
  • Effect modification
  • Gender differences
  • Nonexperimental study
  • Observational data

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Clinical Psychology
  • Arts and Humanities (miscellaneous)

Cite this

@article{fe391601d6624d60887b079f710a885a,
title = "Examining moderation analyses in propensity score methods: Application to depression and substance use",
abstract = "Objective: This study provides guidance on how propensity score methods can be combined with moderation analyses (i.e., effect modification) to examine subgroup differences in potential causal effects in nonexperimental studies. As a motivating example, we focus on how depression may affect subsequent substance use differently for men and women. Method: Using data from a longitudinal community cohort study (N = 952) of urban African Americans with assessments in childhood, adolescence, young adulthood, and midlife, we estimate the influence of depression by young adulthood on substance use outcomes in midlife, and whether that influence varies by gender. We illustrate and compare 5 different techniques for estimating subgroup effects using propensity score methods, including separate propensity score models and matching for men and women, a joint propensity score model for men and women with matching separately and together by gender, and a joint male/female propensity score model that includes theoretically important gender interactions with matching separately and together by gender. Results: Analyses showed that estimating separate models for men and women yielded the best balance and, therefore, is a preferred technique when subgroup analyses are of interest, at least in this data. Results also showed substance use consequences of depression but no significant gender differences. Conclusions: It is critical to prespecify subgroup effects before the estimation of propensity scores and to check balance within subgroups regardless of the type of propensity score model used. Results also suggest that depression may affect multiple substance use outcomes in midlife for both men and women relatively equally.",
keywords = "Causal effects, Effect modification, Gender differences, Nonexperimental study, Observational data",
author = "Green, {Kerry M.} and Elizabeth Stuart",
year = "2014",
doi = "10.1037/a0036515",
language = "English (US)",
volume = "82",
pages = "773--783",
journal = "Journal of Consulting and Clinical Psychology",
issn = "0022-006X",
publisher = "American Psychological Association Inc.",
number = "5",

}

TY - JOUR

T1 - Examining moderation analyses in propensity score methods

T2 - Application to depression and substance use

AU - Green, Kerry M.

AU - Stuart, Elizabeth

PY - 2014

Y1 - 2014

N2 - Objective: This study provides guidance on how propensity score methods can be combined with moderation analyses (i.e., effect modification) to examine subgroup differences in potential causal effects in nonexperimental studies. As a motivating example, we focus on how depression may affect subsequent substance use differently for men and women. Method: Using data from a longitudinal community cohort study (N = 952) of urban African Americans with assessments in childhood, adolescence, young adulthood, and midlife, we estimate the influence of depression by young adulthood on substance use outcomes in midlife, and whether that influence varies by gender. We illustrate and compare 5 different techniques for estimating subgroup effects using propensity score methods, including separate propensity score models and matching for men and women, a joint propensity score model for men and women with matching separately and together by gender, and a joint male/female propensity score model that includes theoretically important gender interactions with matching separately and together by gender. Results: Analyses showed that estimating separate models for men and women yielded the best balance and, therefore, is a preferred technique when subgroup analyses are of interest, at least in this data. Results also showed substance use consequences of depression but no significant gender differences. Conclusions: It is critical to prespecify subgroup effects before the estimation of propensity scores and to check balance within subgroups regardless of the type of propensity score model used. Results also suggest that depression may affect multiple substance use outcomes in midlife for both men and women relatively equally.

AB - Objective: This study provides guidance on how propensity score methods can be combined with moderation analyses (i.e., effect modification) to examine subgroup differences in potential causal effects in nonexperimental studies. As a motivating example, we focus on how depression may affect subsequent substance use differently for men and women. Method: Using data from a longitudinal community cohort study (N = 952) of urban African Americans with assessments in childhood, adolescence, young adulthood, and midlife, we estimate the influence of depression by young adulthood on substance use outcomes in midlife, and whether that influence varies by gender. We illustrate and compare 5 different techniques for estimating subgroup effects using propensity score methods, including separate propensity score models and matching for men and women, a joint propensity score model for men and women with matching separately and together by gender, and a joint male/female propensity score model that includes theoretically important gender interactions with matching separately and together by gender. Results: Analyses showed that estimating separate models for men and women yielded the best balance and, therefore, is a preferred technique when subgroup analyses are of interest, at least in this data. Results also showed substance use consequences of depression but no significant gender differences. Conclusions: It is critical to prespecify subgroup effects before the estimation of propensity scores and to check balance within subgroups regardless of the type of propensity score model used. Results also suggest that depression may affect multiple substance use outcomes in midlife for both men and women relatively equally.

KW - Causal effects

KW - Effect modification

KW - Gender differences

KW - Nonexperimental study

KW - Observational data

UR - http://www.scopus.com/inward/record.url?scp=84925969540&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84925969540&partnerID=8YFLogxK

U2 - 10.1037/a0036515

DO - 10.1037/a0036515

M3 - Article

C2 - 24731233

AN - SCOPUS:84925969540

VL - 82

SP - 773

EP - 783

JO - Journal of Consulting and Clinical Psychology

JF - Journal of Consulting and Clinical Psychology

SN - 0022-006X

IS - 5

ER -