Multigroup Propensity Score Approach to Evaluating an Effectiveness Trial of the New Beginnings Program

Jenn Yun Tein, Gina L. Mazza, Heather J. Gunn, Hanjoe Kim, Elizabeth Stuart, Irwin N. Sandler, Sharlene A. Wolchik

Research output: Contribution to journalArticle

Abstract

We used a multigroup propensity score approach to evaluate a randomized effectiveness trial of the New Beginnings Program (NBP), an intervention targeting divorced or separated families. Two features of effectiveness trials, high nonattendance rates and inclusion of an active control, make program effects harder to detect. To estimate program effects based on actual intervention participation, we created a synthetic inactive control comprised of nonattenders and assessed the impact of attending the NBP or active control relative to no intervention (inactive control). We estimated propensity scores using generalized boosted models and applied inverse probability of treatment weighting for the comparisons. Relative to the inactive control, NBP strengthened parenting quality as well as reduced child exposure to interparental conflict, parent psychological distress, and child internalizing problems. Some effects were moderated by parent gender, parent ethnicity, or child age. On the other hand, the effects of active versus inactive control were minimal for parenting and in the unexpected direction for child internalizing problems. Findings from the propensity score approach complement and enhance the interpretation of findings from the intention-to-treat approach.

Original languageEnglish (US)
Pages (from-to)290-320
Number of pages31
JournalEvaluation and the Health Professions
Volume41
Issue number2
DOIs
StatePublished - Jun 1 2018

Fingerprint

Propensity Score
Parenting
Family Conflict
Divorce
Psychology
Therapeutics

Keywords

  • children of divorce
  • effectiveness trial
  • intention-to-treat principle
  • preventive intervention
  • propensity score analysis

ASJC Scopus subject areas

  • Health Policy

Cite this

Multigroup Propensity Score Approach to Evaluating an Effectiveness Trial of the New Beginnings Program. / Tein, Jenn Yun; Mazza, Gina L.; Gunn, Heather J.; Kim, Hanjoe; Stuart, Elizabeth; Sandler, Irwin N.; Wolchik, Sharlene A.

In: Evaluation and the Health Professions, Vol. 41, No. 2, 01.06.2018, p. 290-320.

Research output: Contribution to journalArticle

Tein, Jenn Yun ; Mazza, Gina L. ; Gunn, Heather J. ; Kim, Hanjoe ; Stuart, Elizabeth ; Sandler, Irwin N. ; Wolchik, Sharlene A. / Multigroup Propensity Score Approach to Evaluating an Effectiveness Trial of the New Beginnings Program. In: Evaluation and the Health Professions. 2018 ; Vol. 41, No. 2. pp. 290-320.
@article{5ac40a848c9f4d66b20fce4927a70f25,
title = "Multigroup Propensity Score Approach to Evaluating an Effectiveness Trial of the New Beginnings Program",
abstract = "We used a multigroup propensity score approach to evaluate a randomized effectiveness trial of the New Beginnings Program (NBP), an intervention targeting divorced or separated families. Two features of effectiveness trials, high nonattendance rates and inclusion of an active control, make program effects harder to detect. To estimate program effects based on actual intervention participation, we created a synthetic inactive control comprised of nonattenders and assessed the impact of attending the NBP or active control relative to no intervention (inactive control). We estimated propensity scores using generalized boosted models and applied inverse probability of treatment weighting for the comparisons. Relative to the inactive control, NBP strengthened parenting quality as well as reduced child exposure to interparental conflict, parent psychological distress, and child internalizing problems. Some effects were moderated by parent gender, parent ethnicity, or child age. On the other hand, the effects of active versus inactive control were minimal for parenting and in the unexpected direction for child internalizing problems. Findings from the propensity score approach complement and enhance the interpretation of findings from the intention-to-treat approach.",
keywords = "children of divorce, effectiveness trial, intention-to-treat principle, preventive intervention, propensity score analysis",
author = "Tein, {Jenn Yun} and Mazza, {Gina L.} and Gunn, {Heather J.} and Hanjoe Kim and Elizabeth Stuart and Sandler, {Irwin N.} and Wolchik, {Sharlene A.}",
year = "2018",
month = "6",
day = "1",
doi = "10.1177/0163278718763499",
language = "English (US)",
volume = "41",
pages = "290--320",
journal = "Evaluation and the Health Professions",
issn = "0163-2787",
publisher = "SAGE Publications Inc.",
number = "2",

}

TY - JOUR

T1 - Multigroup Propensity Score Approach to Evaluating an Effectiveness Trial of the New Beginnings Program

AU - Tein, Jenn Yun

AU - Mazza, Gina L.

AU - Gunn, Heather J.

AU - Kim, Hanjoe

AU - Stuart, Elizabeth

AU - Sandler, Irwin N.

AU - Wolchik, Sharlene A.

PY - 2018/6/1

Y1 - 2018/6/1

N2 - We used a multigroup propensity score approach to evaluate a randomized effectiveness trial of the New Beginnings Program (NBP), an intervention targeting divorced or separated families. Two features of effectiveness trials, high nonattendance rates and inclusion of an active control, make program effects harder to detect. To estimate program effects based on actual intervention participation, we created a synthetic inactive control comprised of nonattenders and assessed the impact of attending the NBP or active control relative to no intervention (inactive control). We estimated propensity scores using generalized boosted models and applied inverse probability of treatment weighting for the comparisons. Relative to the inactive control, NBP strengthened parenting quality as well as reduced child exposure to interparental conflict, parent psychological distress, and child internalizing problems. Some effects were moderated by parent gender, parent ethnicity, or child age. On the other hand, the effects of active versus inactive control were minimal for parenting and in the unexpected direction for child internalizing problems. Findings from the propensity score approach complement and enhance the interpretation of findings from the intention-to-treat approach.

AB - We used a multigroup propensity score approach to evaluate a randomized effectiveness trial of the New Beginnings Program (NBP), an intervention targeting divorced or separated families. Two features of effectiveness trials, high nonattendance rates and inclusion of an active control, make program effects harder to detect. To estimate program effects based on actual intervention participation, we created a synthetic inactive control comprised of nonattenders and assessed the impact of attending the NBP or active control relative to no intervention (inactive control). We estimated propensity scores using generalized boosted models and applied inverse probability of treatment weighting for the comparisons. Relative to the inactive control, NBP strengthened parenting quality as well as reduced child exposure to interparental conflict, parent psychological distress, and child internalizing problems. Some effects were moderated by parent gender, parent ethnicity, or child age. On the other hand, the effects of active versus inactive control were minimal for parenting and in the unexpected direction for child internalizing problems. Findings from the propensity score approach complement and enhance the interpretation of findings from the intention-to-treat approach.

KW - children of divorce

KW - effectiveness trial

KW - intention-to-treat principle

KW - preventive intervention

KW - propensity score analysis

UR - http://www.scopus.com/inward/record.url?scp=85046807505&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85046807505&partnerID=8YFLogxK

U2 - 10.1177/0163278718763499

DO - 10.1177/0163278718763499

M3 - Article

VL - 41

SP - 290

EP - 320

JO - Evaluation and the Health Professions

JF - Evaluation and the Health Professions

SN - 0163-2787

IS - 2

ER -