Methodological Challenges Examining Subgroup Differences: Examples from Universal School-based Youth Violence Prevention Trials

Albert D. Farrell, David B. Henry, Amie Bettencourt

Research output: Contribution to journalReview article

Abstract

This article reviews the literature on school-based universal violence prevention programs to illustrate key methodological challenges for investigating subgroup differences in prevention effects. The variety of potential moderating factors examined within this literature is discussed within the context of a social-ecological model. Our review of this literature identified the following methodological issues: the need for a clear a priori theoretical basis for selecting potential moderators, inflated Type I error rates that result from large numbers of comparisons, the absence of explicit tests of moderation, interpretive issues arising from a restricted range on moderator variables, the failure to report effect size estimates, the presence of potential confounding factors, and the importance of examining factors that might operate at multiple ecological levels. These points are illustrated using examples of studies, primarily within youth violence prevention research, that have identified factors within the individual, school, and community that moderate the outcomes of preventive interventions. We conclude with general recommendations for future work. These include the benefits of using the social-ecological model to provide a basis for moving from exploratory to more theory-driven confirmatory models of subgroup differences, the potential merits of qualitative research designed to identify factors that may influence the effectiveness of intervention efforts for specific subgroups of individuals, and the provision of effect size estimates and confidence intervals for effect sizes in prevention reports.

Original languageEnglish (US)
Pages (from-to)121-133
Number of pages13
JournalPrevention Science
Volume14
Issue number2
DOIs
StatePublished - Jan 1 2013

Fingerprint

Violence
Epidemiologic Effect Modifiers
Qualitative Research
Confidence Intervals
Research

Keywords

  • Moderation
  • Prevention
  • Subgroup analyses
  • Violence prevention

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

Methodological Challenges Examining Subgroup Differences : Examples from Universal School-based Youth Violence Prevention Trials. / Farrell, Albert D.; Henry, David B.; Bettencourt, Amie.

In: Prevention Science, Vol. 14, No. 2, 01.01.2013, p. 121-133.

Research output: Contribution to journalReview article

@article{e63b366a11454388aac04eeef7f4375f,
title = "Methodological Challenges Examining Subgroup Differences: Examples from Universal School-based Youth Violence Prevention Trials",
abstract = "This article reviews the literature on school-based universal violence prevention programs to illustrate key methodological challenges for investigating subgroup differences in prevention effects. The variety of potential moderating factors examined within this literature is discussed within the context of a social-ecological model. Our review of this literature identified the following methodological issues: the need for a clear a priori theoretical basis for selecting potential moderators, inflated Type I error rates that result from large numbers of comparisons, the absence of explicit tests of moderation, interpretive issues arising from a restricted range on moderator variables, the failure to report effect size estimates, the presence of potential confounding factors, and the importance of examining factors that might operate at multiple ecological levels. These points are illustrated using examples of studies, primarily within youth violence prevention research, that have identified factors within the individual, school, and community that moderate the outcomes of preventive interventions. We conclude with general recommendations for future work. These include the benefits of using the social-ecological model to provide a basis for moving from exploratory to more theory-driven confirmatory models of subgroup differences, the potential merits of qualitative research designed to identify factors that may influence the effectiveness of intervention efforts for specific subgroups of individuals, and the provision of effect size estimates and confidence intervals for effect sizes in prevention reports.",
keywords = "Moderation, Prevention, Subgroup analyses, Violence prevention",
author = "Farrell, {Albert D.} and Henry, {David B.} and Amie Bettencourt",
year = "2013",
month = "1",
day = "1",
doi = "10.1007/s11121-011-0200-2",
language = "English (US)",
volume = "14",
pages = "121--133",
journal = "Prevention Science",
issn = "1389-4986",
publisher = "Springer New York",
number = "2",

}

TY - JOUR

T1 - Methodological Challenges Examining Subgroup Differences

T2 - Examples from Universal School-based Youth Violence Prevention Trials

AU - Farrell, Albert D.

AU - Henry, David B.

AU - Bettencourt, Amie

PY - 2013/1/1

Y1 - 2013/1/1

N2 - This article reviews the literature on school-based universal violence prevention programs to illustrate key methodological challenges for investigating subgroup differences in prevention effects. The variety of potential moderating factors examined within this literature is discussed within the context of a social-ecological model. Our review of this literature identified the following methodological issues: the need for a clear a priori theoretical basis for selecting potential moderators, inflated Type I error rates that result from large numbers of comparisons, the absence of explicit tests of moderation, interpretive issues arising from a restricted range on moderator variables, the failure to report effect size estimates, the presence of potential confounding factors, and the importance of examining factors that might operate at multiple ecological levels. These points are illustrated using examples of studies, primarily within youth violence prevention research, that have identified factors within the individual, school, and community that moderate the outcomes of preventive interventions. We conclude with general recommendations for future work. These include the benefits of using the social-ecological model to provide a basis for moving from exploratory to more theory-driven confirmatory models of subgroup differences, the potential merits of qualitative research designed to identify factors that may influence the effectiveness of intervention efforts for specific subgroups of individuals, and the provision of effect size estimates and confidence intervals for effect sizes in prevention reports.

AB - This article reviews the literature on school-based universal violence prevention programs to illustrate key methodological challenges for investigating subgroup differences in prevention effects. The variety of potential moderating factors examined within this literature is discussed within the context of a social-ecological model. Our review of this literature identified the following methodological issues: the need for a clear a priori theoretical basis for selecting potential moderators, inflated Type I error rates that result from large numbers of comparisons, the absence of explicit tests of moderation, interpretive issues arising from a restricted range on moderator variables, the failure to report effect size estimates, the presence of potential confounding factors, and the importance of examining factors that might operate at multiple ecological levels. These points are illustrated using examples of studies, primarily within youth violence prevention research, that have identified factors within the individual, school, and community that moderate the outcomes of preventive interventions. We conclude with general recommendations for future work. These include the benefits of using the social-ecological model to provide a basis for moving from exploratory to more theory-driven confirmatory models of subgroup differences, the potential merits of qualitative research designed to identify factors that may influence the effectiveness of intervention efforts for specific subgroups of individuals, and the provision of effect size estimates and confidence intervals for effect sizes in prevention reports.

KW - Moderation

KW - Prevention

KW - Subgroup analyses

KW - Violence prevention

UR - http://www.scopus.com/inward/record.url?scp=84875580459&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84875580459&partnerID=8YFLogxK

U2 - 10.1007/s11121-011-0200-2

DO - 10.1007/s11121-011-0200-2

M3 - Review article

C2 - 21274627

AN - SCOPUS:84875580459

VL - 14

SP - 121

EP - 133

JO - Prevention Science

JF - Prevention Science

SN - 1389-4986

IS - 2

ER -