Validity and usefulness of members reports of implementation progress in a quality improvement initiative: Findings from the Team Check-up Tool (TCT)

Research output: Contribution to journalArticle

Abstract

Background: Team-based interventions are effective for improving safety and quality of healthcare. However, contextual factors, such as team functioning, leadership, and organizational support, can vary significantly across teams and affect the level of implementation success. Yet, the science for measuring context is immature. The goal of this study is to validate measures from a short instrument tailored to track dynamic context and progress for a team-based quality improvement (QI) intervention.Methods: Design: Secondary cross-sectional and longitudinal analysis of data from a clustered randomized controlled trial (RCT) of a team-based quality improvement intervention to reduce central line-associated bloodstream infection (CLABSI) rates in intensive care units (ICUs).Setting: Forty-six ICUs located within 35 faith-based, not-for-profit community hospitals across 12 states in the U.S.Population: Team members participating in an ICU-based QI intervention.Measures: The primary measure is the Team Check-up Tool (TCT), an original instrument that assesses context and progress of a team-based QI intervention. The TCT is administered monthly. Validation measures include CLABSI rate, Team Functioning Survey (TFS) and Practice Environment Scale (PES) from the Nursing Work Index.Analysis: Temporal stability, responsiveness and validity of the TCT.Results: We found evidence supporting the temporal stability, construct validity, and responsiveness of TCT measures of intervention activities, perceived group-level behaviors, and barriers to team progress.Conclusions: The TCT demonstrates good measurement reliability, validity, and responsiveness. By having more validated measures on implementation context, researchers can more readily conduct rigorous studies to identify contextual variables linked to key intervention and patient outcomes and strengthen the evidence base on successful spread of efficacious team-based interventions. QI teams participating in an intervention should also find data from a validated tool useful for identifying opportunities to improve their own implementation.

Original languageEnglish (US)
Article number115
JournalImplementation Science
Volume6
Issue number1
DOIs
StatePublished - Oct 3 2011

Fingerprint

Quality Improvement
Intensive Care Units
Quality of Health Care
Community Hospital
Infection
Reproducibility of Results
Nursing
Randomized Controlled Trials
Cross-Sectional Studies
Research Personnel
Safety
Population

ASJC Scopus subject areas

  • Health Policy
  • Medicine(all)
  • Public Health, Environmental and Occupational Health
  • Health Informatics

Cite this

@article{dd156c423b094e15a75820731e7753e9,
title = "Validity and usefulness of members reports of implementation progress in a quality improvement initiative: Findings from the Team Check-up Tool (TCT)",
abstract = "Background: Team-based interventions are effective for improving safety and quality of healthcare. However, contextual factors, such as team functioning, leadership, and organizational support, can vary significantly across teams and affect the level of implementation success. Yet, the science for measuring context is immature. The goal of this study is to validate measures from a short instrument tailored to track dynamic context and progress for a team-based quality improvement (QI) intervention.Methods: Design: Secondary cross-sectional and longitudinal analysis of data from a clustered randomized controlled trial (RCT) of a team-based quality improvement intervention to reduce central line-associated bloodstream infection (CLABSI) rates in intensive care units (ICUs).Setting: Forty-six ICUs located within 35 faith-based, not-for-profit community hospitals across 12 states in the U.S.Population: Team members participating in an ICU-based QI intervention.Measures: The primary measure is the Team Check-up Tool (TCT), an original instrument that assesses context and progress of a team-based QI intervention. The TCT is administered monthly. Validation measures include CLABSI rate, Team Functioning Survey (TFS) and Practice Environment Scale (PES) from the Nursing Work Index.Analysis: Temporal stability, responsiveness and validity of the TCT.Results: We found evidence supporting the temporal stability, construct validity, and responsiveness of TCT measures of intervention activities, perceived group-level behaviors, and barriers to team progress.Conclusions: The TCT demonstrates good measurement reliability, validity, and responsiveness. By having more validated measures on implementation context, researchers can more readily conduct rigorous studies to identify contextual variables linked to key intervention and patient outcomes and strengthen the evidence base on successful spread of efficacious team-based interventions. QI teams participating in an intervention should also find data from a validated tool useful for identifying opportunities to improve their own implementation.",
author = "Chan, {Kitty S.} and Yea-Jen Hsu and Lisa Lubomski and Marsteller, {Jill A}",
year = "2011",
month = "10",
day = "3",
doi = "10.1186/1748-5908-6-115",
language = "English (US)",
volume = "6",
journal = "Implementation Science",
issn = "1748-5908",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - Validity and usefulness of members reports of implementation progress in a quality improvement initiative

T2 - Findings from the Team Check-up Tool (TCT)

AU - Chan, Kitty S.

AU - Hsu, Yea-Jen

AU - Lubomski, Lisa

AU - Marsteller, Jill A

PY - 2011/10/3

Y1 - 2011/10/3

N2 - Background: Team-based interventions are effective for improving safety and quality of healthcare. However, contextual factors, such as team functioning, leadership, and organizational support, can vary significantly across teams and affect the level of implementation success. Yet, the science for measuring context is immature. The goal of this study is to validate measures from a short instrument tailored to track dynamic context and progress for a team-based quality improvement (QI) intervention.Methods: Design: Secondary cross-sectional and longitudinal analysis of data from a clustered randomized controlled trial (RCT) of a team-based quality improvement intervention to reduce central line-associated bloodstream infection (CLABSI) rates in intensive care units (ICUs).Setting: Forty-six ICUs located within 35 faith-based, not-for-profit community hospitals across 12 states in the U.S.Population: Team members participating in an ICU-based QI intervention.Measures: The primary measure is the Team Check-up Tool (TCT), an original instrument that assesses context and progress of a team-based QI intervention. The TCT is administered monthly. Validation measures include CLABSI rate, Team Functioning Survey (TFS) and Practice Environment Scale (PES) from the Nursing Work Index.Analysis: Temporal stability, responsiveness and validity of the TCT.Results: We found evidence supporting the temporal stability, construct validity, and responsiveness of TCT measures of intervention activities, perceived group-level behaviors, and barriers to team progress.Conclusions: The TCT demonstrates good measurement reliability, validity, and responsiveness. By having more validated measures on implementation context, researchers can more readily conduct rigorous studies to identify contextual variables linked to key intervention and patient outcomes and strengthen the evidence base on successful spread of efficacious team-based interventions. QI teams participating in an intervention should also find data from a validated tool useful for identifying opportunities to improve their own implementation.

AB - Background: Team-based interventions are effective for improving safety and quality of healthcare. However, contextual factors, such as team functioning, leadership, and organizational support, can vary significantly across teams and affect the level of implementation success. Yet, the science for measuring context is immature. The goal of this study is to validate measures from a short instrument tailored to track dynamic context and progress for a team-based quality improvement (QI) intervention.Methods: Design: Secondary cross-sectional and longitudinal analysis of data from a clustered randomized controlled trial (RCT) of a team-based quality improvement intervention to reduce central line-associated bloodstream infection (CLABSI) rates in intensive care units (ICUs).Setting: Forty-six ICUs located within 35 faith-based, not-for-profit community hospitals across 12 states in the U.S.Population: Team members participating in an ICU-based QI intervention.Measures: The primary measure is the Team Check-up Tool (TCT), an original instrument that assesses context and progress of a team-based QI intervention. The TCT is administered monthly. Validation measures include CLABSI rate, Team Functioning Survey (TFS) and Practice Environment Scale (PES) from the Nursing Work Index.Analysis: Temporal stability, responsiveness and validity of the TCT.Results: We found evidence supporting the temporal stability, construct validity, and responsiveness of TCT measures of intervention activities, perceived group-level behaviors, and barriers to team progress.Conclusions: The TCT demonstrates good measurement reliability, validity, and responsiveness. By having more validated measures on implementation context, researchers can more readily conduct rigorous studies to identify contextual variables linked to key intervention and patient outcomes and strengthen the evidence base on successful spread of efficacious team-based interventions. QI teams participating in an intervention should also find data from a validated tool useful for identifying opportunities to improve their own implementation.

UR - http://www.scopus.com/inward/record.url?scp=80053458523&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80053458523&partnerID=8YFLogxK

U2 - 10.1186/1748-5908-6-115

DO - 10.1186/1748-5908-6-115

M3 - Article

C2 - 21967862

AN - SCOPUS:80053458523

VL - 6

JO - Implementation Science

JF - Implementation Science

SN - 1748-5908

IS - 1

M1 - 115

ER -