Performance of the global assessment of pediatric patient safety (GAPPS) Tool

Christopher P. Landrigan, David Stockwell, Sara L. Toomey, Samuel Loren, Michaela Tracy, Jisun Jang, Jessica A. Quinn, Sepideh Ashrafzadeh, Michelle Wang, Paul J. Sharek, Gareth Parry, Mark A. Schuster

Research output: Contribution to journalArticle

Abstract

BACKGROUND AND OBJECTIVE: Efforts to advance patient safety have been hampered by the lack of high quality measures of adverse events (AEs). This study's objective was to develop and test the Global Assessment of Pediatric Patient Safety (GAPPS) trigger tool, which measures hospital-wide rates of AEs and preventable AEs. METHODS: Through a literature review and expert panel process, we developed a draft trigger tool. Tool performance was tested in 16 academic and community hospitals across the United States. At each site, a primary reviewer (nurse) reviewed ∼240 randomly selected medical records; 10% of records underwent an additional primary review. Suspected AEs were subsequently evaluated by 2 secondary reviewers (physicians). Ten percent of records were also reviewed by external expert reviewers. Each trigger's incidence and positivity rates were assessed to refine GAPPS. RESULTS: In total, 3814 medical records were reviewed. Primary reviewers agreed 92% of the time on presence or absence of a suspected AE (κ = 0.69). Secondary reviewers verifying AE presence or absence agreed 92% of the time (κ = 0.81). Using expert reviews as a standard for comparison, hospital-based primary reviewers had a sensitivity and specificity of 40% and 91%, respectively. As primary reviewers gained experience, their agreement with expert reviewers improved significantly. After removing low-yield triggers, 27 and 30 (of 54) triggers met inclusion criteria to form final manual and automated trigger lists, respectively. CONCLUSIONS: GAPPS reliably identifies AEs and can be used to guide and monitor quality improvement efforts. Ongoing refinement may facilitate future interhospital comparisons.

Original languageEnglish (US)
Article numbere20154076
JournalPediatrics
Volume137
Issue number6
DOIs
StatePublished - Jun 1 2016
Externally publishedYes

Fingerprint

Patient Safety
Pediatrics
Medical Records
Community Hospital
Quality Improvement
Nurses
Physicians
Sensitivity and Specificity
Incidence

ASJC Scopus subject areas

  • Pediatrics, Perinatology, and Child Health

Cite this

Landrigan, C. P., Stockwell, D., Toomey, S. L., Loren, S., Tracy, M., Jang, J., ... Schuster, M. A. (2016). Performance of the global assessment of pediatric patient safety (GAPPS) Tool. Pediatrics, 137(6), [e20154076]. https://doi.org/10.1542/peds.2015-4076

Performance of the global assessment of pediatric patient safety (GAPPS) Tool. / Landrigan, Christopher P.; Stockwell, David; Toomey, Sara L.; Loren, Samuel; Tracy, Michaela; Jang, Jisun; Quinn, Jessica A.; Ashrafzadeh, Sepideh; Wang, Michelle; Sharek, Paul J.; Parry, Gareth; Schuster, Mark A.

In: Pediatrics, Vol. 137, No. 6, e20154076, 01.06.2016.

Research output: Contribution to journalArticle

Landrigan, CP, Stockwell, D, Toomey, SL, Loren, S, Tracy, M, Jang, J, Quinn, JA, Ashrafzadeh, S, Wang, M, Sharek, PJ, Parry, G & Schuster, MA 2016, 'Performance of the global assessment of pediatric patient safety (GAPPS) Tool', Pediatrics, vol. 137, no. 6, e20154076. https://doi.org/10.1542/peds.2015-4076
Landrigan, Christopher P. ; Stockwell, David ; Toomey, Sara L. ; Loren, Samuel ; Tracy, Michaela ; Jang, Jisun ; Quinn, Jessica A. ; Ashrafzadeh, Sepideh ; Wang, Michelle ; Sharek, Paul J. ; Parry, Gareth ; Schuster, Mark A. / Performance of the global assessment of pediatric patient safety (GAPPS) Tool. In: Pediatrics. 2016 ; Vol. 137, No. 6.
@article{fb546b9906114389935959c1e227bcb9,
title = "Performance of the global assessment of pediatric patient safety (GAPPS) Tool",
abstract = "BACKGROUND AND OBJECTIVE: Efforts to advance patient safety have been hampered by the lack of high quality measures of adverse events (AEs). This study's objective was to develop and test the Global Assessment of Pediatric Patient Safety (GAPPS) trigger tool, which measures hospital-wide rates of AEs and preventable AEs. METHODS: Through a literature review and expert panel process, we developed a draft trigger tool. Tool performance was tested in 16 academic and community hospitals across the United States. At each site, a primary reviewer (nurse) reviewed ∼240 randomly selected medical records; 10{\%} of records underwent an additional primary review. Suspected AEs were subsequently evaluated by 2 secondary reviewers (physicians). Ten percent of records were also reviewed by external expert reviewers. Each trigger's incidence and positivity rates were assessed to refine GAPPS. RESULTS: In total, 3814 medical records were reviewed. Primary reviewers agreed 92{\%} of the time on presence or absence of a suspected AE (κ = 0.69). Secondary reviewers verifying AE presence or absence agreed 92{\%} of the time (κ = 0.81). Using expert reviews as a standard for comparison, hospital-based primary reviewers had a sensitivity and specificity of 40{\%} and 91{\%}, respectively. As primary reviewers gained experience, their agreement with expert reviewers improved significantly. After removing low-yield triggers, 27 and 30 (of 54) triggers met inclusion criteria to form final manual and automated trigger lists, respectively. CONCLUSIONS: GAPPS reliably identifies AEs and can be used to guide and monitor quality improvement efforts. Ongoing refinement may facilitate future interhospital comparisons.",
author = "Landrigan, {Christopher P.} and David Stockwell and Toomey, {Sara L.} and Samuel Loren and Michaela Tracy and Jisun Jang and Quinn, {Jessica A.} and Sepideh Ashrafzadeh and Michelle Wang and Sharek, {Paul J.} and Gareth Parry and Schuster, {Mark A.}",
year = "2016",
month = "6",
day = "1",
doi = "10.1542/peds.2015-4076",
language = "English (US)",
volume = "137",
journal = "Pediatrics",
issn = "0031-4005",
publisher = "American Academy of Pediatrics",
number = "6",

}

TY - JOUR

T1 - Performance of the global assessment of pediatric patient safety (GAPPS) Tool

AU - Landrigan, Christopher P.

AU - Stockwell, David

AU - Toomey, Sara L.

AU - Loren, Samuel

AU - Tracy, Michaela

AU - Jang, Jisun

AU - Quinn, Jessica A.

AU - Ashrafzadeh, Sepideh

AU - Wang, Michelle

AU - Sharek, Paul J.

AU - Parry, Gareth

AU - Schuster, Mark A.

PY - 2016/6/1

Y1 - 2016/6/1

N2 - BACKGROUND AND OBJECTIVE: Efforts to advance patient safety have been hampered by the lack of high quality measures of adverse events (AEs). This study's objective was to develop and test the Global Assessment of Pediatric Patient Safety (GAPPS) trigger tool, which measures hospital-wide rates of AEs and preventable AEs. METHODS: Through a literature review and expert panel process, we developed a draft trigger tool. Tool performance was tested in 16 academic and community hospitals across the United States. At each site, a primary reviewer (nurse) reviewed ∼240 randomly selected medical records; 10% of records underwent an additional primary review. Suspected AEs were subsequently evaluated by 2 secondary reviewers (physicians). Ten percent of records were also reviewed by external expert reviewers. Each trigger's incidence and positivity rates were assessed to refine GAPPS. RESULTS: In total, 3814 medical records were reviewed. Primary reviewers agreed 92% of the time on presence or absence of a suspected AE (κ = 0.69). Secondary reviewers verifying AE presence or absence agreed 92% of the time (κ = 0.81). Using expert reviews as a standard for comparison, hospital-based primary reviewers had a sensitivity and specificity of 40% and 91%, respectively. As primary reviewers gained experience, their agreement with expert reviewers improved significantly. After removing low-yield triggers, 27 and 30 (of 54) triggers met inclusion criteria to form final manual and automated trigger lists, respectively. CONCLUSIONS: GAPPS reliably identifies AEs and can be used to guide and monitor quality improvement efforts. Ongoing refinement may facilitate future interhospital comparisons.

AB - BACKGROUND AND OBJECTIVE: Efforts to advance patient safety have been hampered by the lack of high quality measures of adverse events (AEs). This study's objective was to develop and test the Global Assessment of Pediatric Patient Safety (GAPPS) trigger tool, which measures hospital-wide rates of AEs and preventable AEs. METHODS: Through a literature review and expert panel process, we developed a draft trigger tool. Tool performance was tested in 16 academic and community hospitals across the United States. At each site, a primary reviewer (nurse) reviewed ∼240 randomly selected medical records; 10% of records underwent an additional primary review. Suspected AEs were subsequently evaluated by 2 secondary reviewers (physicians). Ten percent of records were also reviewed by external expert reviewers. Each trigger's incidence and positivity rates were assessed to refine GAPPS. RESULTS: In total, 3814 medical records were reviewed. Primary reviewers agreed 92% of the time on presence or absence of a suspected AE (κ = 0.69). Secondary reviewers verifying AE presence or absence agreed 92% of the time (κ = 0.81). Using expert reviews as a standard for comparison, hospital-based primary reviewers had a sensitivity and specificity of 40% and 91%, respectively. As primary reviewers gained experience, their agreement with expert reviewers improved significantly. After removing low-yield triggers, 27 and 30 (of 54) triggers met inclusion criteria to form final manual and automated trigger lists, respectively. CONCLUSIONS: GAPPS reliably identifies AEs and can be used to guide and monitor quality improvement efforts. Ongoing refinement may facilitate future interhospital comparisons.

UR - http://www.scopus.com/inward/record.url?scp=84971537147&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84971537147&partnerID=8YFLogxK

U2 - 10.1542/peds.2015-4076

DO - 10.1542/peds.2015-4076

M3 - Article

C2 - 27221286

AN - SCOPUS:84971537147

VL - 137

JO - Pediatrics

JF - Pediatrics

SN - 0031-4005

IS - 6

M1 - e20154076

ER -