Differential case ascertainment in clinical registry versus administrative data and impact on outcomes assessment for pediatric cardiac operations

Sara K. Pasquali, Eric D. Peterson, Jeffrey P. Jacobs, Xia He, Jennifer S. Li, Marshall L Jacobs, J. William Gaynor, Jennifer C. Hirsch, Samir S. Shah, John E. Mayer

Research output: Contribution to journalArticle

Abstract

Background: Administrative datasets are often used to assess outcomes and quality of pediatric cardiac programs; however their accuracy regarding case ascertainment is unclear. We linked patient data (2004-2010) from the Society of Thoracic Surgeons Congenital Heart Surgery (STS-CHS) Database (clinical registry) and the Pediatric Health Information Systems (PHIS) database (administrative database) from hospitals participating in both to evaluate differential coding/classification of operations between datasets and subsequent impact on outcomes assessment. Methods: Eight individual benchmark operations and the Risk Adjustment in Congenital Heart Surgery, version 1 (RACHS-1) categories were evaluated. The primary outcome was in-hospital mortality. Results: The cohort included 59,820 patients from 33 centers. There was a greater than 10% difference in the number of cases identified between data sources for half of the benchmark operations. The negative predictive value (NPV) of the administrative (versus clinical) data was high (98.8%-99.9%); the positive predictive value (PPV) was lower (56.7%-88.0%). Overall agreement between data sources in RACHS-1 category assignment was 68.4%. These differences translated into significant differences in outcomes assessment, ranging from an underestimation of mortality associated with truncus arteriosus repair by 25.7% in the administrative versus clinical data (7.01% versus 9.43%; p = 0.001) to an overestimation of mortality associated with ventricular septal defect (VSD) repair by 31.0% (0.78% versus 0.60%; p = 0.1). For the RACHS-1 categories, these ranged from an underestimation of category 5 mortality by 40.5% to an overestimation of category 2 mortality by 12.1%; these differences were not statistically significant. Conclusions: This study demonstrates differences in case ascertainment between administrative and clinical registry data for children undergoing cardiac operations, which translated into important differences in outcomes assessment.

Original languageEnglish (US)
Pages (from-to)197-203
Number of pages7
JournalAnnals of Thoracic Surgery
Volume95
Issue number1
DOIs
StatePublished - Jan 2013
Externally publishedYes

Fingerprint

Risk Adjustment
Thoracic Surgery
Registries
Outcome Assessment (Health Care)
Pediatrics
Benchmarking
Mortality
Information Storage and Retrieval
Databases
Truncus Arteriosus
Health Information Systems
Ventricular Heart Septal Defects
Hospital Mortality
Datasets

ASJC Scopus subject areas

  • Cardiology and Cardiovascular Medicine
  • Surgery
  • Pulmonary and Respiratory Medicine

Cite this

Differential case ascertainment in clinical registry versus administrative data and impact on outcomes assessment for pediatric cardiac operations. / Pasquali, Sara K.; Peterson, Eric D.; Jacobs, Jeffrey P.; He, Xia; Li, Jennifer S.; Jacobs, Marshall L; Gaynor, J. William; Hirsch, Jennifer C.; Shah, Samir S.; Mayer, John E.

In: Annals of Thoracic Surgery, Vol. 95, No. 1, 01.2013, p. 197-203.

Research output: Contribution to journalArticle

Pasquali, Sara K. ; Peterson, Eric D. ; Jacobs, Jeffrey P. ; He, Xia ; Li, Jennifer S. ; Jacobs, Marshall L ; Gaynor, J. William ; Hirsch, Jennifer C. ; Shah, Samir S. ; Mayer, John E. / Differential case ascertainment in clinical registry versus administrative data and impact on outcomes assessment for pediatric cardiac operations. In: Annals of Thoracic Surgery. 2013 ; Vol. 95, No. 1. pp. 197-203.
@article{9ba80344fb224fda80733a1e2cc9c8cb,
title = "Differential case ascertainment in clinical registry versus administrative data and impact on outcomes assessment for pediatric cardiac operations",
abstract = "Background: Administrative datasets are often used to assess outcomes and quality of pediatric cardiac programs; however their accuracy regarding case ascertainment is unclear. We linked patient data (2004-2010) from the Society of Thoracic Surgeons Congenital Heart Surgery (STS-CHS) Database (clinical registry) and the Pediatric Health Information Systems (PHIS) database (administrative database) from hospitals participating in both to evaluate differential coding/classification of operations between datasets and subsequent impact on outcomes assessment. Methods: Eight individual benchmark operations and the Risk Adjustment in Congenital Heart Surgery, version 1 (RACHS-1) categories were evaluated. The primary outcome was in-hospital mortality. Results: The cohort included 59,820 patients from 33 centers. There was a greater than 10{\%} difference in the number of cases identified between data sources for half of the benchmark operations. The negative predictive value (NPV) of the administrative (versus clinical) data was high (98.8{\%}-99.9{\%}); the positive predictive value (PPV) was lower (56.7{\%}-88.0{\%}). Overall agreement between data sources in RACHS-1 category assignment was 68.4{\%}. These differences translated into significant differences in outcomes assessment, ranging from an underestimation of mortality associated with truncus arteriosus repair by 25.7{\%} in the administrative versus clinical data (7.01{\%} versus 9.43{\%}; p = 0.001) to an overestimation of mortality associated with ventricular septal defect (VSD) repair by 31.0{\%} (0.78{\%} versus 0.60{\%}; p = 0.1). For the RACHS-1 categories, these ranged from an underestimation of category 5 mortality by 40.5{\%} to an overestimation of category 2 mortality by 12.1{\%}; these differences were not statistically significant. Conclusions: This study demonstrates differences in case ascertainment between administrative and clinical registry data for children undergoing cardiac operations, which translated into important differences in outcomes assessment.",
author = "Pasquali, {Sara K.} and Peterson, {Eric D.} and Jacobs, {Jeffrey P.} and Xia He and Li, {Jennifer S.} and Jacobs, {Marshall L} and Gaynor, {J. William} and Hirsch, {Jennifer C.} and Shah, {Samir S.} and Mayer, {John E.}",
year = "2013",
month = "1",
doi = "10.1016/j.athoracsur.2012.08.074",
language = "English (US)",
volume = "95",
pages = "197--203",
journal = "Annals of Thoracic Surgery",
issn = "0003-4975",
publisher = "Elsevier USA",
number = "1",

}

TY - JOUR

T1 - Differential case ascertainment in clinical registry versus administrative data and impact on outcomes assessment for pediatric cardiac operations

AU - Pasquali, Sara K.

AU - Peterson, Eric D.

AU - Jacobs, Jeffrey P.

AU - He, Xia

AU - Li, Jennifer S.

AU - Jacobs, Marshall L

AU - Gaynor, J. William

AU - Hirsch, Jennifer C.

AU - Shah, Samir S.

AU - Mayer, John E.

PY - 2013/1

Y1 - 2013/1

N2 - Background: Administrative datasets are often used to assess outcomes and quality of pediatric cardiac programs; however their accuracy regarding case ascertainment is unclear. We linked patient data (2004-2010) from the Society of Thoracic Surgeons Congenital Heart Surgery (STS-CHS) Database (clinical registry) and the Pediatric Health Information Systems (PHIS) database (administrative database) from hospitals participating in both to evaluate differential coding/classification of operations between datasets and subsequent impact on outcomes assessment. Methods: Eight individual benchmark operations and the Risk Adjustment in Congenital Heart Surgery, version 1 (RACHS-1) categories were evaluated. The primary outcome was in-hospital mortality. Results: The cohort included 59,820 patients from 33 centers. There was a greater than 10% difference in the number of cases identified between data sources for half of the benchmark operations. The negative predictive value (NPV) of the administrative (versus clinical) data was high (98.8%-99.9%); the positive predictive value (PPV) was lower (56.7%-88.0%). Overall agreement between data sources in RACHS-1 category assignment was 68.4%. These differences translated into significant differences in outcomes assessment, ranging from an underestimation of mortality associated with truncus arteriosus repair by 25.7% in the administrative versus clinical data (7.01% versus 9.43%; p = 0.001) to an overestimation of mortality associated with ventricular septal defect (VSD) repair by 31.0% (0.78% versus 0.60%; p = 0.1). For the RACHS-1 categories, these ranged from an underestimation of category 5 mortality by 40.5% to an overestimation of category 2 mortality by 12.1%; these differences were not statistically significant. Conclusions: This study demonstrates differences in case ascertainment between administrative and clinical registry data for children undergoing cardiac operations, which translated into important differences in outcomes assessment.

AB - Background: Administrative datasets are often used to assess outcomes and quality of pediatric cardiac programs; however their accuracy regarding case ascertainment is unclear. We linked patient data (2004-2010) from the Society of Thoracic Surgeons Congenital Heart Surgery (STS-CHS) Database (clinical registry) and the Pediatric Health Information Systems (PHIS) database (administrative database) from hospitals participating in both to evaluate differential coding/classification of operations between datasets and subsequent impact on outcomes assessment. Methods: Eight individual benchmark operations and the Risk Adjustment in Congenital Heart Surgery, version 1 (RACHS-1) categories were evaluated. The primary outcome was in-hospital mortality. Results: The cohort included 59,820 patients from 33 centers. There was a greater than 10% difference in the number of cases identified between data sources for half of the benchmark operations. The negative predictive value (NPV) of the administrative (versus clinical) data was high (98.8%-99.9%); the positive predictive value (PPV) was lower (56.7%-88.0%). Overall agreement between data sources in RACHS-1 category assignment was 68.4%. These differences translated into significant differences in outcomes assessment, ranging from an underestimation of mortality associated with truncus arteriosus repair by 25.7% in the administrative versus clinical data (7.01% versus 9.43%; p = 0.001) to an overestimation of mortality associated with ventricular septal defect (VSD) repair by 31.0% (0.78% versus 0.60%; p = 0.1). For the RACHS-1 categories, these ranged from an underestimation of category 5 mortality by 40.5% to an overestimation of category 2 mortality by 12.1%; these differences were not statistically significant. Conclusions: This study demonstrates differences in case ascertainment between administrative and clinical registry data for children undergoing cardiac operations, which translated into important differences in outcomes assessment.

UR - http://www.scopus.com/inward/record.url?scp=84871861782&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871861782&partnerID=8YFLogxK

U2 - 10.1016/j.athoracsur.2012.08.074

DO - 10.1016/j.athoracsur.2012.08.074

M3 - Article

C2 - 23141907

AN - SCOPUS:84871861782

VL - 95

SP - 197

EP - 203

JO - Annals of Thoracic Surgery

JF - Annals of Thoracic Surgery

SN - 0003-4975

IS - 1

ER -