Estimating a composite measure of hospital quality from the hospital compare database: Differences when using a bayesian hierarchical latent variable model versus denominator-based weights

Michael Shwartz, Justin Ren, Erol A. Peköz, Xin Wang, Alan B. Cohen, Joseph D. Restuccia

Research output: Contribution to journalArticle

Abstract

BACKGROUND: A single composite measure calculated from individual quality indicators (QIs) is a useful measure of hospital performance and can be justified conceptually even when the indicators are not highly correlated with one another. OBJECTIVE: To compare 2 basic approaches for calculating a composite measure: an extension of the most widely-used approach, which weights individual indicators based on the number of people eligible for the indicator (referred to as denominator-based weights, DBWs), and a Bayesian hierarchical latent variable model (BLVM). METHODS: Using data for 15 QIs from 3275 hospitals in the Hospital Compare database, we calculated hospital ranks using several versions of DBWs and 2 BLVMs. Estimates in 1 BLVM were driven by differences in variances of the QIs (BLVM1) and estimates in the other by differences in the signal-to-noise ratios of the QIs (BLVM2). RESULTS: There was a high correlation in ranks among all of the DBW approaches and between those approaches and BLVM1. However, a high correlation does not necessarily mean that the same hospitals were ranked in the top or bottom quality deciles. In general, large hospitals were ranked in higher quality deciles by all of the approaches, though the effect was most apparent using BLVM2. CONCLUSIONS: Both conceptually and practically, hospital-specific DBWs are a reasonable approach for calculating a composite measure. However, this approach fails to take into account differences in the reliability of estimates from hospitals of different sizes, a big advantage of the Bayesian models.

Original languageEnglish (US)
Pages (from-to)778-785
Number of pages8
JournalMedical care
Volume46
Issue number8
DOIs
StatePublished - Aug 1 2008

Keywords

  • Bayesian inference
  • Quality measurement
  • Quality performance

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Fingerprint Dive into the research topics of 'Estimating a composite measure of hospital quality from the hospital compare database: Differences when using a bayesian hierarchical latent variable model versus denominator-based weights'. Together they form a unique fingerprint.

  • Cite this