Percentile-based empirical distribution function estimates for performance evaluation of healthcare providers

Susan M. Paddock, Thomas A. Louis

Research output: Contribution to journalArticle

Abstract

Hierarchical models are widely used to characterize the performance of individual healthcare providers. However, little attention has been devoted to systemwide performance evaluations, the goals of which include identifying extreme (e.g. the top 10%) provider performance and developing statistical benchmarks to define high quality care. Obtaining optimal estimates of these quantities requires estimating the empirical distribution function (EDF) of provider-specific parameters that generate the data set under consideration. However, the difficulty of obtaining uncertainty bounds for a squared error loss minimizing EDF estimate has hindered its use in systemwide performance evaluations. We therefore develop and study a percentile-based EDF estimate for univariate provider-specific parameters. We compute order statistics of samples drawn from the posterior distribution of provider-specific parameters to obtain relevant assessments of uncertainty of an EDF estimate and its features, such as thresholds and percentiles. We apply our method to data from the Medicare end stage renal disease programme, which is a health insurance programme for people with irreversible kidney failure. We highlight the risk of misclassifying providers as exceptionally good or poor performers when uncertainty in statistical benchmark estimates is ignored. Given the high stakes of performance evaluations, statistical benchmarks should be accompanied by precision estimates.

Original languageEnglish (US)
Pages (from-to)575-589
Number of pages15
JournalJournal of the Royal Statistical Society. Series C: Applied Statistics
Volume60
Issue number4
DOIs
StatePublished - Aug 1 2011

Keywords

  • Bayesian methods
  • Empirical distribution function
  • Ensemble
  • Hierarchical model
  • Statistical benchmark

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint Dive into the research topics of 'Percentile-based empirical distribution function estimates for performance evaluation of healthcare providers'. Together they form a unique fingerprint.

  • Cite this