Forecasting Emergency Department Crowding

A Discrete Event Simulation

Nathan R. Hoot, Larry J. LeBlanc, Ian Jones, Scott Levin, Chuan Zhou, Cynthia S. Gadd, Dominik Aronsky

Research output: Contribution to journalArticle

Abstract

Study objective: To develop a discrete event simulation of emergency department (ED) patient flow for the purpose of forecasting near-future operating conditions and to validate the forecasts with several measures of ED crowding. Methods: We developed a discrete event simulation of patient flow with evidence from the literature. Development was purely theoretical, whereas validation involved patient data from an academic ED. The model inputs and outputs, respectively, are 6-variable descriptions of every present and future patient in the ED. We validated the model by using a sliding-window design, ensuring separation of fitting and validation data in time series. We sampled consecutive 10-minute observations during 2006 (n=52,560). The outcome measures-all forecast 2, 4, 6, and 8 hours into the future from each observation-were the waiting count, waiting time, occupancy level, length of stay, boarding count, boarding time, and ambulance diversion. Forecasting performance was assessed with Pearson's correlation, residual summary statistics, and area under the receiver operating characteristic curve. Results: The correlations between crowding forecasts and actual outcomes started high and decreased gradually up to 8 hours into the future (lowest Pearson's r for waiting count=0.56; waiting time=0.49; occupancy level=0.78; length of stay=0.86; boarding count=0.79; boarding time=0.80). The residual means were unbiased for all outcomes except the boarding time. The discriminatory power for ambulance diversion remained consistently high up to 8 hours into the future (lowest area under the receiver operating characteristic curve=0.86). Conclusion: By modeling patient flow, rather than operational summary variables, our simulation forecasts several measures of near-future ED crowding, with various degrees of good performance.

Original languageEnglish (US)
Pages (from-to)116-125
Number of pages10
JournalAnnals of Emergency Medicine
Volume52
Issue number2
DOIs
StatePublished - Aug 2008
Externally publishedYes

Fingerprint

Hospital Emergency Service
Ambulance Diversion
ROC Curve
Length of Stay
Patient Simulation
Observation
Outcome Assessment (Health Care)

ASJC Scopus subject areas

  • Emergency Medicine

Cite this

Forecasting Emergency Department Crowding : A Discrete Event Simulation. / Hoot, Nathan R.; LeBlanc, Larry J.; Jones, Ian; Levin, Scott; Zhou, Chuan; Gadd, Cynthia S.; Aronsky, Dominik.

In: Annals of Emergency Medicine, Vol. 52, No. 2, 08.2008, p. 116-125.

Research output: Contribution to journalArticle

Hoot, NR, LeBlanc, LJ, Jones, I, Levin, S, Zhou, C, Gadd, CS & Aronsky, D 2008, 'Forecasting Emergency Department Crowding: A Discrete Event Simulation', Annals of Emergency Medicine, vol. 52, no. 2, pp. 116-125. https://doi.org/10.1016/j.annemergmed.2007.12.011
Hoot, Nathan R. ; LeBlanc, Larry J. ; Jones, Ian ; Levin, Scott ; Zhou, Chuan ; Gadd, Cynthia S. ; Aronsky, Dominik. / Forecasting Emergency Department Crowding : A Discrete Event Simulation. In: Annals of Emergency Medicine. 2008 ; Vol. 52, No. 2. pp. 116-125.
@article{d9a9726adee3422e8a2d943542bc4a67,
title = "Forecasting Emergency Department Crowding: A Discrete Event Simulation",
abstract = "Study objective: To develop a discrete event simulation of emergency department (ED) patient flow for the purpose of forecasting near-future operating conditions and to validate the forecasts with several measures of ED crowding. Methods: We developed a discrete event simulation of patient flow with evidence from the literature. Development was purely theoretical, whereas validation involved patient data from an academic ED. The model inputs and outputs, respectively, are 6-variable descriptions of every present and future patient in the ED. We validated the model by using a sliding-window design, ensuring separation of fitting and validation data in time series. We sampled consecutive 10-minute observations during 2006 (n=52,560). The outcome measures-all forecast 2, 4, 6, and 8 hours into the future from each observation-were the waiting count, waiting time, occupancy level, length of stay, boarding count, boarding time, and ambulance diversion. Forecasting performance was assessed with Pearson's correlation, residual summary statistics, and area under the receiver operating characteristic curve. Results: The correlations between crowding forecasts and actual outcomes started high and decreased gradually up to 8 hours into the future (lowest Pearson's r for waiting count=0.56; waiting time=0.49; occupancy level=0.78; length of stay=0.86; boarding count=0.79; boarding time=0.80). The residual means were unbiased for all outcomes except the boarding time. The discriminatory power for ambulance diversion remained consistently high up to 8 hours into the future (lowest area under the receiver operating characteristic curve=0.86). Conclusion: By modeling patient flow, rather than operational summary variables, our simulation forecasts several measures of near-future ED crowding, with various degrees of good performance.",
author = "Hoot, {Nathan R.} and LeBlanc, {Larry J.} and Ian Jones and Scott Levin and Chuan Zhou and Gadd, {Cynthia S.} and Dominik Aronsky",
year = "2008",
month = "8",
doi = "10.1016/j.annemergmed.2007.12.011",
language = "English (US)",
volume = "52",
pages = "116--125",
journal = "Annals of Emergency Medicine",
issn = "0196-0644",
publisher = "Mosby Inc.",
number = "2",

}

TY - JOUR

T1 - Forecasting Emergency Department Crowding

T2 - A Discrete Event Simulation

AU - Hoot, Nathan R.

AU - LeBlanc, Larry J.

AU - Jones, Ian

AU - Levin, Scott

AU - Zhou, Chuan

AU - Gadd, Cynthia S.

AU - Aronsky, Dominik

PY - 2008/8

Y1 - 2008/8

N2 - Study objective: To develop a discrete event simulation of emergency department (ED) patient flow for the purpose of forecasting near-future operating conditions and to validate the forecasts with several measures of ED crowding. Methods: We developed a discrete event simulation of patient flow with evidence from the literature. Development was purely theoretical, whereas validation involved patient data from an academic ED. The model inputs and outputs, respectively, are 6-variable descriptions of every present and future patient in the ED. We validated the model by using a sliding-window design, ensuring separation of fitting and validation data in time series. We sampled consecutive 10-minute observations during 2006 (n=52,560). The outcome measures-all forecast 2, 4, 6, and 8 hours into the future from each observation-were the waiting count, waiting time, occupancy level, length of stay, boarding count, boarding time, and ambulance diversion. Forecasting performance was assessed with Pearson's correlation, residual summary statistics, and area under the receiver operating characteristic curve. Results: The correlations between crowding forecasts and actual outcomes started high and decreased gradually up to 8 hours into the future (lowest Pearson's r for waiting count=0.56; waiting time=0.49; occupancy level=0.78; length of stay=0.86; boarding count=0.79; boarding time=0.80). The residual means were unbiased for all outcomes except the boarding time. The discriminatory power for ambulance diversion remained consistently high up to 8 hours into the future (lowest area under the receiver operating characteristic curve=0.86). Conclusion: By modeling patient flow, rather than operational summary variables, our simulation forecasts several measures of near-future ED crowding, with various degrees of good performance.

AB - Study objective: To develop a discrete event simulation of emergency department (ED) patient flow for the purpose of forecasting near-future operating conditions and to validate the forecasts with several measures of ED crowding. Methods: We developed a discrete event simulation of patient flow with evidence from the literature. Development was purely theoretical, whereas validation involved patient data from an academic ED. The model inputs and outputs, respectively, are 6-variable descriptions of every present and future patient in the ED. We validated the model by using a sliding-window design, ensuring separation of fitting and validation data in time series. We sampled consecutive 10-minute observations during 2006 (n=52,560). The outcome measures-all forecast 2, 4, 6, and 8 hours into the future from each observation-were the waiting count, waiting time, occupancy level, length of stay, boarding count, boarding time, and ambulance diversion. Forecasting performance was assessed with Pearson's correlation, residual summary statistics, and area under the receiver operating characteristic curve. Results: The correlations between crowding forecasts and actual outcomes started high and decreased gradually up to 8 hours into the future (lowest Pearson's r for waiting count=0.56; waiting time=0.49; occupancy level=0.78; length of stay=0.86; boarding count=0.79; boarding time=0.80). The residual means were unbiased for all outcomes except the boarding time. The discriminatory power for ambulance diversion remained consistently high up to 8 hours into the future (lowest area under the receiver operating characteristic curve=0.86). Conclusion: By modeling patient flow, rather than operational summary variables, our simulation forecasts several measures of near-future ED crowding, with various degrees of good performance.

UR - http://www.scopus.com/inward/record.url?scp=48949116379&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=48949116379&partnerID=8YFLogxK

U2 - 10.1016/j.annemergmed.2007.12.011

DO - 10.1016/j.annemergmed.2007.12.011

M3 - Article

VL - 52

SP - 116

EP - 125

JO - Annals of Emergency Medicine

JF - Annals of Emergency Medicine

SN - 0196-0644

IS - 2

ER -