TY - JOUR
T1 - Forecasting Emergency Department Crowding
T2 - An External, Multicenter Evaluation
AU - Hoot, Nathan R.
AU - Epstein, Stephen K.
AU - Allen, Todd L.
AU - Jones, Spencer S.
AU - Baumlin, Kevin M.
AU - Chawla, Neal
AU - Lee, Anna T.
AU - Pines, Jesse M.
AU - Klair, Amandeep K.
AU - Gordon, Bradley D.
AU - Flottemesch, Thomas J.
AU - LeBlanc, Larry J.
AU - Jones, Ian
AU - Levin, Scott R.
AU - Zhou, Chuan
AU - Gadd, Cynthia S.
AU - Aronsky, Dominik
N1 - Funding Information:
Funding and support: By Annals policy, all authors are required to disclose any and all commercial, financial, and other relationships in any way related to the subject of this article that might create any potential conflict of interest. See the Manuscript Submission Agreement in this issue for examples of specific conflicts covered by this statement. The first author was supported by National Library of Medicine grant LM07450 and National Institute of General Medical Studies grant T32 GM07347. The research was also supported by the National Library of Medicine grant R21 LM009002. This project is an academic endeavor. It was supported by federal funding, as noted above, and there was no corporate funding. There are no current plans to commercialize this research that would cause any conflicts of interest.
PY - 2009/10
Y1 - 2009/10
N2 - Study objective: We apply a previously described tool to forecast emergency department (ED) crowding at multiple institutions and assess its generalizability for predicting the near-future waiting count, occupancy level, and boarding count. Methods: The ForecastED tool was validated with historical data from 5 institutions external to the development site. A sliding-window design separated the data for parameter estimation and forecast validation. Observations were sampled at consecutive 10-minute intervals during 12 months (n=52,560) at 4 sites and 10 months (n=44,064) at the fifth. Three outcome measures-the waiting count, occupancy level, and boarding count-were forecast 2, 4, 6, and 8 hours beyond each observation, and forecasts were compared with observed data at corresponding times. The reliability and calibration were measured following previously described methods. After linear calibration, the forecasting accuracy was measured with the median absolute error. Results: The tool was successfully used for 5 different sites. Its forecasts were more reliable, better calibrated, and more accurate at 2 hours than at 8 hours. The reliability and calibration of the tool were similar between the original development site and external sites; the boarding count was an exception, which was less reliable at 4 of 5 sites. Some variability in accuracy existed among institutions; when forecasting 4 hours into the future, the median absolute error of the waiting count ranged between 0.6 and 3.1 patients, the median absolute error of the occupancy level ranged between 9.0% and 14.5% of beds, and the median absolute error of the boarding count ranged between 0.9 and 2.8 patients. Conclusion: The ForecastED tool generated potentially useful forecasts of input and throughput measures of ED crowding at 5 external sites, without modifying the underlying assumptions. Noting the limitation that this was not a real-time validation, ongoing research will focus on integrating the tool with ED information systems.
AB - Study objective: We apply a previously described tool to forecast emergency department (ED) crowding at multiple institutions and assess its generalizability for predicting the near-future waiting count, occupancy level, and boarding count. Methods: The ForecastED tool was validated with historical data from 5 institutions external to the development site. A sliding-window design separated the data for parameter estimation and forecast validation. Observations were sampled at consecutive 10-minute intervals during 12 months (n=52,560) at 4 sites and 10 months (n=44,064) at the fifth. Three outcome measures-the waiting count, occupancy level, and boarding count-were forecast 2, 4, 6, and 8 hours beyond each observation, and forecasts were compared with observed data at corresponding times. The reliability and calibration were measured following previously described methods. After linear calibration, the forecasting accuracy was measured with the median absolute error. Results: The tool was successfully used for 5 different sites. Its forecasts were more reliable, better calibrated, and more accurate at 2 hours than at 8 hours. The reliability and calibration of the tool were similar between the original development site and external sites; the boarding count was an exception, which was less reliable at 4 of 5 sites. Some variability in accuracy existed among institutions; when forecasting 4 hours into the future, the median absolute error of the waiting count ranged between 0.6 and 3.1 patients, the median absolute error of the occupancy level ranged between 9.0% and 14.5% of beds, and the median absolute error of the boarding count ranged between 0.9 and 2.8 patients. Conclusion: The ForecastED tool generated potentially useful forecasts of input and throughput measures of ED crowding at 5 external sites, without modifying the underlying assumptions. Noting the limitation that this was not a real-time validation, ongoing research will focus on integrating the tool with ED information systems.
UR - http://www.scopus.com/inward/record.url?scp=70349159073&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=70349159073&partnerID=8YFLogxK
U2 - 10.1016/j.annemergmed.2009.06.006
DO - 10.1016/j.annemergmed.2009.06.006
M3 - Article
C2 - 19716629
AN - SCOPUS:70349159073
VL - 54
SP - 514-522.e19
JO - Journal of the American College of Emergency Physicians
JF - Journal of the American College of Emergency Physicians
SN - 0196-0644
IS - 4
ER -