Optimization of drug-drug interaction alert rules in a pediatric hospital's electronic health record system using a visual analytics dashboard

Allan F. Simpao, Luis M. Ahumada, Bimal R. Desai, Christopher P. Bonafide, Jorge A. Gávez, Mohamed Rehman, Abbas F. Jawad, Krisha L. Palma, Eric D. Shelov

Research output: Contribution to journalArticle

Abstract

Objective To develop and evaluate an electronic dashboard of hospital-wide electronic health record medication alerts for an alert fatigue reduction quality improvement project. Methods We used visual analytics software to develop the dashboard. We collaborated with the hospital-wide Clinical Decision Support committee to perform three interventions successively deactivating clinically irrelevant drug-drug interaction (DDI) alert rules. We analyzed the impact of the interventions on care providers' and pharmacists' alert and override rates using an interrupted time series framework with piecewise regression. Results We evaluated 2 391 880 medication alerts between January 31, 2011 and January 26, 2014. For pharmacists, the median alert rate prior to the first DDI deactivation was 58.74 alerts/100 orders (IQR 54.98-60.48) and 25.11 alerts/ 100 orders (IQR 23.45-26.57) following the three interventions (p < 0.001). For providers, baseline median alert rate prior to the first round of DDI deactivation was 19.73 alerts/100 orders (IQR 18.66-20.24) and 15.11 alerts/100 orders (IQR 14.44-15.49) following the three interventions (p < 0.001). In a subgroup analysis, we observed a decrease in pharmacists' override rates for DDI alerts that were not modified in the system from a median of 93.06 overrides/100 alerts (IQR 91.96-94.33) to 85.68 overrides/100 alerts (IQR 84.29-87.15, p < 0.001). The medication serious safety event rate decreased during the study period, and there were no serious safety events reported in association with the deactivated alert rules. Conclusions An alert dashboard facilitated safe rapid-cycle reductions in alert burden that were temporally associated with lower pharmacist override rates in a subgroup of DDIs not directly affected by the interventions; meanwhile, the pharmacists' frequency of selecting the 'cancel' option increased. We hypothesize that reducing the alert burden enabled pharmacists to devote more attention to clinically relevant alerts.

Original languageEnglish (US)
Pages (from-to)361-369
Number of pages9
JournalJournal of the American Medical Informatics Association
Volume22
Issue number2
DOIs
StatePublished - Jan 1 2015
Externally publishedYes

Fingerprint

Pediatric Hospitals
Electronic Health Records
Drug Interactions
Pharmacists
Pharmaceutical Preparations
Clinical Decision Support Systems
Safety
Quality Improvement
Fatigue
Software

Keywords

  • Clinical decision support systems
  • Drug interactions
  • Electronic health records
  • Medical order entry systems
  • Medication alert systems
  • Visual analytics

ASJC Scopus subject areas

  • Health Informatics

Cite this

Optimization of drug-drug interaction alert rules in a pediatric hospital's electronic health record system using a visual analytics dashboard. / Simpao, Allan F.; Ahumada, Luis M.; Desai, Bimal R.; Bonafide, Christopher P.; Gávez, Jorge A.; Rehman, Mohamed; Jawad, Abbas F.; Palma, Krisha L.; Shelov, Eric D.

In: Journal of the American Medical Informatics Association, Vol. 22, No. 2, 01.01.2015, p. 361-369.

Research output: Contribution to journalArticle

Simpao, Allan F. ; Ahumada, Luis M. ; Desai, Bimal R. ; Bonafide, Christopher P. ; Gávez, Jorge A. ; Rehman, Mohamed ; Jawad, Abbas F. ; Palma, Krisha L. ; Shelov, Eric D. / Optimization of drug-drug interaction alert rules in a pediatric hospital's electronic health record system using a visual analytics dashboard. In: Journal of the American Medical Informatics Association. 2015 ; Vol. 22, No. 2. pp. 361-369.
@article{4fab93d5450449e99f4e56e708c4f941,
title = "Optimization of drug-drug interaction alert rules in a pediatric hospital's electronic health record system using a visual analytics dashboard",
abstract = "Objective To develop and evaluate an electronic dashboard of hospital-wide electronic health record medication alerts for an alert fatigue reduction quality improvement project. Methods We used visual analytics software to develop the dashboard. We collaborated with the hospital-wide Clinical Decision Support committee to perform three interventions successively deactivating clinically irrelevant drug-drug interaction (DDI) alert rules. We analyzed the impact of the interventions on care providers' and pharmacists' alert and override rates using an interrupted time series framework with piecewise regression. Results We evaluated 2 391 880 medication alerts between January 31, 2011 and January 26, 2014. For pharmacists, the median alert rate prior to the first DDI deactivation was 58.74 alerts/100 orders (IQR 54.98-60.48) and 25.11 alerts/ 100 orders (IQR 23.45-26.57) following the three interventions (p < 0.001). For providers, baseline median alert rate prior to the first round of DDI deactivation was 19.73 alerts/100 orders (IQR 18.66-20.24) and 15.11 alerts/100 orders (IQR 14.44-15.49) following the three interventions (p < 0.001). In a subgroup analysis, we observed a decrease in pharmacists' override rates for DDI alerts that were not modified in the system from a median of 93.06 overrides/100 alerts (IQR 91.96-94.33) to 85.68 overrides/100 alerts (IQR 84.29-87.15, p < 0.001). The medication serious safety event rate decreased during the study period, and there were no serious safety events reported in association with the deactivated alert rules. Conclusions An alert dashboard facilitated safe rapid-cycle reductions in alert burden that were temporally associated with lower pharmacist override rates in a subgroup of DDIs not directly affected by the interventions; meanwhile, the pharmacists' frequency of selecting the 'cancel' option increased. We hypothesize that reducing the alert burden enabled pharmacists to devote more attention to clinically relevant alerts.",
keywords = "Clinical decision support systems, Drug interactions, Electronic health records, Medical order entry systems, Medication alert systems, Visual analytics",
author = "Simpao, {Allan F.} and Ahumada, {Luis M.} and Desai, {Bimal R.} and Bonafide, {Christopher P.} and G{\'a}vez, {Jorge A.} and Mohamed Rehman and Jawad, {Abbas F.} and Palma, {Krisha L.} and Shelov, {Eric D.}",
year = "2015",
month = "1",
day = "1",
doi = "10.1136/amiajnl-2013-002538",
language = "English (US)",
volume = "22",
pages = "361--369",
journal = "Journal of the American Medical Informatics Association : JAMIA",
issn = "1067-5027",
publisher = "Oxford University Press",
number = "2",

}

TY - JOUR

T1 - Optimization of drug-drug interaction alert rules in a pediatric hospital's electronic health record system using a visual analytics dashboard

AU - Simpao, Allan F.

AU - Ahumada, Luis M.

AU - Desai, Bimal R.

AU - Bonafide, Christopher P.

AU - Gávez, Jorge A.

AU - Rehman, Mohamed

AU - Jawad, Abbas F.

AU - Palma, Krisha L.

AU - Shelov, Eric D.

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Objective To develop and evaluate an electronic dashboard of hospital-wide electronic health record medication alerts for an alert fatigue reduction quality improvement project. Methods We used visual analytics software to develop the dashboard. We collaborated with the hospital-wide Clinical Decision Support committee to perform three interventions successively deactivating clinically irrelevant drug-drug interaction (DDI) alert rules. We analyzed the impact of the interventions on care providers' and pharmacists' alert and override rates using an interrupted time series framework with piecewise regression. Results We evaluated 2 391 880 medication alerts between January 31, 2011 and January 26, 2014. For pharmacists, the median alert rate prior to the first DDI deactivation was 58.74 alerts/100 orders (IQR 54.98-60.48) and 25.11 alerts/ 100 orders (IQR 23.45-26.57) following the three interventions (p < 0.001). For providers, baseline median alert rate prior to the first round of DDI deactivation was 19.73 alerts/100 orders (IQR 18.66-20.24) and 15.11 alerts/100 orders (IQR 14.44-15.49) following the three interventions (p < 0.001). In a subgroup analysis, we observed a decrease in pharmacists' override rates for DDI alerts that were not modified in the system from a median of 93.06 overrides/100 alerts (IQR 91.96-94.33) to 85.68 overrides/100 alerts (IQR 84.29-87.15, p < 0.001). The medication serious safety event rate decreased during the study period, and there were no serious safety events reported in association with the deactivated alert rules. Conclusions An alert dashboard facilitated safe rapid-cycle reductions in alert burden that were temporally associated with lower pharmacist override rates in a subgroup of DDIs not directly affected by the interventions; meanwhile, the pharmacists' frequency of selecting the 'cancel' option increased. We hypothesize that reducing the alert burden enabled pharmacists to devote more attention to clinically relevant alerts.

AB - Objective To develop and evaluate an electronic dashboard of hospital-wide electronic health record medication alerts for an alert fatigue reduction quality improvement project. Methods We used visual analytics software to develop the dashboard. We collaborated with the hospital-wide Clinical Decision Support committee to perform three interventions successively deactivating clinically irrelevant drug-drug interaction (DDI) alert rules. We analyzed the impact of the interventions on care providers' and pharmacists' alert and override rates using an interrupted time series framework with piecewise regression. Results We evaluated 2 391 880 medication alerts between January 31, 2011 and January 26, 2014. For pharmacists, the median alert rate prior to the first DDI deactivation was 58.74 alerts/100 orders (IQR 54.98-60.48) and 25.11 alerts/ 100 orders (IQR 23.45-26.57) following the three interventions (p < 0.001). For providers, baseline median alert rate prior to the first round of DDI deactivation was 19.73 alerts/100 orders (IQR 18.66-20.24) and 15.11 alerts/100 orders (IQR 14.44-15.49) following the three interventions (p < 0.001). In a subgroup analysis, we observed a decrease in pharmacists' override rates for DDI alerts that were not modified in the system from a median of 93.06 overrides/100 alerts (IQR 91.96-94.33) to 85.68 overrides/100 alerts (IQR 84.29-87.15, p < 0.001). The medication serious safety event rate decreased during the study period, and there were no serious safety events reported in association with the deactivated alert rules. Conclusions An alert dashboard facilitated safe rapid-cycle reductions in alert burden that were temporally associated with lower pharmacist override rates in a subgroup of DDIs not directly affected by the interventions; meanwhile, the pharmacists' frequency of selecting the 'cancel' option increased. We hypothesize that reducing the alert burden enabled pharmacists to devote more attention to clinically relevant alerts.

KW - Clinical decision support systems

KW - Drug interactions

KW - Electronic health records

KW - Medical order entry systems

KW - Medication alert systems

KW - Visual analytics

UR - http://www.scopus.com/inward/record.url?scp=84934288123&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84934288123&partnerID=8YFLogxK

U2 - 10.1136/amiajnl-2013-002538

DO - 10.1136/amiajnl-2013-002538

M3 - Article

C2 - 25318641

AN - SCOPUS:84934288123

VL - 22

SP - 361

EP - 369

JO - Journal of the American Medical Informatics Association : JAMIA

JF - Journal of the American Medical Informatics Association : JAMIA

SN - 1067-5027

IS - 2

ER -