Smart agent system for insulin infusion protocol management: A simulation-based human factors evaluation study

Michael A. Rosen, Mark Romig, Zoe Demko, Noah Barasch, Cynthia Dwyer, Peter J. Pronovost, Adam Sapirstein

Research output: Contribution to journalArticlepeer-review


Objective To compare the insulin infusion management of critically ill patients by nurses using either a common standard (ie, human completion of insulin infusion protocol steps) or smart agent (SA) system that integrates the electronic health record and infusion pump and automates insulin dose selection. Design A within subjects design where participants completed 12 simulation scenarios, in 4 blocks of 3 scenarios each. Each block was performed with either the manual standard or the SA system. The initial starting condition was randomised to manual standard or SA and alternated thereafter. Setting A simulation-based human factors evaluation conducted at a large academic medical centre. Subjects Twenty critical care nurses. Interventions A systems engineering intervention, the SA, for insulin infusion management. Measurements The primary study outcomes were error rates and task completion times. Secondary study outcomes were perceived workload, trust in automation and system usability, all measured with previously validated scales. Main results The SA system produced significantly fewer dose errors compared with manual calculation (17% (n=20) vs 0, p<0.001). Participants were significantly faster, completing the protocol using the SA system (p<0.001). Overall ratings of workload for the SA system were significantly lower than with the manual system (p<0.001). For trust ratings, there was a significant interaction between time (first or second exposure) and the system used, such that after their second exposure to the two systems, participants had significantly more trust in the SA system. Participants rated the usability of the SA system significantly higher than the manual system (p<0.001). Conclusions A systems engineering approach jointly optimised safety, efficiency and workload considerations.

Original languageEnglish (US)
Pages (from-to)893-900
Number of pages8
JournalBMJ Quality and Safety
Issue number11
StatePublished - Nov 1 2021


  • human error
  • human factors
  • medication safety
  • nurses
  • patient safety

ASJC Scopus subject areas

  • Health Policy


Dive into the research topics of 'Smart agent system for insulin infusion protocol management: A simulation-based human factors evaluation study'. Together they form a unique fingerprint.

Cite this