TY - JOUR
T1 - Eye Tracking and Motion Data Predict Endoscopic Sinus Surgery Skill
AU - Berges, Alexandra J.
AU - Vedula, S. Swaroop
AU - Chara, Alejandro
AU - Hager, Gregory D.
AU - Ishii, Masaru
AU - Malpani, Anand
N1 - Funding Information:
The authors acknowledge Narges Ahmidi for data collection and Ana Fahey for data analysis.
Publisher Copyright:
© 2022 The Authors. The Laryngoscope published by Wiley Periodicals LLC on behalf of The American Laryngological, Rhinological and Otological Society, Inc.
PY - 2023/3
Y1 - 2023/3
N2 - Objective: Endoscopic surgery has a considerable learning curve due to dissociation of the visual-motor axes, coupled with decreased tactile feedback and mobility. In particular, endoscopic sinus surgery (ESS) lacks objective skill assessment metrics to provide specific feedback to trainees. This study aims to identify summary metrics from eye tracking, endoscope motion, and tool motion to objectively assess surgeons' ESS skill. Methods: In this cross-sectional study, expert and novice surgeons performed ESS tasks of inserting an endoscope and tool into a cadaveric nose, touching an anatomical landmark, and withdrawing the endoscope and tool out of the nose. Tool and endoscope motion were collected using an electromagnetic tracker, and eye gaze was tracked using an infrared camera. Three expert surgeons provided binary assessments of low/high skill. 20 summary statistics were calculated for eye, tool, and endoscope motion and used in logistic regression models to predict surgical skill. Results: 14 metrics (10 eye gaze, 2 tool motion, and 2 endoscope motion) were significantly different between surgeons with low and high skill. Models to predict skill for 6/9 ESS tasks had an AUC >0.95. A combined model of all tasks (AUC 0.95, PPV 0.93, NPV 0.89) included metrics from eye tracking data and endoscope motion, indicating that these metrics are transferable across tasks. Conclusions: Eye gaze, endoscope, and tool motion data can provide an objective and accurate measurement of ESS surgical performance. Incorporation of these algorithmic techniques intraoperatively could allow for automated skill assessment for trainees learning endoscopic surgery. Level of Evidence: N/A Laryngoscope, 133:500–505, 2023.
AB - Objective: Endoscopic surgery has a considerable learning curve due to dissociation of the visual-motor axes, coupled with decreased tactile feedback and mobility. In particular, endoscopic sinus surgery (ESS) lacks objective skill assessment metrics to provide specific feedback to trainees. This study aims to identify summary metrics from eye tracking, endoscope motion, and tool motion to objectively assess surgeons' ESS skill. Methods: In this cross-sectional study, expert and novice surgeons performed ESS tasks of inserting an endoscope and tool into a cadaveric nose, touching an anatomical landmark, and withdrawing the endoscope and tool out of the nose. Tool and endoscope motion were collected using an electromagnetic tracker, and eye gaze was tracked using an infrared camera. Three expert surgeons provided binary assessments of low/high skill. 20 summary statistics were calculated for eye, tool, and endoscope motion and used in logistic regression models to predict surgical skill. Results: 14 metrics (10 eye gaze, 2 tool motion, and 2 endoscope motion) were significantly different between surgeons with low and high skill. Models to predict skill for 6/9 ESS tasks had an AUC >0.95. A combined model of all tasks (AUC 0.95, PPV 0.93, NPV 0.89) included metrics from eye tracking data and endoscope motion, indicating that these metrics are transferable across tasks. Conclusions: Eye gaze, endoscope, and tool motion data can provide an objective and accurate measurement of ESS surgical performance. Incorporation of these algorithmic techniques intraoperatively could allow for automated skill assessment for trainees learning endoscopic surgery. Level of Evidence: N/A Laryngoscope, 133:500–505, 2023.
KW - endoscopic sinus surgery
KW - eye movement events
KW - eye tracking
KW - surgical skill assessment
KW - surgical training
UR - http://www.scopus.com/inward/record.url?scp=85127407338&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85127407338&partnerID=8YFLogxK
U2 - 10.1002/lary.30121
DO - 10.1002/lary.30121
M3 - Article
C2 - 35357011
AN - SCOPUS:85127407338
SN - 0023-852X
VL - 133
SP - 500
EP - 505
JO - Laryngoscope
JF - Laryngoscope
IS - 3
ER -