Audio and visual analysis of urologic laparoscopic and robotic skills: Objective criteria for surgical skill evaluation

Amin Herati, Sylvia Montag, Sero Andonian, Edan Y. Shapiro, Meredith Akerman, Louis R. Kavoussi, Lee Richstone

Research output: Contribution to journalArticle

Abstract

Objective: To assess intraoperative cognitive and motor skills using audio- and video-based analysis. Materials and Methods: The study enrolled 11 surgeons who were categorized into novice (n = 4), intermediate (n = 4), and expert (n = 3) groups. Categorization of skill level was based on years of experience and as determined by the lead expert surgeon. A total of 32 cases were available for analysis, including 5 robotic and 27 laparoscopic renal cases. For each procedure, video and audio components were recorded and sent for grading to 4 blinded judges. The previously validated global rating scale (GRS) and operation-specific rating scale (ORS), as well as a novel cognitive rating scale (CRS), were used to assess performances. Statistical comparisons were performed by analysis of variance. Results: Comparison of the 3 skill levels using analysis of variance showed that each scale was able to differentiate among the levels (P <.05). The mean scores for the before and after audio GRS, ORS, and CRS showed significant difference between the novice, intermediate, and expert groups, demonstrating construct validity. Conclusion: The use of intraoperative audio is an innovative way to assess the cognitive ability of the surgeon. The CRS demonstrated construct validity. The addition of the CRS to the already validated GRS and ORS may serve as a reliable system to objectively evaluate laparoscopic and robotic surgical skill.

Original languageEnglish (US)
Pages (from-to)1277-1282
Number of pages6
JournalUrology
Volume80
Issue number6
DOIs
Publication statusPublished - Dec 1 2012
Externally publishedYes

    Fingerprint

ASJC Scopus subject areas

  • Urology

Cite this