A computational framework for complementary situational awareness (CSA) in surgical assistant robots

Preetham Chalasani, Anton Deguet, Peter Kazanzides, Russell H Taylor

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Robotic surgical systems have contributed greatly to the advancement of minimally invasive surgery (MIS). More specifically, telesurgical robots have provided enhanced dexterity to surgeons performing MIS procedures. However, current robotic teleoperated systems have only limited situational awareness of the patient anatomy and surgical environment that would typically be available to a surgeon in an open surgery. Although the endoscopic view enhances the visualization of the anatomy, perceptual understanding of the environment and anatomy is still lacking due to the absence of sensory feedback. To address these limitations, we present an algorithmic software framework to provide Complementary Situational Awareness (CSA) in a surgical assistant. This framework aims at improving the human-robot relationship by providing elaborate guidance and sensory feedback capabilities for the surgeon in complex MIS procedures. Unlike traditional teleoperation, this framework enables the user to telemanipulate the situational model in a virtual environment and uses that information to command the slave robot with appropriate admittance gains and environmental constraints. Simultaneously, the situational model is updated based on interaction of the slave robot with the task space environment. We provide various high-level and mid-level components to provide CSA and illustrate the necessary capabilities required for any robotic platform to readily incorporate CSA. We also demonstrate the use of our framework for constrained model-mediated teleoperation using the open-source da Vinci Research Kit (dVRK) hardware.

Original languageEnglish (US)
Title of host publicationProceedings - 2nd IEEE International Conference on Robotic Computing, IRC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages9-16
Number of pages8
Volume2018-January
ISBN (Electronic)9781538646519
DOIs
StatePublished - Apr 2 2018
Event2nd IEEE International Conference on Robotic Computing, IRC 2018 - Laguna Hills, United States
Duration: Jan 31 2018Feb 2 2018

Other

Other2nd IEEE International Conference on Robotic Computing, IRC 2018
CountryUnited States
CityLaguna Hills
Period1/31/182/2/18

Fingerprint

Situational Awareness
Minimally Invasive Surgery
Surgery
Anatomy
Robot
Robots
Sensory feedback
Robotics
Teleoperation
Remote control
Information use
Virtual Environments
Open Source
Virtual reality
Guidance
Visualization
Hardware
Model
Software
Necessary

Keywords

  • DVRK
  • Online estimation
  • Software framework
  • Teleoperation

ASJC Scopus subject areas

  • Control and Optimization
  • Artificial Intelligence
  • Software

Cite this

Chalasani, P., Deguet, A., Kazanzides, P., & Taylor, R. H. (2018). A computational framework for complementary situational awareness (CSA) in surgical assistant robots. In Proceedings - 2nd IEEE International Conference on Robotic Computing, IRC 2018 (Vol. 2018-January, pp. 9-16). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IRC.2018.00011

A computational framework for complementary situational awareness (CSA) in surgical assistant robots. / Chalasani, Preetham; Deguet, Anton; Kazanzides, Peter; Taylor, Russell H.

Proceedings - 2nd IEEE International Conference on Robotic Computing, IRC 2018. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. p. 9-16.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chalasani, P, Deguet, A, Kazanzides, P & Taylor, RH 2018, A computational framework for complementary situational awareness (CSA) in surgical assistant robots. in Proceedings - 2nd IEEE International Conference on Robotic Computing, IRC 2018. vol. 2018-January, Institute of Electrical and Electronics Engineers Inc., pp. 9-16, 2nd IEEE International Conference on Robotic Computing, IRC 2018, Laguna Hills, United States, 1/31/18. https://doi.org/10.1109/IRC.2018.00011
Chalasani P, Deguet A, Kazanzides P, Taylor RH. A computational framework for complementary situational awareness (CSA) in surgical assistant robots. In Proceedings - 2nd IEEE International Conference on Robotic Computing, IRC 2018. Vol. 2018-January. Institute of Electrical and Electronics Engineers Inc. 2018. p. 9-16 https://doi.org/10.1109/IRC.2018.00011
Chalasani, Preetham ; Deguet, Anton ; Kazanzides, Peter ; Taylor, Russell H. / A computational framework for complementary situational awareness (CSA) in surgical assistant robots. Proceedings - 2nd IEEE International Conference on Robotic Computing, IRC 2018. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. pp. 9-16
@inproceedings{2c49460733e54ff89b8024cc17fa7746,
title = "A computational framework for complementary situational awareness (CSA) in surgical assistant robots",
abstract = "Robotic surgical systems have contributed greatly to the advancement of minimally invasive surgery (MIS). More specifically, telesurgical robots have provided enhanced dexterity to surgeons performing MIS procedures. However, current robotic teleoperated systems have only limited situational awareness of the patient anatomy and surgical environment that would typically be available to a surgeon in an open surgery. Although the endoscopic view enhances the visualization of the anatomy, perceptual understanding of the environment and anatomy is still lacking due to the absence of sensory feedback. To address these limitations, we present an algorithmic software framework to provide Complementary Situational Awareness (CSA) in a surgical assistant. This framework aims at improving the human-robot relationship by providing elaborate guidance and sensory feedback capabilities for the surgeon in complex MIS procedures. Unlike traditional teleoperation, this framework enables the user to telemanipulate the situational model in a virtual environment and uses that information to command the slave robot with appropriate admittance gains and environmental constraints. Simultaneously, the situational model is updated based on interaction of the slave robot with the task space environment. We provide various high-level and mid-level components to provide CSA and illustrate the necessary capabilities required for any robotic platform to readily incorporate CSA. We also demonstrate the use of our framework for constrained model-mediated teleoperation using the open-source da Vinci Research Kit (dVRK) hardware.",
keywords = "DVRK, Online estimation, Software framework, Teleoperation",
author = "Preetham Chalasani and Anton Deguet and Peter Kazanzides and Taylor, {Russell H}",
year = "2018",
month = "4",
day = "2",
doi = "10.1109/IRC.2018.00011",
language = "English (US)",
volume = "2018-January",
pages = "9--16",
booktitle = "Proceedings - 2nd IEEE International Conference on Robotic Computing, IRC 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - A computational framework for complementary situational awareness (CSA) in surgical assistant robots

AU - Chalasani, Preetham

AU - Deguet, Anton

AU - Kazanzides, Peter

AU - Taylor, Russell H

PY - 2018/4/2

Y1 - 2018/4/2

N2 - Robotic surgical systems have contributed greatly to the advancement of minimally invasive surgery (MIS). More specifically, telesurgical robots have provided enhanced dexterity to surgeons performing MIS procedures. However, current robotic teleoperated systems have only limited situational awareness of the patient anatomy and surgical environment that would typically be available to a surgeon in an open surgery. Although the endoscopic view enhances the visualization of the anatomy, perceptual understanding of the environment and anatomy is still lacking due to the absence of sensory feedback. To address these limitations, we present an algorithmic software framework to provide Complementary Situational Awareness (CSA) in a surgical assistant. This framework aims at improving the human-robot relationship by providing elaborate guidance and sensory feedback capabilities for the surgeon in complex MIS procedures. Unlike traditional teleoperation, this framework enables the user to telemanipulate the situational model in a virtual environment and uses that information to command the slave robot with appropriate admittance gains and environmental constraints. Simultaneously, the situational model is updated based on interaction of the slave robot with the task space environment. We provide various high-level and mid-level components to provide CSA and illustrate the necessary capabilities required for any robotic platform to readily incorporate CSA. We also demonstrate the use of our framework for constrained model-mediated teleoperation using the open-source da Vinci Research Kit (dVRK) hardware.

AB - Robotic surgical systems have contributed greatly to the advancement of minimally invasive surgery (MIS). More specifically, telesurgical robots have provided enhanced dexterity to surgeons performing MIS procedures. However, current robotic teleoperated systems have only limited situational awareness of the patient anatomy and surgical environment that would typically be available to a surgeon in an open surgery. Although the endoscopic view enhances the visualization of the anatomy, perceptual understanding of the environment and anatomy is still lacking due to the absence of sensory feedback. To address these limitations, we present an algorithmic software framework to provide Complementary Situational Awareness (CSA) in a surgical assistant. This framework aims at improving the human-robot relationship by providing elaborate guidance and sensory feedback capabilities for the surgeon in complex MIS procedures. Unlike traditional teleoperation, this framework enables the user to telemanipulate the situational model in a virtual environment and uses that information to command the slave robot with appropriate admittance gains and environmental constraints. Simultaneously, the situational model is updated based on interaction of the slave robot with the task space environment. We provide various high-level and mid-level components to provide CSA and illustrate the necessary capabilities required for any robotic platform to readily incorporate CSA. We also demonstrate the use of our framework for constrained model-mediated teleoperation using the open-source da Vinci Research Kit (dVRK) hardware.

KW - DVRK

KW - Online estimation

KW - Software framework

KW - Teleoperation

UR - http://www.scopus.com/inward/record.url?scp=85049642925&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049642925&partnerID=8YFLogxK

U2 - 10.1109/IRC.2018.00011

DO - 10.1109/IRC.2018.00011

M3 - Conference contribution

AN - SCOPUS:85049642925

VL - 2018-January

SP - 9

EP - 16

BT - Proceedings - 2nd IEEE International Conference on Robotic Computing, IRC 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -