Towards clinical translation of augmented orthopedic surgery: From pre-op CT to intra-op x-ray via RGBD sensing

Emerson Tucker, Javad Fotouhi, Mathias Unberath, Sing Chun Lee, Bernhard Fuerst, Alex Johnson, Mehran Armand, Greg Osgood, Nassir Navab

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Pre-operative CT data is available for several orthopedic and trauma interventions, and is mainly used to identify injuries and plan the surgical procedure. In this work we propose an intuitive augmented reality environment allowing visualization of pre-operative data during the intervention, with an overlay of the optical information from the surgical site. The pre-operative CT volume is first registered to the patient by acquiring a single C-Arm X-ray image and using 3D/2D intensity-based registration. Next, we use an RGBD sensor on the C-Arm to fuse the optical information of the surgical site with patient pre-operative medical data and provide an augmented reality environment. The 3D/2D registration of the pre-and intra-operative data allows us to maintain a correct visualization each time the C-Arm is repositioned or the patient moves. An overall mean target registration error (mTRE) and standard deviation of 5.24 ± 3.09 mm was measured averaged over 19 C-Arm poses. The proposed solution enables the surgeon to visualize pre-operative data overlaid with information from the surgical site (e.g. surgeon's hands, surgical tools, etc.) for any C-Arm pose, and negates issues of line-of-sight and long setup times, which are present in commercially available systems.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2018
Subtitle of host publicationImaging Informatics for Healthcare, Research, and Applications
PublisherSPIE
Volume10579
ISBN (Electronic)9781510616479
DOIs
StatePublished - Jan 1 2018
EventMedical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications - Houston, United States
Duration: Feb 13 2018Feb 15 2018

Other

OtherMedical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications
CountryUnited States
CityHouston
Period2/13/182/15/18

Keywords

  • 3D/2D Registration
  • Augmented reality
  • Pre-operative CT
  • RGBD camera

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'Towards clinical translation of augmented orthopedic surgery: From pre-op CT to intra-op x-ray via RGBD sensing'. Together they form a unique fingerprint.

Cite this