Real-time self-calibration of a tracked augmented reality display

Zachary Baum, Andras Lasso, Tamas Ungi, Gabor Fichtinger

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

PURPOSE: Augmented reality systems have been proposed for image-guided needle interventions but they have not become widely used in clinical practice due to restrictions such as limited portability, low display refresh rates, and tedious calibration procedures. We propose a handheld tablet-based self-calibrating image overlay system. METHODS: A modular handheld augmented reality viewbox was constructed from a tablet computer and a semi-transparent mirror. A consistent and precise self-calibration method, without the use of any temporary markers, was designed to achieve an accurate calibration of the system. Markers attached to the viewbox and patient are simultaneously tracked using an optical pose tracker to report the position of the patient with respect to a displayed image plane that is visualized in real-time. The software was built using the open-source 3D Slicer application platform's SlicerIGT extension and the PLUS toolkit. RESULTS: The accuracy of the image overlay with image-guided needle interventions yielded a mean absolute position error of 0.99 mm (95th percentile 1.93 mm) in-plane of the overlay and a mean absolute position error of 0.61 mm (95th percentile 1.19 mm) out-of-plane. This accuracy is clinically acceptable for tool guidance during various procedures, such as musculoskeletal injections. CONCLUSION: A self-calibration method was developed and evaluated for a tracked augmented reality display. The results show potential for the use of handheld image overlays in clinical studies with image-guided needle interventions.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling
PublisherSPIE
Volume9786
ISBN (Electronic)9781510600218
DOIs
StatePublished - 2016
Externally publishedYes
EventMedical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling - San Diego, United States
Duration: Feb 28 2016Mar 1 2016

Other

OtherMedical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling
CountryUnited States
CitySan Diego
Period2/28/163/1/16

Keywords

  • 3D Slicer
  • Augmented Reality
  • Calibration
  • Image-Guided Intervention
  • Image-Guided Therapy
  • PLUS Toolkit
  • SlicerIGT
  • Visualization

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics
  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'Real-time self-calibration of a tracked augmented reality display'. Together they form a unique fingerprint.

  • Cite this

    Baum, Z., Lasso, A., Ungi, T., & Fichtinger, G. (2016). Real-time self-calibration of a tracked augmented reality display. In Medical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling (Vol. 9786). [97860F] SPIE. https://doi.org/10.1117/12.2217270