Auditory and visio-temporal distance coding for 3-dimensional perception in medical augmented reality

Felix Bork, Bernhard Fuerst, Anja Katharina Schneider, Francisco Pinto, Christoph Graumann, Nassir Navab

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Image-guided medical interventions more frequently rely on Augmented Reality (AR) visualization to enable surgical navigation. Current systems use 2-D monitors to present the view from external cameras, which does not provide an ideal perception of the 3-D position of the region of interest. Despite this problem, most research targets the direct overlay of diagnostic imaging data, and only few studies attempt to improve the perception of occluded structures in external camera views. The focus of this paper lies on improving the 3-D perception of an augmented external camera view by combining both auditory and visual stimuli in a dynamic multi-sensory AR environment for medical applications. Our approach is based on Temporal Distance Coding (TDC) and an active surgical tool to interact with occluded virtual objects of interest in the scene in order to gain an improved perception of their 3-D location. Users performed a simulated needle biopsy by targeting virtual lesions rendered inside a patient phantom. Experimental results demonstrate that our TDC-based visualization technique significantly improves the localization accuracy, while the addition of auditory feedback results in increased intuitiveness and faster completion of the task.

Original languageEnglish (US)
Title of host publicationProceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages7-12
Number of pages6
ISBN (Electronic)9781467376600
DOIs
StatePublished - Nov 11 2015
Event14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 - Fukuoka, Japan
Duration: Sep 29 2015Oct 3 2015

Other

Other14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
CountryJapan
CityFukuoka
Period9/29/1510/3/15

Keywords

  • Auditory and Visual Stimuli
  • Medical Augmented Reality
  • Multi-Sensory Environment
  • Temporal Distance Coding

ASJC Scopus subject areas

  • Computer Science Applications
  • Modeling and Simulation
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Auditory and visio-temporal distance coding for 3-dimensional perception in medical augmented reality'. Together they form a unique fingerprint.

  • Cite this

    Bork, F., Fuerst, B., Schneider, A. K., Pinto, F., Graumann, C., & Navab, N. (2015). Auditory and visio-temporal distance coding for 3-dimensional perception in medical augmented reality. In Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 (pp. 7-12). [7328052] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR.2015.16