TY - GEN
T1 - Auditory and visio-temporal distance coding for 3-dimensional perception in medical augmented reality
AU - Bork, Felix
AU - Fuers, Bernhard
AU - Schneider, Anja Katharina
AU - Pinto, Francisco
AU - Graumann, Christoph
AU - Navab, Nassir
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2015/11/11
Y1 - 2015/11/11
N2 - Image-guided medical interventions more frequently rely on Augmented Reality (AR) visualization to enable surgical navigation. Current systems use 2-D monitors to present the view from external cameras, which does not provide an ideal perception of the 3-D position of the region of interest. Despite this problem, most research targets the direct overlay of diagnostic imaging data, and only few studies attempt to improve the perception of occluded structures in external camera views. The focus of this paper lies on improving the 3-D perception of an augmented external camera view by combining both auditory and visual stimuli in a dynamic multi-sensory AR environment for medical applications. Our approach is based on Temporal Distance Coding (TDC) and an active surgical tool to interact with occluded virtual objects of interest in the scene in order to gain an improved perception of their 3-D location. Users performed a simulated needle biopsy by targeting virtual lesions rendered inside a patient phantom. Experimental results demonstrate that our TDC-based visualization technique significantly improves the localization accuracy, while the addition of auditory feedback results in increased intuitiveness and faster completion of the task.
AB - Image-guided medical interventions more frequently rely on Augmented Reality (AR) visualization to enable surgical navigation. Current systems use 2-D monitors to present the view from external cameras, which does not provide an ideal perception of the 3-D position of the region of interest. Despite this problem, most research targets the direct overlay of diagnostic imaging data, and only few studies attempt to improve the perception of occluded structures in external camera views. The focus of this paper lies on improving the 3-D perception of an augmented external camera view by combining both auditory and visual stimuli in a dynamic multi-sensory AR environment for medical applications. Our approach is based on Temporal Distance Coding (TDC) and an active surgical tool to interact with occluded virtual objects of interest in the scene in order to gain an improved perception of their 3-D location. Users performed a simulated needle biopsy by targeting virtual lesions rendered inside a patient phantom. Experimental results demonstrate that our TDC-based visualization technique significantly improves the localization accuracy, while the addition of auditory feedback results in increased intuitiveness and faster completion of the task.
KW - Auditory and Visual Stimuli
KW - Medical Augmented Reality
KW - Multi-Sensory Environment
KW - Temporal Distance Coding
UR - http://www.scopus.com/inward/record.url?scp=84962221514&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84962221514&partnerID=8YFLogxK
U2 - 10.1109/ISMAR.2015.16
DO - 10.1109/ISMAR.2015.16
M3 - Conference contribution
AN - SCOPUS:84962221514
T3 - Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
SP - 7
EP - 12
BT - Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
A2 - Sakata, Nobuchika
A2 - Newcombe, Richard
A2 - Lindeman, Robert
A2 - Sandor, Christian
A2 - Mayol-Cuevas, Walterio
A2 - Teichrieb, Veronica
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
Y2 - 29 September 2015 through 3 October 2015
ER -