TY - JOUR
T1 - The impact of visualization paradigms on the detectability of spatial misalignment in mixed reality surgical guidance
AU - Gu, Wenhao
AU - Martin-Gomez, Alejandro
AU - Cho, Sue Min
AU - Osgood, Greg
AU - Bracke, Bert
AU - Josewski, Chad
AU - Knopf, Jonathan
AU - Unberath, Mathias
N1 - Funding Information:
This work was funded in part by a sponsored research agreement between Arthrex Inc. and the Johns Hopkins University.
Funding Information:
This work was funded in part by a sponsored research agreement between Arthrex Inc. and the Johns Hopkins University.
Publisher Copyright:
© 2022, CARS.
PY - 2022/5
Y1 - 2022/5
N2 - Purpose:: Mixed reality (MR) for image-guided surgery may enable unobtrusive solutions for precision surgery. To display preoperative treatment plans at the correct physical position, it is essential to spatially align it with the patient intra-operatively. Accurate alignment is safety critical because it will guide treatment, but cannot always be achieved for varied reasons. Effective visualization mechanisms that reveal misalignment are crucial to prevent adverse surgical outcomes to ensure safe execution. Methods:: We test the effectiveness of three MR visualization paradigms in revealing spatial misalignment: wireframe, silhouette, and heatmap, which encodes residual registration error. We conduct a user study among 12 participants and use an anthropomorphic phantom mimicking total shoulder arthroplasty. Participants wearing Microsoft HoloLens 2 are presented with 36 randomly ordered spatial (mis)alignments of a virtual glenoid model overlaid on the phantom, each rendered using one of the three methods. Users choose whether to accept or reject the spatial alignment at every trial. Upon completion, participants report their perceived difficulty while using the visualization paradigms. Results:: Across all visualization paradigms, the ability of participants to reliably judge the accuracy of spatial alignment was moderate (58.33%).The three visualization paradigms showed comparable performance. However, the heatmap-based visualization resulted in significantly better detectability than random chance (p= 0.007). Despite heatmap enabling the most accurate decisions according to our measurements, wireframe was the most liked paradigm (50 %), followed by silhouette (41.7 %) and heatmap (8.3 %). Conclusion:: Our findings suggest that conventional mixed reality visualization paradigms are not sufficiently effective in enabling users to differentiate between accurate and inaccurate spatial alignment of virtual content to the environment.
AB - Purpose:: Mixed reality (MR) for image-guided surgery may enable unobtrusive solutions for precision surgery. To display preoperative treatment plans at the correct physical position, it is essential to spatially align it with the patient intra-operatively. Accurate alignment is safety critical because it will guide treatment, but cannot always be achieved for varied reasons. Effective visualization mechanisms that reveal misalignment are crucial to prevent adverse surgical outcomes to ensure safe execution. Methods:: We test the effectiveness of three MR visualization paradigms in revealing spatial misalignment: wireframe, silhouette, and heatmap, which encodes residual registration error. We conduct a user study among 12 participants and use an anthropomorphic phantom mimicking total shoulder arthroplasty. Participants wearing Microsoft HoloLens 2 are presented with 36 randomly ordered spatial (mis)alignments of a virtual glenoid model overlaid on the phantom, each rendered using one of the three methods. Users choose whether to accept or reject the spatial alignment at every trial. Upon completion, participants report their perceived difficulty while using the visualization paradigms. Results:: Across all visualization paradigms, the ability of participants to reliably judge the accuracy of spatial alignment was moderate (58.33%).The three visualization paradigms showed comparable performance. However, the heatmap-based visualization resulted in significantly better detectability than random chance (p= 0.007). Despite heatmap enabling the most accurate decisions according to our measurements, wireframe was the most liked paradigm (50 %), followed by silhouette (41.7 %) and heatmap (8.3 %). Conclusion:: Our findings suggest that conventional mixed reality visualization paradigms are not sufficiently effective in enabling users to differentiate between accurate and inaccurate spatial alignment of virtual content to the environment.
KW - Image-guided surgery
KW - Mixed reality
KW - Perception
KW - Registration
UR - http://www.scopus.com/inward/record.url?scp=85127244899&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85127244899&partnerID=8YFLogxK
U2 - 10.1007/s11548-022-02602-6
DO - 10.1007/s11548-022-02602-6
M3 - Article
C2 - 35347565
AN - SCOPUS:85127244899
SN - 1861-6410
VL - 17
SP - 921
EP - 927
JO - International Journal of Computer Assisted Radiology and Surgery
JF - International Journal of Computer Assisted Radiology and Surgery
IS - 5
ER -