Smartglasses/smartphone needle guidance AR system for transperineal prostate procedures

Ming Li, Sheng Xu, Dumitru Mazilu, Baris Turkbey, Bradford J. Wood

Research output: Chapter in Book/Report/Conference proceedingConference contribution


In transperineal prostate biopsy or ablation, a gridlate is typically used to guide the needle. The guidance method has limited positioning resolution and lack of needle angulation selections that are referenced to ultrasound imaging or TRUS-MRI fusion targets. To overcome the limitation, a novel augmented reality (AR) system that use smart see-through glasses and smartphone as a needle guidance device for transperineal prostate procedure was developed. The AR system is comprised of a MRI/CT scanner, a pre-procedural image analysis and visualization software, AR devices (smart-glasses, smartphone), a newly-developed AR app, as well as a local network. The AR app displays the lesion and planned needle trajectory, which are derived from the pre-procedural images, on the AR devices. A special designed image marker frame that affixed to the patient's perineum was used to track the pre-procedural image with the AR devices. The displayed needle plan was always referenced to the patient and remains independent from the position and orientation of the devices. Multiple devices can be used simultaneously and communicate via a local network. We evaluated the AR system accuracy with iPhone and R-7 glasses in a phantom study. The image overlay accuracy was 0.58±0.43o and 1.62±1.52o in iPhone and R-7 glasses respectively. The accuracy of iPhone guidance was 1.9±0.97 mm (lateral) and 1.0±0.5 mm (in-direction), the accuracy of R-7 guidance was 2.8±1.4mm (lateral) and 2.3±1.5mm (indirection). AR system using smart-glasses and smartphone can provide accurate needle guidance and see-through-the-skin display for needle based transperineal prostate interventions like biopsy and ablation.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2019
Subtitle of host publicationImage-Guided Procedures, Robotic Interventions, and Modeling
EditorsBaowei Fei, Cristian A. Linte
ISBN (Electronic)9781510625495
StatePublished - 2019
Externally publishedYes
EventMedical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling - San Diego, United States
Duration: Feb 17 2019Feb 19 2019

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


ConferenceMedical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling
Country/TerritoryUnited States
CitySan Diego


  • Augmented Reality (AR)
  • Interventional radiology
  • Smart-glasses guidance
  • Smartphone guidance
  • Transperineal prostate procedure

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging


Dive into the research topics of 'Smartglasses/smartphone needle guidance AR system for transperineal prostate procedures'. Together they form a unique fingerprint.

Cite this