Fusing acoustic and optical sensing for needle tracking with ultrasound

Alexis Cheng, Bofeng Zhang, Philip Oh, Emad M. Boctor

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Needles are used in many surgical procedures such as drug delivery or needle biopsies. One of the key challenges when using needles in these interventions is the placement of the needle. Placement of the needle at the goal position will ensure proper execution of the surgical plan as well as avoid possible complications. This work explores tracking a needle with a piezoelectric sensor embedded at its tip with an ultrasound transducer and a mono-camera. While each of the ultrasound transducer and the monocamera sensors are insufficient on their own, one can uniquely locate the position of the piezoelectric sensor by combining these two sources of sensor information together. The information from each sensor can be processed to determine a geometrical locus on which the piezoelectric sensor must lie. By spatially combining the geometrical loci from the two sensors using an ultrasound calibration process, one can uniquely determine the location of the piezoelectric sensor. An experiment in a water tank was conducted with the computed results compared to ground truth cartesian stage data. An in-plane accuracy measure resulted in errors of 0.63mm and 0.18mm. The relative accuracy measure had a minimum, maximum, mean, and standard deviation of 0.02mm, 2.15mm, 0.61mm, and 0.61mm respectively. Future work will focus on demonstrating this method in more realistic ex vivo scenarios and explore whether our listed assumptions hold.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2018
Subtitle of host publicationImage-Guided Procedures, Robotic Interventions, and Modeling
EditorsBaowei Fei, Robert J. Webster
ISBN (Electronic)9781510616417
StatePublished - 2018
EventMedical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling - Houston, United States
Duration: Feb 12 2018Feb 15 2018

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


OtherMedical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling
Country/TerritoryUnited States

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging


Dive into the research topics of 'Fusing acoustic and optical sensing for needle tracking with ultrasound'. Together they form a unique fingerprint.

Cite this