Surgical fiducial segmentation and tracking for pose estimation based on ultrasound B-mode images

Lei Chen, Nathanael Kuo, Fereshteh Aalamifar, David Narrow, Devin O'Brien-Coon, Jerry Ladd Prince, Emad Boctor

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Doppler ultrasound is a non-invasive diagnostic tool for the quantitative measurement of blood flow. However, given that it provides velocity data that is dependent on the location and angle of measurement, repeat measurements to detect problems over time may require an expert to return to the same location. We therefore developed an image-guidance system based on ultrasound B-mode images that enables an inexperienced user to position the ultrasound probe at the same site repeatedly in order to acquire a comparable time series of Doppler readings. The system utilizes a bioresorbable fiducial and complementing software composed of the fiducial detection, key points tracking, probe pose estimation, and graphical user interface (GUI) modules. The fiducial is an echogenic marker that is implanted at the surgical site and can be detected and tracked during ultrasound B-mode screening. The key points on the marker can next be used to determine the pose of the ultrasound probe with respect to the marker. The 3D representation of the probe with its position and orientation are then displayed in the GUI for the user guidance. The fiducial detection has been tested on the data sets collected from three animal studies. The pose estimation algorithm was validated by five data sets collected by a UR5 robot. We tested the system on a plastisol phantom and showed that it can detect and track the fiducial marker while displaying the probe pose in real-time.

Original languageEnglish (US)
Title of host publication2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1244-1247
Number of pages4
Volume2016-October
ISBN (Electronic)9781457702204
DOIs
StatePublished - Oct 13 2016
Event38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016 - Orlando, United States
Duration: Aug 16 2016Aug 20 2016

Other

Other38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016
CountryUnited States
CityOrlando
Period8/16/168/20/16

Fingerprint

Ultrasonics
Fiducial Markers
Doppler Ultrasonography
Graphical user interfaces
Plastisols
Reading
Software
Time series
Screening
Animals
Blood
Robots
Datasets

ASJC Scopus subject areas

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Cite this

Chen, L., Kuo, N., Aalamifar, F., Narrow, D., O'Brien-Coon, D., Prince, J. L., & Boctor, E. (2016). Surgical fiducial segmentation and tracking for pose estimation based on ultrasound B-mode images. In 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016 (Vol. 2016-October, pp. 1244-1247). [7590931] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2016.7590931

Surgical fiducial segmentation and tracking for pose estimation based on ultrasound B-mode images. / Chen, Lei; Kuo, Nathanael; Aalamifar, Fereshteh; Narrow, David; O'Brien-Coon, Devin; Prince, Jerry Ladd; Boctor, Emad.

2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016. Vol. 2016-October Institute of Electrical and Electronics Engineers Inc., 2016. p. 1244-1247 7590931.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chen, L, Kuo, N, Aalamifar, F, Narrow, D, O'Brien-Coon, D, Prince, JL & Boctor, E 2016, Surgical fiducial segmentation and tracking for pose estimation based on ultrasound B-mode images. in 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016. vol. 2016-October, 7590931, Institute of Electrical and Electronics Engineers Inc., pp. 1244-1247, 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016, Orlando, United States, 8/16/16. https://doi.org/10.1109/EMBC.2016.7590931
Chen L, Kuo N, Aalamifar F, Narrow D, O'Brien-Coon D, Prince JL et al. Surgical fiducial segmentation and tracking for pose estimation based on ultrasound B-mode images. In 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016. Vol. 2016-October. Institute of Electrical and Electronics Engineers Inc. 2016. p. 1244-1247. 7590931 https://doi.org/10.1109/EMBC.2016.7590931
Chen, Lei ; Kuo, Nathanael ; Aalamifar, Fereshteh ; Narrow, David ; O'Brien-Coon, Devin ; Prince, Jerry Ladd ; Boctor, Emad. / Surgical fiducial segmentation and tracking for pose estimation based on ultrasound B-mode images. 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016. Vol. 2016-October Institute of Electrical and Electronics Engineers Inc., 2016. pp. 1244-1247
@inproceedings{15ab55bfd6f343628fd52ff116a8ac8f,
title = "Surgical fiducial segmentation and tracking for pose estimation based on ultrasound B-mode images",
abstract = "Doppler ultrasound is a non-invasive diagnostic tool for the quantitative measurement of blood flow. However, given that it provides velocity data that is dependent on the location and angle of measurement, repeat measurements to detect problems over time may require an expert to return to the same location. We therefore developed an image-guidance system based on ultrasound B-mode images that enables an inexperienced user to position the ultrasound probe at the same site repeatedly in order to acquire a comparable time series of Doppler readings. The system utilizes a bioresorbable fiducial and complementing software composed of the fiducial detection, key points tracking, probe pose estimation, and graphical user interface (GUI) modules. The fiducial is an echogenic marker that is implanted at the surgical site and can be detected and tracked during ultrasound B-mode screening. The key points on the marker can next be used to determine the pose of the ultrasound probe with respect to the marker. The 3D representation of the probe with its position and orientation are then displayed in the GUI for the user guidance. The fiducial detection has been tested on the data sets collected from three animal studies. The pose estimation algorithm was validated by five data sets collected by a UR5 robot. We tested the system on a plastisol phantom and showed that it can detect and track the fiducial marker while displaying the probe pose in real-time.",
author = "Lei Chen and Nathanael Kuo and Fereshteh Aalamifar and David Narrow and Devin O'Brien-Coon and Prince, {Jerry Ladd} and Emad Boctor",
year = "2016",
month = "10",
day = "13",
doi = "10.1109/EMBC.2016.7590931",
language = "English (US)",
volume = "2016-October",
pages = "1244--1247",
booktitle = "2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Surgical fiducial segmentation and tracking for pose estimation based on ultrasound B-mode images

AU - Chen, Lei

AU - Kuo, Nathanael

AU - Aalamifar, Fereshteh

AU - Narrow, David

AU - O'Brien-Coon, Devin

AU - Prince, Jerry Ladd

AU - Boctor, Emad

PY - 2016/10/13

Y1 - 2016/10/13

N2 - Doppler ultrasound is a non-invasive diagnostic tool for the quantitative measurement of blood flow. However, given that it provides velocity data that is dependent on the location and angle of measurement, repeat measurements to detect problems over time may require an expert to return to the same location. We therefore developed an image-guidance system based on ultrasound B-mode images that enables an inexperienced user to position the ultrasound probe at the same site repeatedly in order to acquire a comparable time series of Doppler readings. The system utilizes a bioresorbable fiducial and complementing software composed of the fiducial detection, key points tracking, probe pose estimation, and graphical user interface (GUI) modules. The fiducial is an echogenic marker that is implanted at the surgical site and can be detected and tracked during ultrasound B-mode screening. The key points on the marker can next be used to determine the pose of the ultrasound probe with respect to the marker. The 3D representation of the probe with its position and orientation are then displayed in the GUI for the user guidance. The fiducial detection has been tested on the data sets collected from three animal studies. The pose estimation algorithm was validated by five data sets collected by a UR5 robot. We tested the system on a plastisol phantom and showed that it can detect and track the fiducial marker while displaying the probe pose in real-time.

AB - Doppler ultrasound is a non-invasive diagnostic tool for the quantitative measurement of blood flow. However, given that it provides velocity data that is dependent on the location and angle of measurement, repeat measurements to detect problems over time may require an expert to return to the same location. We therefore developed an image-guidance system based on ultrasound B-mode images that enables an inexperienced user to position the ultrasound probe at the same site repeatedly in order to acquire a comparable time series of Doppler readings. The system utilizes a bioresorbable fiducial and complementing software composed of the fiducial detection, key points tracking, probe pose estimation, and graphical user interface (GUI) modules. The fiducial is an echogenic marker that is implanted at the surgical site and can be detected and tracked during ultrasound B-mode screening. The key points on the marker can next be used to determine the pose of the ultrasound probe with respect to the marker. The 3D representation of the probe with its position and orientation are then displayed in the GUI for the user guidance. The fiducial detection has been tested on the data sets collected from three animal studies. The pose estimation algorithm was validated by five data sets collected by a UR5 robot. We tested the system on a plastisol phantom and showed that it can detect and track the fiducial marker while displaying the probe pose in real-time.

UR - http://www.scopus.com/inward/record.url?scp=85009090855&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85009090855&partnerID=8YFLogxK

U2 - 10.1109/EMBC.2016.7590931

DO - 10.1109/EMBC.2016.7590931

M3 - Conference contribution

C2 - 28268550

AN - SCOPUS:85009090855

VL - 2016-October

SP - 1244

EP - 1247

BT - 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -