TY - JOUR
T1 - A beamformer-independent method to predict photoacoustic visual servoing system failure from a single image frame
AU - Gonzalez, Eduardo A.
AU - Assis, Fabrizio
AU - Chrispin, Jonathan
AU - Bell, Muyinatu A.Lediju
N1 - Funding Information:
ACKNOWLEDGMENTS This work was supported by NSF CAREER Award ECCS-1751522 and NSF SCH Award IIS-2014088. The authors acknowledge the support of NVIDIA Corporation with the donation of the Titan Xp GPU used for this research.
Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Visual servoing is a robotic method that has the potential to assist surgeons with tracking tool tips when attached to optical fibers to create photoacoustic images that are autonomously monitored. Currently, this approach must be tested with multiple image frames and multiple laser energies prior to each surgery in order to identify the minimum required energy that will not cause system failure over the number of frames tested. This study investigates possible integration of the generalized contrast-to-noise ratio (gCNR) into pre-surgical procedures as a method to predict system failure from only a single image frame. Photoacoustic data were acquired from an optical fiber inserted in a plastisol phantom or in the left ventricle of an in vivo swine heart. Raw data were processed with delay-and-sum (DAS) and short-lag spatial coherence (SLSC) beamforming (M = 25). gCNR values were estimated from a 3 mm x 3 mm region of interest (ROI) surrounding the photoacoustic target coordinates provided by the visual servoing algorithm. The prediction function modelled from phantom data was fit with R2 values of 0.992 and 0.991 for DAS and SLSC beamformers, respectively. When applying this fit to the in vivo test data, the RMSE between measured segmentation accuracy and the prediction functions was 9.34% for DAS images and 4.78% for SLSC images. These results indicate that the newly introduced image quality metric gCNR has sufficient robustness to predict the performance of visual servoing segmentation tasks and thereby mitigate the burden, time, and requirements of testing multiple image frames prior to the initiation of a surgery.
AB - Visual servoing is a robotic method that has the potential to assist surgeons with tracking tool tips when attached to optical fibers to create photoacoustic images that are autonomously monitored. Currently, this approach must be tested with multiple image frames and multiple laser energies prior to each surgery in order to identify the minimum required energy that will not cause system failure over the number of frames tested. This study investigates possible integration of the generalized contrast-to-noise ratio (gCNR) into pre-surgical procedures as a method to predict system failure from only a single image frame. Photoacoustic data were acquired from an optical fiber inserted in a plastisol phantom or in the left ventricle of an in vivo swine heart. Raw data were processed with delay-and-sum (DAS) and short-lag spatial coherence (SLSC) beamforming (M = 25). gCNR values were estimated from a 3 mm x 3 mm region of interest (ROI) surrounding the photoacoustic target coordinates provided by the visual servoing algorithm. The prediction function modelled from phantom data was fit with R2 values of 0.992 and 0.991 for DAS and SLSC beamformers, respectively. When applying this fit to the in vivo test data, the RMSE between measured segmentation accuracy and the prediction functions was 9.34% for DAS images and 4.78% for SLSC images. These results indicate that the newly introduced image quality metric gCNR has sufficient robustness to predict the performance of visual servoing segmentation tasks and thereby mitigate the burden, time, and requirements of testing multiple image frames prior to the initiation of a surgery.
UR - http://www.scopus.com/inward/record.url?scp=85122863592&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85122863592&partnerID=8YFLogxK
U2 - 10.1109/IUS52206.2021.9593672
DO - 10.1109/IUS52206.2021.9593672
M3 - Conference article
AN - SCOPUS:85122863592
SN - 1948-5719
JO - IEEE International Ultrasonics Symposium, IUS
JF - IEEE International Ultrasonics Symposium, IUS
T2 - 2021 IEEE International Ultrasonics Symposium, IUS 2021
Y2 - 11 September 2011 through 16 September 2011
ER -