Robot-assisted mirror ultrasound scanning for deep venous thrombosis detection using RGB-D sensor

Bo Meng, Ying ying Zhao, Lei Chen, Fereshteh Aalamifar, Xue jun Liu, Emad Boctor

Research output: Contribution to journalArticle

Abstract

Deep Venous Thrombosis (DVT) is a major cause of morbidity and mortality. Manually scanning with Ultrasound (US) probe brings heavy work load for the sonographers. This paper proposes a novel “Mirror robotic US scanning system. The system is composed of two-arm robot, linear US probes for master and slave side, Kinect sensor as a vision servo. On the master side, sonographers hold one robot arm and operate probe to inspect one leg. On the slave side, the robot follows the master probe on the navigation of Kinect and scans the other leg. 3D images of legs are segmented and register to get mirror matrix. Both Clustered Viewpoint Feature Histogram (CVFH) descriptors of segmented probe and CAD (Computer-Aided Design) training data were calculated to probe recognition. The leg phantom platform was built up. The mirror matrixes were obtained. The correlation coefficients between the two legs are calculated. Times of ICP (Iterative Closest Point) have been calculated for the platform. Results from the initial experiment indicate the idea is feasible and promising greatly by improving the inspection efficiently. Clinically, the method can be implemented for pre-operative procedures to predict the risk of DVT, and this may improve the US scanning efficacy.

Original languageEnglish (US)
Pages (from-to)1-15
Number of pages15
JournalMultimedia Tools and Applications
DOIs
StateAccepted/In press - May 2 2016

Fingerprint

Mirrors
Ultrasonics
Robots
Scanning
Sensors
Computer aided design
Navigation
Robotics
Inspection
Experiments

Keywords

  • CAD model
  • Camera calibration
  • ICP registraion
  • RGB-D sensor
  • Robot
  • Vision servo

ASJC Scopus subject areas

  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications
  • Software

Cite this

Robot-assisted mirror ultrasound scanning for deep venous thrombosis detection using RGB-D sensor. / Meng, Bo; Zhao, Ying ying; Chen, Lei; Aalamifar, Fereshteh; Liu, Xue jun; Boctor, Emad.

In: Multimedia Tools and Applications, 02.05.2016, p. 1-15.

Research output: Contribution to journalArticle

Meng, Bo ; Zhao, Ying ying ; Chen, Lei ; Aalamifar, Fereshteh ; Liu, Xue jun ; Boctor, Emad. / Robot-assisted mirror ultrasound scanning for deep venous thrombosis detection using RGB-D sensor. In: Multimedia Tools and Applications. 2016 ; pp. 1-15.
@article{2db1f5106f434b65b06fcc3b6c6b5f69,
title = "Robot-assisted mirror ultrasound scanning for deep venous thrombosis detection using RGB-D sensor",
abstract = "Deep Venous Thrombosis (DVT) is a major cause of morbidity and mortality. Manually scanning with Ultrasound (US) probe brings heavy work load for the sonographers. This paper proposes a novel “Mirror robotic US scanning system. The system is composed of two-arm robot, linear US probes for master and slave side, Kinect sensor as a vision servo. On the master side, sonographers hold one robot arm and operate probe to inspect one leg. On the slave side, the robot follows the master probe on the navigation of Kinect and scans the other leg. 3D images of legs are segmented and register to get mirror matrix. Both Clustered Viewpoint Feature Histogram (CVFH) descriptors of segmented probe and CAD (Computer-Aided Design) training data were calculated to probe recognition. The leg phantom platform was built up. The mirror matrixes were obtained. The correlation coefficients between the two legs are calculated. Times of ICP (Iterative Closest Point) have been calculated for the platform. Results from the initial experiment indicate the idea is feasible and promising greatly by improving the inspection efficiently. Clinically, the method can be implemented for pre-operative procedures to predict the risk of DVT, and this may improve the US scanning efficacy.",
keywords = "CAD model, Camera calibration, ICP registraion, RGB-D sensor, Robot, Vision servo",
author = "Bo Meng and Zhao, {Ying ying} and Lei Chen and Fereshteh Aalamifar and Liu, {Xue jun} and Emad Boctor",
year = "2016",
month = "5",
day = "2",
doi = "10.1007/s11042-016-3516-x",
language = "English (US)",
pages = "1--15",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",

}

TY - JOUR

T1 - Robot-assisted mirror ultrasound scanning for deep venous thrombosis detection using RGB-D sensor

AU - Meng, Bo

AU - Zhao, Ying ying

AU - Chen, Lei

AU - Aalamifar, Fereshteh

AU - Liu, Xue jun

AU - Boctor, Emad

PY - 2016/5/2

Y1 - 2016/5/2

N2 - Deep Venous Thrombosis (DVT) is a major cause of morbidity and mortality. Manually scanning with Ultrasound (US) probe brings heavy work load for the sonographers. This paper proposes a novel “Mirror robotic US scanning system. The system is composed of two-arm robot, linear US probes for master and slave side, Kinect sensor as a vision servo. On the master side, sonographers hold one robot arm and operate probe to inspect one leg. On the slave side, the robot follows the master probe on the navigation of Kinect and scans the other leg. 3D images of legs are segmented and register to get mirror matrix. Both Clustered Viewpoint Feature Histogram (CVFH) descriptors of segmented probe and CAD (Computer-Aided Design) training data were calculated to probe recognition. The leg phantom platform was built up. The mirror matrixes were obtained. The correlation coefficients between the two legs are calculated. Times of ICP (Iterative Closest Point) have been calculated for the platform. Results from the initial experiment indicate the idea is feasible and promising greatly by improving the inspection efficiently. Clinically, the method can be implemented for pre-operative procedures to predict the risk of DVT, and this may improve the US scanning efficacy.

AB - Deep Venous Thrombosis (DVT) is a major cause of morbidity and mortality. Manually scanning with Ultrasound (US) probe brings heavy work load for the sonographers. This paper proposes a novel “Mirror robotic US scanning system. The system is composed of two-arm robot, linear US probes for master and slave side, Kinect sensor as a vision servo. On the master side, sonographers hold one robot arm and operate probe to inspect one leg. On the slave side, the robot follows the master probe on the navigation of Kinect and scans the other leg. 3D images of legs are segmented and register to get mirror matrix. Both Clustered Viewpoint Feature Histogram (CVFH) descriptors of segmented probe and CAD (Computer-Aided Design) training data were calculated to probe recognition. The leg phantom platform was built up. The mirror matrixes were obtained. The correlation coefficients between the two legs are calculated. Times of ICP (Iterative Closest Point) have been calculated for the platform. Results from the initial experiment indicate the idea is feasible and promising greatly by improving the inspection efficiently. Clinically, the method can be implemented for pre-operative procedures to predict the risk of DVT, and this may improve the US scanning efficacy.

KW - CAD model

KW - Camera calibration

KW - ICP registraion

KW - RGB-D sensor

KW - Robot

KW - Vision servo

UR - http://www.scopus.com/inward/record.url?scp=84965076193&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84965076193&partnerID=8YFLogxK

U2 - 10.1007/s11042-016-3516-x

DO - 10.1007/s11042-016-3516-x

M3 - Article

AN - SCOPUS:84965076193

SP - 1

EP - 15

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

ER -