Visual servoing for automatic and uncalibrated percutaneous procedures

Michael H. Loser, Nassir Navab, Benedicte Bascle, Russell H Taylor

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

Visual servoing is well established in the field of industrial robotics, when using CCD cameras. This paper describes one of the first medical implementations of uncalibrated visual servoing. To our knowledge, this is the first time that visual servoing is done using X-ray fluoroscopy. In this paper we present a new image based approach for semi-automatically guidance of a needle or surgical tool during percutaneous procedures and is based on a series of granted and pending US patent applications. It is a simple and accurate method which requires no prior calibration or registration. Therefore, no additional sensors (infrared, laser, ultrasound, MRI, etc), no stereotactic frame and no additional calibration phantom is needed. Our technique provides accurate 3D alignment of the tool with respect to an anatomic target and estimates the required insertion depth. We implemented and verified this method with three different medical robots at the Computer Integrated Surgery (CIS) Lab at the Johns Hopkins University. First tests were performed using a CCD-camera and a mobile uniplanar X-ray fluoroscope as imaging modality. We used small metal balls of 4 mm in diameter as target points. These targets were place 60 to 70 mm deep inside a test-phantom. Our method led to correct insertions with mean deviation of 0.20 mm with CCD camera and mean deviation of about 1.5 mm in clinical surrounding with an old X-ray imaging system, where the images were not of best quality. These promising results present this method as a serious alternative to other needle placement techniques, which require cumbersome and time consuming calibration procedures.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
PublisherSociety of Photo-Optical Instrumentation Engineers
Pages270-281
Number of pages12
Volume3976
StatePublished - 2000
Externally publishedYes
EventMedical Imaging 2000: Image Display and Visualization - San Diego, CA, USA
Duration: Feb 13 2000Feb 15 2000

Other

OtherMedical Imaging 2000: Image Display and Visualization
CitySan Diego, CA, USA
Period2/13/002/15/00

Fingerprint

Visual servoing
CCD cameras
Calibration
needles
X rays
Needles
insertion
patent applications
deviation
fluoroscopy
x rays
Infrared lasers
robotics
robots
surgery
Imaging systems
infrared lasers
Magnetic resonance imaging
Surgery
balls

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Loser, M. H., Navab, N., Bascle, B., & Taylor, R. H. (2000). Visual servoing for automatic and uncalibrated percutaneous procedures. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 3976, pp. 270-281). Society of Photo-Optical Instrumentation Engineers.

Visual servoing for automatic and uncalibrated percutaneous procedures. / Loser, Michael H.; Navab, Nassir; Bascle, Benedicte; Taylor, Russell H.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 3976 Society of Photo-Optical Instrumentation Engineers, 2000. p. 270-281.

Research output: Chapter in Book/Report/Conference proceedingChapter

Loser, MH, Navab, N, Bascle, B & Taylor, RH 2000, Visual servoing for automatic and uncalibrated percutaneous procedures. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 3976, Society of Photo-Optical Instrumentation Engineers, pp. 270-281, Medical Imaging 2000: Image Display and Visualization, San Diego, CA, USA, 2/13/00.
Loser MH, Navab N, Bascle B, Taylor RH. Visual servoing for automatic and uncalibrated percutaneous procedures. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 3976. Society of Photo-Optical Instrumentation Engineers. 2000. p. 270-281
Loser, Michael H. ; Navab, Nassir ; Bascle, Benedicte ; Taylor, Russell H. / Visual servoing for automatic and uncalibrated percutaneous procedures. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 3976 Society of Photo-Optical Instrumentation Engineers, 2000. pp. 270-281
@inbook{70f17a2d0ab643ebbee8e0e0544a2053,
title = "Visual servoing for automatic and uncalibrated percutaneous procedures",
abstract = "Visual servoing is well established in the field of industrial robotics, when using CCD cameras. This paper describes one of the first medical implementations of uncalibrated visual servoing. To our knowledge, this is the first time that visual servoing is done using X-ray fluoroscopy. In this paper we present a new image based approach for semi-automatically guidance of a needle or surgical tool during percutaneous procedures and is based on a series of granted and pending US patent applications. It is a simple and accurate method which requires no prior calibration or registration. Therefore, no additional sensors (infrared, laser, ultrasound, MRI, etc), no stereotactic frame and no additional calibration phantom is needed. Our technique provides accurate 3D alignment of the tool with respect to an anatomic target and estimates the required insertion depth. We implemented and verified this method with three different medical robots at the Computer Integrated Surgery (CIS) Lab at the Johns Hopkins University. First tests were performed using a CCD-camera and a mobile uniplanar X-ray fluoroscope as imaging modality. We used small metal balls of 4 mm in diameter as target points. These targets were place 60 to 70 mm deep inside a test-phantom. Our method led to correct insertions with mean deviation of 0.20 mm with CCD camera and mean deviation of about 1.5 mm in clinical surrounding with an old X-ray imaging system, where the images were not of best quality. These promising results present this method as a serious alternative to other needle placement techniques, which require cumbersome and time consuming calibration procedures.",
author = "Loser, {Michael H.} and Nassir Navab and Benedicte Bascle and Taylor, {Russell H}",
year = "2000",
language = "English (US)",
volume = "3976",
pages = "270--281",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "Society of Photo-Optical Instrumentation Engineers",

}

TY - CHAP

T1 - Visual servoing for automatic and uncalibrated percutaneous procedures

AU - Loser, Michael H.

AU - Navab, Nassir

AU - Bascle, Benedicte

AU - Taylor, Russell H

PY - 2000

Y1 - 2000

N2 - Visual servoing is well established in the field of industrial robotics, when using CCD cameras. This paper describes one of the first medical implementations of uncalibrated visual servoing. To our knowledge, this is the first time that visual servoing is done using X-ray fluoroscopy. In this paper we present a new image based approach for semi-automatically guidance of a needle or surgical tool during percutaneous procedures and is based on a series of granted and pending US patent applications. It is a simple and accurate method which requires no prior calibration or registration. Therefore, no additional sensors (infrared, laser, ultrasound, MRI, etc), no stereotactic frame and no additional calibration phantom is needed. Our technique provides accurate 3D alignment of the tool with respect to an anatomic target and estimates the required insertion depth. We implemented and verified this method with three different medical robots at the Computer Integrated Surgery (CIS) Lab at the Johns Hopkins University. First tests were performed using a CCD-camera and a mobile uniplanar X-ray fluoroscope as imaging modality. We used small metal balls of 4 mm in diameter as target points. These targets were place 60 to 70 mm deep inside a test-phantom. Our method led to correct insertions with mean deviation of 0.20 mm with CCD camera and mean deviation of about 1.5 mm in clinical surrounding with an old X-ray imaging system, where the images were not of best quality. These promising results present this method as a serious alternative to other needle placement techniques, which require cumbersome and time consuming calibration procedures.

AB - Visual servoing is well established in the field of industrial robotics, when using CCD cameras. This paper describes one of the first medical implementations of uncalibrated visual servoing. To our knowledge, this is the first time that visual servoing is done using X-ray fluoroscopy. In this paper we present a new image based approach for semi-automatically guidance of a needle or surgical tool during percutaneous procedures and is based on a series of granted and pending US patent applications. It is a simple and accurate method which requires no prior calibration or registration. Therefore, no additional sensors (infrared, laser, ultrasound, MRI, etc), no stereotactic frame and no additional calibration phantom is needed. Our technique provides accurate 3D alignment of the tool with respect to an anatomic target and estimates the required insertion depth. We implemented and verified this method with three different medical robots at the Computer Integrated Surgery (CIS) Lab at the Johns Hopkins University. First tests were performed using a CCD-camera and a mobile uniplanar X-ray fluoroscope as imaging modality. We used small metal balls of 4 mm in diameter as target points. These targets were place 60 to 70 mm deep inside a test-phantom. Our method led to correct insertions with mean deviation of 0.20 mm with CCD camera and mean deviation of about 1.5 mm in clinical surrounding with an old X-ray imaging system, where the images were not of best quality. These promising results present this method as a serious alternative to other needle placement techniques, which require cumbersome and time consuming calibration procedures.

UR - http://www.scopus.com/inward/record.url?scp=0033736865&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0033736865&partnerID=8YFLogxK

M3 - Chapter

AN - SCOPUS:0033736865

VL - 3976

SP - 270

EP - 281

BT - Proceedings of SPIE - The International Society for Optical Engineering

PB - Society of Photo-Optical Instrumentation Engineers

ER -