Visual servoing for automatic and uncalibrated percutaneous procedures

Michael H. Loser, Nassir Navab, Benedicte Bascle, Russell H. Taylor

Research output: Contribution to journalConference article

Abstract

Visual servoing is well established in the field of industrial robotics, when using CCD cameras. This paper describes one of the first medical implementations of uncalibrated visual servoing. To our knowledge, this is the first time that visual servoing is done using X-ray fluoroscopy. In this paper we present a new image based approach for semi-automatically guidance of a needle or surgical tool during percutaneous procedures and is based on a series of granted and pending US patent applications. It is a simple and accurate method which requires no prior calibration or registration. Therefore, no additional sensors (infrared, laser, ultrasound, MRI, etc), no stereotactic frame and no additional calibration phantom is needed. Our technique provides accurate 3D alignment of the tool with respect to an anatomic target and estimates the required insertion depth. We implemented and verified this method with three different medical robots at the Computer Integrated Surgery (CIS) Lab at the Johns Hopkins University. First tests were performed using a CCD-camera and a mobile uniplanar X-ray fluoroscope as imaging modality. We used small metal balls of 4 mm in diameter as target points. These targets were place 60 to 70 mm deep inside a test-phantom. Our method led to correct insertions with mean deviation of 0.20 mm with CCD camera and mean deviation of about 1.5 mm in clinical surrounding with an old X-ray imaging system, where the images were not of best quality. These promising results present this method as a serious alternative to other needle placement techniques, which require cumbersome and time consuming calibration procedures.

Original languageEnglish (US)
Pages (from-to)270-281
Number of pages12
JournalProceedings of SPIE - The International Society for Optical Engineering
Volume3976
StatePublished - Jan 1 2000
EventMedical Imaging 2000: Image Display and Visualization - San Diego, CA, USA
Duration: Feb 13 2000Feb 15 2000

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this