Direct global adjustment methods for endoscopic mosaicking

Sharmishtaa Seshamania, Michael D. Smith, Jason J. Corso, Marcus O. Filipovich, Ananth Natarajan, Gregory D. Hagera

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Scopus citations


Endoscopy is an invaluable tool for several surgical and diagnostic applications. It permits minimally invasive visualization of internal structures thus involving little or no injury to internal structures. This method of visualization however restricts the size of the imaging device and therefore compromises on the field of view captured in a single image. The problem of a narrow field of view can be solved by capturing video sequences and stitching them to generate a mosaic of the scene under consideration. Registration of images in the sequence is therefore a crucial step. Existing methods compute frame-to-frame registration estimates and use these to resample images in order to generate a mosaic. The complexity of the appearance of internal structures and accumulation of registration error in frame to frame estimates however can be large enough to cause a cumulative drift that can misrepresent the scene. These errors can be reduced by application of global adjustment schemes. In this paper, we present a set of techniques for overcoming this problem of drift for pixel based registration in order to achieve global consistency of mosaics. The algorithm uses the frame-to-frame estimate as an initialization and subsequently corrects these estimates by setting up a large scale optimization problem which simultaneously solves for all corrections of estimates. In addition we set up a graph and introduce loop closure constraints in order to ensure consistency of registration. We present our method and results in semi global and fully global graph based adjustment methods as well as validation of our results.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2009
Subtitle of host publicationVisualization, Image-Guided Procedures, and Modeling
StatePublished - 2009
EventMedical Imaging 2009: Biomedical Applications in Molecular, Structural, and Functional Imaging - Lake Buena Vista, FL, United States
Duration: Feb 8 2009Feb 10 2009

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


OtherMedical Imaging 2009: Biomedical Applications in Molecular, Structural, and Functional Imaging
Country/TerritoryUnited States
CityLake Buena Vista, FL


  • Data integration for the clinic/or
  • Endoscopic procedures
  • Registration
  • Visualization

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging


Dive into the research topics of 'Direct global adjustment methods for endoscopic mosaicking'. Together they form a unique fingerprint.

Cite this