Color-based hybrid reconstruction for endoscopy

Haluk N. Tokgozoglu, Eric M. Meisner, Michael Kazhdan, Gregory D. Hager

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Three-dimensional (3D) reconstruction of images acquired during endoscopy presents an enormous opportunity for computer vision, however reconstructing geometry from such images is challenging due to lack of features. Shape From Shading (SFS) is an approach to obtain the shape of an object from a single image, but most current methods that are applicable to endoscopy are susceptible to errors caused by surfaces with differing reflectance characteristics. Another weakness of SFS is that while it has high frequency detail information, its shape is inaccurate in the low frequency sense, which makes it difficult to compare to ground truth. Multiview reconstruction (MR), on the other hand, yields reliable shape but lacks details. In this paper, we propose a novel method to perform SFS using a color projection that minimizes intensity variance caused by differing surface characteristics. We then combine the resulting reconstruction with a multiview reconstruction obtained from bundle adjustment, and combine the two reconstructions using an approach inspired by Laplacian surface editing to get a reconstruction that is accurate both in details and overall shape. We compare our results to ground truth to show improvement over existing approaches.

Original languageEnglish (US)
Title of host publication2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2012
Pages8-15
Number of pages8
DOIs
StatePublished - Aug 20 2012
Event2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2012 - Providence, RI, United States
Duration: Jun 16 2012Jun 21 2012

Publication series

NameIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
ISSN (Print)2160-7508
ISSN (Electronic)2160-7516

Other

Other2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2012
CountryUnited States
CityProvidence, RI
Period6/16/126/21/12

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Color-based hybrid reconstruction for endoscopy'. Together they form a unique fingerprint.

Cite this