Real-time 3D surface tracking and its applications

Nicholas A. Ramey, Jason J. Corso, William W. Lau, Darius Burschka, Gregory D. Hager

Research output: Contribution to journalConference article

Abstract

We present a general technique for directly estimating and tracking surfaces from a stream of rectified stereo pairs in real-time. These techniques are based on the iterative updating of surface representations directly from image information and use no disparity search except during initialization. We perform the tracking through an iteratively re-weighted least squares minimization wherein a mask is incorporated to increase robustness to occlusion. The algorithms are formulated for a general family of linear in parameters surface models and discussed for the cases of planar surfaces and tensor product surfaces. These algorithms have been implemented on standard hardware and run at or near frame rate, with accuracy on the order of 1/20 of a pixel. We discuss applications of the technique including mobile robot localization, general deforming surface tracking, and biometry of biological surfaces.

Original languageEnglish (US)
Article number1384825
JournalIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Volume2004-January
Issue numberJanuary
DOIs
StatePublished - Jan 1 2004
Event2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2004 - Washington, United States
Duration: Jun 27 2004Jul 2 2004

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Cite this