Light field assisted stereo matching using depth from focus and image-guided cost-volume filtering

Jȩdrzej Kowalczuk, Eric T. Psota, Lance C. Pérez

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Light field photography advances upon current digital imaging technology by making it possible to adjust focus after capturing a photograph. This capability is enabled by an array of microlenses mounted above the image sensor, allowing the camera to simultaneously capture both light intensity and approximate angle of incidence. The ability to adjust focus after capture makes light field photography well-suited for computer vision techniques that aim to determine the depth of objects in a scene, such as depth from focus/defocus. Another commonly known method for extracting depth from images is stereo matching, which seeks to obtain a disparity map linking corresponding objects that appear in both images. This disparity map, along with the known geometry of the cameras can be used to compute the depth of objects in the scene. Whereas depth from focus/defocus using traditional cameras requires multiple sequential image captures, light field cameras capture these images simultaneously, making them more suitable for use in conjunction with stereo matching. A method is presented that combines both light field photography and stereo matching to achieve an enhanced disparity map. This joint approach takes advantage of the unique strengths of both methods to produce a result that is more accurate than either method produces in isolation.

Original languageEnglish (US)
Title of host publicationProceedings of the 2012 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2012
Pages1114-1119
Number of pages6
StatePublished - Dec 1 2012
Event2012 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2012 - Las Vegas, NV, United States
Duration: Jul 16 2012Jul 19 2012

Publication series

NameProceedings of the 2012 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2012
Volume2

Other

Other2012 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2012
CountryUnited States
CityLas Vegas, NV
Period7/16/127/19/12

Keywords

  • Depth from focus
  • Light field photography
  • Stereo correspondence
  • Stereo matching

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Light field assisted stereo matching using depth from focus and image-guided cost-volume filtering'. Together they form a unique fingerprint.

  • Cite this

    Kowalczuk, J., Psota, E. T., & Pérez, L. C. (2012). Light field assisted stereo matching using depth from focus and image-guided cost-volume filtering. In Proceedings of the 2012 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2012 (pp. 1114-1119). (Proceedings of the 2012 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2012; Vol. 2).