TY - GEN
T1 - Light field assisted stereo matching using depth from focus and image-guided cost-volume filtering
AU - Kowalczuk, Jȩdrzej
AU - Psota, Eric T.
AU - Pérez, Lance C.
PY - 2012
Y1 - 2012
N2 - Light field photography advances upon current digital imaging technology by making it possible to adjust focus after capturing a photograph. This capability is enabled by an array of microlenses mounted above the image sensor, allowing the camera to simultaneously capture both light intensity and approximate angle of incidence. The ability to adjust focus after capture makes light field photography well-suited for computer vision techniques that aim to determine the depth of objects in a scene, such as depth from focus/defocus. Another commonly known method for extracting depth from images is stereo matching, which seeks to obtain a disparity map linking corresponding objects that appear in both images. This disparity map, along with the known geometry of the cameras can be used to compute the depth of objects in the scene. Whereas depth from focus/defocus using traditional cameras requires multiple sequential image captures, light field cameras capture these images simultaneously, making them more suitable for use in conjunction with stereo matching. A method is presented that combines both light field photography and stereo matching to achieve an enhanced disparity map. This joint approach takes advantage of the unique strengths of both methods to produce a result that is more accurate than either method produces in isolation.
AB - Light field photography advances upon current digital imaging technology by making it possible to adjust focus after capturing a photograph. This capability is enabled by an array of microlenses mounted above the image sensor, allowing the camera to simultaneously capture both light intensity and approximate angle of incidence. The ability to adjust focus after capture makes light field photography well-suited for computer vision techniques that aim to determine the depth of objects in a scene, such as depth from focus/defocus. Another commonly known method for extracting depth from images is stereo matching, which seeks to obtain a disparity map linking corresponding objects that appear in both images. This disparity map, along with the known geometry of the cameras can be used to compute the depth of objects in the scene. Whereas depth from focus/defocus using traditional cameras requires multiple sequential image captures, light field cameras capture these images simultaneously, making them more suitable for use in conjunction with stereo matching. A method is presented that combines both light field photography and stereo matching to achieve an enhanced disparity map. This joint approach takes advantage of the unique strengths of both methods to produce a result that is more accurate than either method produces in isolation.
KW - Depth from focus
KW - Light field photography
KW - Stereo correspondence
KW - Stereo matching
UR - http://www.scopus.com/inward/record.url?scp=84873292175&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84873292175&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84873292175
SN - 9781601322258
T3 - Proceedings of the 2012 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2012
SP - 1114
EP - 1119
BT - Proceedings of the 2012 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2012
T2 - 2012 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2012
Y2 - 16 July 2012 through 19 July 2012
ER -