Oriented Light-Field Windows for Scene Flow

2D spatial image windows are used for comparing pixel values in computer vision applications such as correspondence for optical flow and 3D reconstruction, bilateral filtering, and image segmentation. However, pixel window comparisons can suffer from varying defocus blur and perspective at different...

Full description

Saved in:
Bibliographic Details
Main Authors: Srinivasan, Pratul P., Tao, Michael W., Ren Ng, Ramamoorthi, Ravi
Format: Conference Proceeding
Language:English
Subjects:
Cameras
Computer vision
Construction
Filtering
Filtration
Image segmentation
Optical imaging
Optical sensors
Pixels
Robustness
Three dimensional
Three-dimensional displays
Two dimensional
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:2D spatial image windows are used for comparing pixel values in computer vision applications such as correspondence for optical flow and 3D reconstruction, bilateral filtering, and image segmentation. However, pixel window comparisons can suffer from varying defocus blur and perspective at different depths, and can also lead to a loss of precision. In this paper, we leverage the recent use of light-field cameras to propose alternative oriented light-field windows that enable more robust and accurate pixel comparisons. For Lambertian surfaces focused to the correct depth, the 2D distribution of angular rays from a pixel remains consistent. We build on this idea to develop an oriented 4D light-field window that accounts for shearing (depth), translation (matching), and windowing. Our main application is to scene flow, a generalization of optical flow to the 3D vector field describing the motion of each point in the scene. We show significant benefits of oriented light-field windows over standard 2D spatial windows. We also demonstrate additional applications of oriented light-field windows for bilateral filtering and image segmentation.
ISSN:2380-7504
DOI:10.1109/ICCV.2015.399