Variational image-based rendering with gradient constraints

Multi-view image-based rendering consists in generating a novel view of a scene from a set of source views. In general, this works by first doing a coarse 3D reconstruction of the scene, and then using this reconstruction to establish correspondences between source and target views, followed by blen...

Full description

Saved in:
Bibliographic Details
Main Authors: Nieto, Gregoire, Devernay, Frederic, Crowley, James
Format: Conference Proceeding
Language:English
Subjects:
Cameras
Computational Photography
Computer Graphics
Geometry
Image reconstruction
Image resolution
Image-Based Rendering
Laplace equations
Rendering (computer graphics)
Three-dimensional displays
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Multi-view image-based rendering consists in generating a novel view of a scene from a set of source views. In general, this works by first doing a coarse 3D reconstruction of the scene, and then using this reconstruction to establish correspondences between source and target views, followed by blending the warped views to get the final image. Unfortunately, discontinuities in the blending weights, due to scene geometry or camera placement, result in artifacts in the target view. In this paper, we show how to avoid these artifacts by imposing additional constraints on the image gradients of the novel view. We propose a variational framework in which an energy functional is derived and optimized by iteratively solving a linear system. We demonstrate this method on several structured and unstructured multi-view datasets, and show that it numerically outperforms state-of-the-art methods, and eliminates artifacts that result from visibility discontinuities.
ISSN:2379-1780
DOI:10.1109/IC3D.2016.7823449