GMLight: Lighting Estimation via Geometric Distribution Approximation

Inferring the scene illumination from a single image is an essential yet challenging task in computer vision and computer graphics. Existing works estimate lighting by regressing representative illumination parameters or generating illumination maps directly. However, these methods often suffer from...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on image processing 2022-01, Vol.31, p.1-1
Main Authors: Zhan, Fangneng, Yu, Yingchen, Zhang, Changgong, Wu, Rongliang, Hu, Wenbo, Lu, Shijian, Ma, Feiying, Xie, Xuansong, Shao, Ling
Format: Article
Language:English
Subjects:
Computer graphics
Computer vision
Costs
Estimation
Generative Adversarial Networks
Geometric accuracy
Geometry
Harmonic analysis
Illumination
Image Synthesis
Light distribution
Light sources
Lighting
Lighting Estimation
Luminance distribution
Luminous intensity
Parameters
Regression
Three-dimensional displays
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Inferring the scene illumination from a single image is an essential yet challenging task in computer vision and computer graphics. Existing works estimate lighting by regressing representative illumination parameters or generating illumination maps directly. However, these methods often suffer from poor accuracy and generalization. This paper presents Geometric Mover's Light (GMLight), a lighting estimation framework that employs a regression network and a generative projector for effective illumination estimation. We parameterize illumination scenes in terms of the geometric light distribution, light intensity, ambient term, and auxiliary depth, which can be estimated by a regression network. Inspired by the earth mover's distance, we design a novel geometric mover's loss to guide the accurate regression of light distribution parameters. With the estimated light parameters, the generative projector synthesizes panoramic illumination maps with realistic appearance and high-frequency details. Extensive experiments show that GMLight achieves accurate illumination estimation and superior fidelity in relighting for 3D object insertion. The codes are available at https://github.com/fnzhan/Illumination-Estimation.
ISSN:1057-7149
1941-0042
DOI:10.1109/TIP.2022.3151997