LM-GAN: A Photorealistic All-Weather Parametric Sky Model

We present LM-GAN, an HDR sky model that generates photorealistic environment maps with weathered skies. Our sky model retains the flexibility of traditional parametric models and enables the reproduction of photorealistic all-weather skies with visual diversity in cloud formations. This is achieved...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-01
Main Authors: Lucas Valença, Maquignaz, Ian, Moazen, Hadi, Rishikesh Madan, Hold-Geoffroy, Yannick, Lalonde, Jean-François
Format: Article
Language:English
Subjects:
Algorithms
Atmospheric models
Illumination
Parameters
Qualitative analysis
Rendering
Sky models
Turbidity
Weather
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present LM-GAN, an HDR sky model that generates photorealistic environment maps with weathered skies. Our sky model retains the flexibility of traditional parametric models and enables the reproduction of photorealistic all-weather skies with visual diversity in cloud formations. This is achieved with flexible and intuitive user controls for parameters, including sun position, sky color, and atmospheric turbidity. Our method is trained directly from inputs fitted to real HDR skies, learning both to preserve the input's illumination and correlate it to the real reference's atmospheric components in an end-to-end manner. Our main contributions are a generative model trained on both sky appearance and scene rendering losses, as well as a novel sky-parameter fitting algorithm. We demonstrate that our fitting algorithm surpasses existing approaches in both accuracy and sky fidelity, and also provide quantitative and qualitative analyses, demonstrating LM-GAN's ability to match parametric input to photorealistic all-weather skies. The generated HDR environment maps are ready to use in 3D rendering engines and can be applied to a wide range of image-based lighting applications.
ISSN:2331-8422