用深度学习生成高动态范围真实天空,光照更准更逼真。
Full Dynamic Range Sky-Modelling For Image Based Lighting
- 基于深度学习构建全动态范围天空模型,支持云和太阳位置自由控制。
- 在14EV以上高动态范围下仍保持精准光照与真实阴影,优于现有模型。
- 适合影视渲染、VR/AR和需要真实光照的工业应用。
准确的环境贴图是建模真实户外场景的关键,广泛应用于视觉艺术、沉浸式虚拟现实及科学工程领域。为减轻物理采集、物理仿真和体渲染的负担,天空模型成为快速、灵活且低成本的替代方案。近年来,深度学习使天空模型能更全面地包含云层变化,但现有方法在高分辨率下仍难以准确还原14EV以上的类不平衡太阳区域,导致光照失真、阴影偏移和色调偏差。本文提出Icarus,一种可学习全动态范围(FDR)物理捕获户外影像曝光范围的全天候天空模型。该模型支持通过用户指定太阳和云层位置进行条件生成,并扩展了当前最先进方法,实现对大气形态的文本可控纹理化。评估表明,Icarus可无缝替代FDR物理捕获影像或参数化天空模型,在图像基照明(IBL)中实现前所未有的光照准确性、逼真度、方向性(阴影)和色调表现。
原文摘要 · Abstract (English)
Accurate environment maps are a key component to modelling real-world outdoor scenes. They enable captivating visual arts, immersive virtual reality and a wide range of scientific and engineering applications. To alleviate the burden of physical-capture, physically-simulation and volumetric rendering, sky-models have been proposed as fast, flexible, and cost-saving alternatives. In recent years, sky-models have been extended through deep learning to be more comprehensive and inclusive of cloud formations, but recent work has demonstrated these models fall short in faithfully recreating accurate and photorealistic natural skies. Particularly at higher resolutions, DNN sky-models struggle to accurately model the 14EV+ class-imbalanced solar region, resulting in poor visual quality and scenes illuminated with skewed light transmission, shadows and tones. In this work, we propose Icarus, an all-weather sky-model capable of learning the exposure range of Full Dynamic Range (FDR) physically captured outdoor imagery. Our model allows conditional generation of environment maps with intuitive user-positioning of solar and cloud formations, and extends on current state-of-the-art to enable user-controlled texturing of atmospheric formations. Through our evaluation, we demonstrate Icarus is interchangeable with FDR physically captured outdoor imagery or parametric sky-models, and illuminates scenes with unprecedented accuracy, photorealism, lighting directionality (shadows), and tones in Image Based Lightning (IBL).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。