arXiv:2512.15632cs.CVcs.GR2025-12

提出可物理模拟的全天候天空模型AllSky,实现真实光照再现

Towards Physically-Based Sky-Modeling For Image Based Lighting

  • 直接从实测HDR影像学习,构建可控制太阳与云层的天空模型
  • 支持22档动态范围,生成环境图光照与真实拍摄一致
  • 揭示现有深度学习天空模型无法替代实测HDR,适合影视渲染与虚拟现实

精确的环境图是实现户外场景逼真光照渲染的关键,广泛应用于视觉艺术、沉浸式虚拟现实及工程科学领域。尽管近年深度神经网络生成的高动态范围图像(HDRI)视觉质量显著提升,但现有DNN天空模型生成的环境图在色调、阴影和光照方面仍无法还原实测HDR影像的真实效果。本文指出,当前研究在高动态范围(FDR)重建上存在根本性不足,难以同时满足保真度与22档动态范围要求。为此,我们提出AllSky——一个基于实测高清辐射图像训练的灵活全天气天空模型,系统研究输入模态、色调映射、条件控制与评估方法。用户可通过控制太阳位置和云层分布,直观调节环境图。实验表明,现有DNN天空模型不可替代实测HDR或参数化天空模型,其局限性严重制约下游应用中的可扩展性与光照准确性。

原文摘要 · Abstract (English)

Accurate environment maps are a key component for rendering photorealistic outdoor scenes with coherent illumination. They enable captivating visual arts, immersive virtual reality, and a wide range of engineering and scientific applications. Recent works have extended sky-models to be more comprehensive and inclusive of cloud formations but, as we demonstrate, existing methods fall short in faithfully recreating natural skies. Though in recent years the visual quality of DNN-generated High Dynamic Range Imagery (HDRI) has greatly improved, the environment maps generated by DNN sky-models do not re-light scenes with the same tones, shadows, and illumination as physically captured HDR imagery. In this work, we demonstrate progress in HDR literature to be tangential to sky-modelling as current works cannot support both photorealism and the 22 f-stops required for the Full Dynamic Range (FDR) of outdoor illumination. We achieve this by proposing AllSky, a flexible all-weather sky-model learned directly from physically captured HDRI which we leverage to study the input modalities, tonemapping, conditioning, and evaluation of sky-models. Per user-controlled positioning of the sun and cloud formations, AllSky expands on current functionality by allowing for intuitive user control over environment maps and achieves state-of-the-art sky-model performance. Through our proposed evaluation, we demonstrate existing DNN sky-models are not interchangeable with physically captured HDRI or parametric sky-models, with current limitations being prohibitive of scalability and accurate illumination in downstream applications

天空建模光照重建高动态范围真实感渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。