arXiv:2602.21820cs.CV2026-02

用几何光照图统一生成阴影与重光照,让虚拟光影更真实。

Joint Shadow Generation and Relighting via Light-Geometry Interaction Maps

  • 提出光照-几何交互图,从2.5D深度图推导光照遮蔽关系。
  • 在合成与真实图像上显著提升阴影与光照的一致性与逼真度。
  • 适合做图像生成、影视特效的开发者,尤其关注光影真实性的场景。

我们提出光照-几何交互(LGI)图,一种新颖的表示方法,通过单目深度图编码光照感知的遮挡关系。与需要完整3D重建的光线追踪不同,LGI能可靠且准确地捕捉关键的光照-阴影交互,仅需现成的2.5D深度图预测即可计算。LGI显式关联光照方向与几何结构,提供物理启发的先验,约束生成模型。缺乏此先验时,生成模型常产生漂浮阴影、光照不一致及不合理阴影几何。基于该表示,我们构建了统一的阴影生成与重光照流水线,不同于以往将二者视为独立任务的方法,捕捉了光照与阴影之间的内在耦合,对建模间接效应至关重要。通过将LGI嵌入桥接匹配生成骨干网络,降低歧义并强制实现物理一致的光照-阴影推理。为支持有效训练,我们构建了首个大规模联合阴影与重光照基准数据集,涵盖反射、透明和复杂互反射。实验表明,在合成与真实图像上均显著提升真实感与一致性。LGI因此连接了几何启发的渲染与生成建模,实现了高效、物理一致的阴影生成与重光照。

原文摘要 · Abstract (English)

We propose Light-Geometry Interaction (LGI) maps, a novel representation that encodes light-aware occlusion from monocular depth. Unlike ray tracing, which requires full 3D reconstruction, LGI captures essential light-shadow interactions reliably and accurately, computed from off-the-shelf 2.5D depth map predictions. LGI explicitly ties illumination direction to geometry, providing a physics-inspired prior that constrains generative models. Without such prior, these models often produce floating shadows, inconsistent illumination, and implausible shadow geometry. Building on this representation, we propose a unified pipeline for joint shadow generation and relighting - unlike prior methods that treat them as disjoint tasks - capturing the intrinsic coupling of illumination and shadowing essential for modeling indirect effects. By embedding LGI into a bridge-matching generative backbone, we reduce ambiguity and enforce physically consistent light-shadow reasoning. To enable effective training, we curated the first large-scale benchmark dataset for joint shadow and relighting, covering reflections, transparency, and complex interreflections. Experiments show significant gains in realism and consistency across synthetic and real images. LGI thus bridges geometry-inspired rendering with generative modeling, enabling efficient, physically consistent shadow generation and relighting.

阴影生成光照建模生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。