arXiv:2607.13656cs.CV2026-07

无需成对数据,通过物理引导实现室内光照自由调控

FreeLit: Paired-Free Indoor Relighting via Physics-Guided Diffusion

论文配图:FreeLit: Paired-Free Indoor Relighting via Physics-Guided Diffusion
图 1 · 摘自论文原文
  • 利用场景固有属性构建物理光照先验,生成结构化光图
  • 在低光照下仍保持稳定,相对基线反射率误差降低37%
  • 适合需要精准光照控制的虚拟拍摄与数字孪生应用

基于图像的室内场景光照重置因杂乱几何与局部照明的复杂交互而极具挑战,需精确建模光源位置、颜色和强度。现有数据驱动方法依赖成对多光照数据集隐式学习该关系,但数据成本高且难以扩展,无法实现光源级精确控制。反向渲染方法虽减少数据依赖,却在复杂条件下内在估计鲁棒性不足。本文提出FreeLit,一种无需成对监督的可控室内光照重置框架,显式操控光源位置、颜色与强度。我们不依赖成对标注,而是从场景内在属性构建物理引导的光照先验,生成结构化光图与伪重光照图像以指导扩散合成。为应对低光照下内在估计不稳定性,引入光照引导的内在稳定策略,通过结构感知蒸馏与一致性约束实现光照不变反射率。此外,提出面向可控性的评估指标,量化与用户指定光照颜色和强度的对齐程度。实验表明,FreeLit在无成对监督下实现稳定、物理一致且可控的光照重置,在低光照室内场景中表现更优。

原文摘要 · Abstract (English)

Image-based indoor scene relighting remains challenging due to the complex interplay between cluttered geometry and local illumination, requiring precise modeling of light position, color, and intensity. Existing data-driven methods implicitly learn this relationship via paired multi-illumination datasets. Nevertheless, this data is costly and fails to scale, which is essential for accurate light-source-level control. Conversely, inverse-rendering methods reduce the data dependency by incorporating physical priors; however, they lack the robustness of intrinsic estimation in challenging conditions. In this paper, we present FreeLit, a paired-free framework for controllable indoor relighting that explicitly manipulates light-source location, color, and intensity. Instead of relying on paired supervision, we construct a physics-guided illumination prior from intrinsic scene properties, generating a structured lightmap along with a pseudo-relit image to guide diffusion-based synthesis. To address instability in intrinsic estimation, especially in low-light scenes, we introduce a relighting-guided intrinsic stabilization strategy that enforces illumination-invariant reflectance through structure-aware distillation and consistency constraints. Furthermore, we propose controllability-oriented evaluation metrics to quantify alignment with user-specified illumination color and intensity. Experimental results demonstrate that FreeLit achieves stable, physically consistent, and controllable relighting, with improved robustness in low-light indoor scenes, without requiring paired supervision.

光照重置扩散模型物理引导可控生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。