arXiv:2604.10994cs.CV2026-04被引 1

利用动态物体辅助光照重建,提升真实场景中材质与光照的分离精度。

LumiMotion: Improving Gaussian Relighting with Scene Dynamics

  • 通过运动区域作为监督信号,解耦材质与光照变化
  • 相比基线方法,反照率估计提升23%,场景重光照提升15%
  • 首个支持任意动态场景的高斯溅射逆渲染方法,适合真实世界应用

在3D重建中,逆渲染(恢复场景光照与材质属性)是核心问题。现有基于高斯溅射的方法多针对静态场景,常假设简化或中等复杂度光照,以避免阴影与表面外观混淆,限制了其在真实环境下的材质与光照分离能力。本文提出LumiMotion,首次利用动态区域(随时间运动的场景部分)作为逆渲染的监督信号。运动使同一表面在不同光照下呈现,提供更强线索以解耦材质与光照。实验表明,相较最优基线,该方法在反照率估计上提升LPIPS 23%,在场景重光照上提升15%。我们引入一种新型动态2D高斯溅射表示,结合约束机制,促使动态区域形变而静态区域保持稳定,对正确优化反照率至关重要。此外,我们发布首个合成基准数据集,包含5个场景、4种光照条件,每种均有静态与动态版本,首次实现动态环境下逆渲染方法的系统评估。项目页面:https://joaxkal.github.io/LumiMotion/

原文摘要 · Abstract (English)

In 3D reconstruction, the problem of inverse rendering, namely recovering the illumination of the scene and the material properties, is fundamental. Existing Gaussian Splatting-based methods primarily target static scenes and often assume simplified or moderate lighting to avoid entangling shadows with surface appearance. This limits their ability to accurately separate lighting effects from material properties, particularly in real-world conditions. We address this limitation by leveraging dynamic elements - regions of the scene that undergo motion - as a supervisory signal for inverse rendering. Motion reveals the same surfaces under varying lighting conditions, providing stronger cues for disentangling material and illumination. This thesis is supported by our experimental results which show we improve LPIPS by 23% for albedo estimation and by 15% for scene relighting relative to next-best baseline. To this end, we introduce LumiMotion, the first Gaussian-based approach that leverages dynamics for inverse rendering and operates in arbitrary dynamic scenes. Our method learns a dynamic 2D Gaussian Splatting representation that employs a set of novel constraints which encourage the dynamic regions of the scene to deform, while keeping static regions stable. As we demonstrate, this separation is crucial for correct optimization of the albedo. Finally, we release a new synthetic benchmark comprising five scenes under four lighting conditions, each in both static and dynamic variants, for the first time enabling systematic evaluation of inverse rendering methods in dynamic environments and challenging lighting. Link to project page: https://joaxkal.github.io/LumiMotion/

逆渲染高斯溅射动态场景光照分离

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。