arXiv:2604.05908cs.CV2026-04

分离光照与材质,让不同时间拍摄的场景更一致。

Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction

  • 将背景外观分解为材质和光照两部分,分别建模。
  • 在Argoverse 2和Waymo数据集上比基线提升0.98 dB PSNR。
  • 适合自动驾驶仿真与数字孪生中的多时段重建任务。

多时段场景重建对高保真自动驾驶仿真与数字孪生构建至关重要,需融合不同时刻拍摄的多个序列。主要挑战在于光照与环境变化导致的外观不一致,尽管几何结构相同。本文提出ADM-GS(Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction),通过显式分解静态背景的外观来缓解跨时段外观混淆。对于静态背景,将外观分解为与时段无关的材质(体现内在属性)和依赖时段的光照(捕捉照明变化)。具体地,设计一种神经光场,采用频率分离的混合编码策略,结合表面法向与显式反射向量,分别建模低频漫反射光照与高频镜面反射。在Argoverse 2与Waymo Open数据集上的定量评估表明,本方法在多时段实验中相较现有基于潜在变量的基线提升0.98 dB PSNR,且跨时段外观更一致。代码将开源于https://github.com/IRMVLab/ADM-GS。

原文摘要 · Abstract (English)

Multi-traversal scene reconstruction is important for high-fidelity autonomous driving simulation and digital twin construction. This task involves integrating multiple sequences captured from the same geographical area at different times. In this context, a primary challenge is the significant appearance inconsistency across traversals caused by varying illumination and environmental conditions, despite the shared underlying geometry. This paper presents ADM-GS (Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction), a framework that applies an explicit appearance decomposition to the static background to alleviate appearance entanglement across traversals. For the static background, we decompose the appearance into traversal-invariant material, representing intrinsic material properties, and traversal-dependent illumination, capturing lighting variations. Specifically, we propose a neural light field that utilizes a frequency-separated hybrid encoding strategy. By incorporating surface normals and explicit reflection vectors, this design separately captures low-frequency diffuse illumination and high-frequency specular reflections. Quantitative evaluations on the Argoverse 2 and Waymo Open datasets demonstrate the effectiveness of ADM-GS. In multi-traversal experiments, our method achieves a +0.98 dB PSNR improvement over existing latent-based baselines while producing more consistent appearance across traversals. Code will be available at https://github.com/IRMVLab/ADM-GS.

3D重建光照建模数字孪生GS

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。