arXiv:2604.03462cs.CVcs.GR2026-04

让驾驶场景3D高斯点云可随意换光照天气,保持清晰还原。

SpectralSplat: Appearance-Disentangled Feed-Forward Gaussian Splatting for Driving Scenes

  • 用共享MLP分离几何与外观,通过全局外观嵌入控制颜色变化。
  • 在多时段数据上实现外观可控迁移,重渲染一致性提升显著。
  • 适合需要跨环境一致渲染的自动驾驶场景重建任务。

前馈式3D高斯点云方法在自动驾驶场景重建中表现优异,但将几何结构与瞬时外观(如光照、天气、时段)耦合,导致无法实现重布光、外观迁移及多遍采集数据的一致渲染。本文提出SpectralSplat,通过在前馈框架内解耦外观与几何:将颜色预测分解为与外观无关的基流和受外观条件调节的适配流,两者均由基于DINOv2特征生成的全局外观嵌入驱动的共享MLP生成。为强化解耦,采用融合物理分解与扩散生成的混合重布光管道生成配对观测,并以互补一致性、重建、跨外观及基色损失联合监督。此外引入可适应外观的时间历史存储,保存与外观无关的特征,使累积高斯点可在任意目标外观下重渲染。实验表明,SpectralSplat在保持基线重建质量的同时,支持可控外观迁移与驾驶序列间的时序一致重布光。

原文摘要 · Abstract (English)

Feed-forward 3D Gaussian Splatting methods have achieved impressive reconstruction quality for autonomous driving scenes, yet they entangle scene geometry with transient appearance properties such as lighting, weather, and time of day. This coupling prevents relighting, appearance transfer, and consistent rendering across multi-traversal data captured under varying environmental conditions. We present SpectralSplat, a method that disentangles appearance from geometry within a feed-forward Gaussian Splatting framework. Our key insight is to factor color prediction into an appearance-agnostic base stream and and appearance-conditioned adapted stream, both produced by a shared MLP conditioned on a global appearance embedding derived from DINOv2 features. To enforce disentanglement, we train with paired observations generated by a hybrid relighting pipeline that combines physics-based intrinsic decomposition with diffusion based generative refinement, and supervise with complementary consistency, reconstruction, cross-appearance, and base color losses. We further introduce an appearance-adaptable temporal history that stores appearance-agnostic features, enabling accumulated Gaussians to be re-rendered under arbitrary target appearances. Experiments demonstrate that SpectralSplat preserves the reconstruction quality of the underlying backbone while enabling controllable appearance transfer and temporally consistent relighting across driving sequences.

3D重建高斯点云外观解耦自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。