让3D高斯点云在野外场景中更稳定,能自动生成逼真光照和外观。
WilLaGS: Latent-Conditional 3D Appearance Fields for Robust Gaussian Splatting In-the-Wild

- 用连续潜空间建模全局外观,支持动态光照变化
- 生成可变的三平面特征,还原局部光照细节
- 自监督感知掩码过滤瞬时干扰,适合复杂户外场景
3D高斯点云(3DGS)可实现实时、高质量渲染,但在开放环境(in-the-wild)中面临剧烈外观变化和瞬时物体破坏多视角一致性的问题。现有方法受限于独立离散的嵌入表示,难以捕捉连续环境变化或建模空间变化的局部光照。为此,我们提出统一框架WilLaGS,实现开放环境下鲁棒的3D场景重建与生成式外观合成。具体地,引入基于β-VAE的生成外观模型,学习结构化的连续全局外观流形;以潜码为条件,构建3D神经外观场,生成动态三平面特征以编码空间变化的局部光照。此外,设计自监督感知掩码机制,通过教师-学生(EMA)架构提取稳定场景共识,利用感知差异识别不一致区域。多数据集实验证明,WilLaGS在重建质量与新视角外观合成上达到领先水平,同时保持实时渲染效率。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) delivers real-time and high-fidelity rendering but remains challenged by unconstrained in-the-wild scenes, where drastic appearance variations and transient objects violate multi-view consistency. Existing methods are fundamentally limited by independent and discrete embeddings that struggle to capture continuous environmental changes or model spatially-varying local illumination. To address these limitations, we propose \textbf{WilLaGS}, a unified framework for robust 3D scene reconstruction and generative appearance synthesis under unconstrained settings. Specifically, we introduce a generative appearance model where a $β$-VAE learns a structured and continuous manifold of global appearance. Conditioned on the latent code, we construct a 3D neural appearance field that generates dynamic Tri-Plane features to encode spatially-varying local illumination effects. Furthermore, to suppress transient artifacts, we present a self-supervised perceptual masking mechanism that leverages a Teacher-Student (EMA) architecture to derive a stable scene consensus, robustly identifying inconsistent regions via perceptual discrepancies. Extensive experiments on multiple datasets demonstrate that \textbf{WilLaGS} achieves state-of-the-art performance in reconstruction quality and novel view appearance synthesis, while maintaining real-time rendering efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。