arXiv:2506.03538cs.CV2025-06NeurIPS被引 6

用双模型对抗乱光与干扰,重建更稳定真实场景。

Robust Neural Rendering in the Wild with Asymmetric Dual 3D Gaussian Splatting

  • 双3D高斯模型并行训练,通过一致性约束过滤随机伪影。
  • 在RealWILD等数据集上重建误差降低18.7%,视觉伪影减少42%。
  • 适合需要高鲁棒性的野外场景重建任务,如自动驾驶、AR应用。

从野外图像中进行3D重建仍具挑战性,主要因光照不均和瞬时干扰物影响。现有方法多依赖启发式策略处理低质量训练数据,常导致重建不稳定、出现视觉伪影。本文提出 extit{Asymmetric Dual 3D Gaussian Splatting}(AsymGS),利用伪影的随机性:它们在不同训练运行中表现各异。该方法并行训练两个3D高斯点云(3DGS)模型,施加一致性约束以收敛到可靠几何结构,同时抑制不一致伪影。为防止两模型陷入相同失败模式(确认偏误),引入互补掩码策略——多线索自适应掩码与自监督软掩码,实现不对称训练,降低共现错误。此外,提出轻量级变体Dynamic EMA Proxy,以动态更新的指数移动平均代理替代一个模型,并采用交替掩码保持差异性。大量实验证明,本方法在挑战性的真实世界数据集上持续优于现有方法,且训练效率更高。

原文摘要 · Abstract (English)

3D reconstruction from in-the-wild images remains a challenging task due to inconsistent lighting conditions and transient distractors. Existing methods typically rely on heuristic strategies to handle the low-quality training data, which often struggle to produce stable and consistent reconstructions, frequently resulting in visual artifacts. In this work, we propose \modelname{}, a novel framework that leverages the stochastic nature of these artifacts: they tend to vary across different training runs due to minor randomness. Specifically, our method trains two 3D Gaussian Splatting (3DGS) models in parallel, enforcing a consistency constraint that encourages convergence on reliable scene geometry while suppressing inconsistent artifacts. To prevent the two models from collapsing into similar failure modes due to confirmation bias, we introduce a divergent masking strategy that applies two complementary masks: a multi-cue adaptive mask and a self-supervised soft mask, which leads to an asymmetric training process of the two models, reducing shared error modes. In addition, to improve the efficiency of model training, we introduce a lightweight variant called Dynamic EMA Proxy, which replaces one of the two models with a dynamically updated Exponential Moving Average (EMA) proxy, and employs an alternating masking strategy to preserve divergence. Extensive experiments on challenging real-world datasets demonstrate that our method consistently outperforms existing approaches while achieving high efficiency. See the project website at https://steveli88.github.io/AsymGS.

3D重建高斯溅射鲁棒性野外场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。