提出多视角不确定性感知方法,让神经辐射场更鲁棒地应对动态干扰。
MU-GeNeRF: Multi-view Uncertainty-guided Generalizable Neural Radiance Fields for Distractor-aware Scene

- 通过源视图与目标视图双重不确定性建模,区分结构变化与真实干扰
- 在多个数据集上优于现有泛化神经辐射场,接近专场景最优效果
- 适合需要处理动态物体的3D重建任务,如自动驾驶、AR应用
泛化神经辐射场(GeNeRF)可在稀疏视图下实现高质量场景重建并推广至未见场景。但在真实环境中,瞬时干扰物会破坏跨视图结构一致性,污染监督信号,降低重建质量。现有无干扰NeRF方法依赖逐场景优化,并基于单视图重建误差估计不确定性,对GeNeRF不可靠,常将静态结构不一致误判为干扰物。为此,我们提出MU-GeNeRF,一种多视角不确定性引导的干扰感知泛化神经辐射场框架,以缓解真实场景中动态干扰带来的建模挑战。我们将干扰感知分解为两个互补的不确定性分量:源视图不确定性,捕捉因视角变化或动态因素导致的源视图间结构差异;目标视图不确定性,检测由瞬时干扰引起的目标图像观测异常。这两种不确定性分别对应不同错误来源,通过异方差重建损失融合,引导模型自适应调节监督,实现更鲁棒的干扰抑制与几何建模。大量实验表明,本方法不仅超越现有GeNeRF,且性能可媲美场景专用的无干扰NeRF。
原文摘要 · Abstract (English)
Generalizable Neural Radiance Fields (GeNeRFs) enable high-quality scene reconstruction from sparse views and can generalize to unseen scenes. However, in real-world settings, transient distractors break cross-view structural consistency, corrupting supervision and degrading reconstruction quality. Existing distractor-free NeRF methods rely on per-scene optimization and estimate uncertainty from per-view reconstruction errors, which are not reliable for GeNeRFs and often misjudge inconsistent static structures as distractors. To this end, we propose MU-GeNeRF, a Multi-view Uncertainty-guided distractor-aware GeNeRF framework designed to alleviate GeNeRF's robust modeling challenges in the presence of transient distractions. We decompose distractor awareness into two complementary uncertainty components: Source-view Uncertainty, which captures structural discrepancies across source views caused by viewpoint changes or dynamic factors; and Target-view Uncertainty, which detects observation anomalies in the target image induced by transient distractors.These two uncertainties address distinct error sources and are combined through a heteroscedastic reconstruction loss, which guides the model to adaptively modulate supervision, enabling more robust distractor suppression and geometric modeling.Extensive experiments show that our method not only surpasses existing GeNeRFs but also achieves performance comparable to scene-specific distractor-free NeRFs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。