让神经辐射场自动学习相机位姿不确定性,提升复杂场景重建精度
PCM-NeRF: Probabilistic Camera Modeling for Neural Radiance Fields under Pose Uncertainty

- 将每个相机位姿建模为可学习的分布,考虑姿态估计误差
- 在存在严重异常值的场景中,几何指标优于现有方法
- 无需额外标注,适合相机姿态不准确的复杂重建任务
神经表面重建方法通常将相机位姿视为固定值,假设结构从运动(SfM)系统输出完全准确。然而当姿态估计不完美时,会导致重建结果失真或不完整。本文提出PCM-NeRF,一种基于SG-NeRF的概率化框架,在神经表面重建中引入每台相机的可学习不确定性。不同于对所有相机一视同仁地优化,我们以分布形式表示每个位姿,其均值和方差可学习,并由SfM对应质量初始化。通过不确定性正则化损失,使学习到的方差与视图置信度相关联,进而动态调节有效位姿更新速率:不确定性高的相机梯度更新被抑制,防止初始不良视角污染重建结果。该轻量机制无需修改渲染流程,开销极小。在存在严重姿态异常值的挑战性场景中,PCM-NeRF在Chamfer Distance和F-Score上持续优于当前最优方法,尤其在几何复杂结构上表现更优,且无需前景掩码。
原文摘要 · Abstract (English)
Neural surface reconstruction methods typically treat camera poses as fixed values, assuming perfect accuracy from Structure-from-Motion (SfM) systems. This assumption breaks down with imperfect pose estimates, leading to distorted or incomplete reconstructions. We present PCM-NeRF, a probabilistic framework that augments neural surface reconstruction with per-camera learnable uncertainty, built on top of SG-NeRF. Rather than treating all cameras equally throughout optimization, we represent each pose as a distribution with a learnable mean and variance, initialized from SfM correspondence quality. An uncertainty regularization loss couples the learned variance to view confidence, and the resulting uncertainty directly modulates the effective pose learning rate: uncertain cameras receive damped gradient updates, preventing poorly initialized views from corrupting the reconstruction. This lightweight mechanism requires no changes to the rendering pipeline and adds negligible overhead. Experiments on challenging scenes with severe pose outliers demonstrate that PCM-NeRF consistently outperforms state-of-the-art methods in both Chamfer Distance and F-Score, particularly for geometrically complex structures, without requiring foreground masks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。