为3D重建提供可信赖的不确定性估计,让模型自知何时该被信任。
Trust It or Not: Evidential Uncertainty for Feed-Forward 3D Reconstruction with Trust3R

- 用证据不确定性框架生成每点的置信度,支持概率解释。
- 在ScanNet++上使不确定性排序误差降低41%,覆盖更准确。
- 轻量设计适合下游几何任务中动态加权,提升可靠性。
几何基础模型有望实现从未标定图像中无约束地进行密集三维重建。然而,当前前馈设计中的置信度评分多为启发式方法,缺乏概率解释,且难以指出预测几何的可信区域与程度。为此,我们提出Trust3R,一种面向前馈3D重建的轻量级证据不确定性框架。Trust3R结合门控残差均值修正与正态逆威沙特证据头,生成每点几何不确定性的闭式多元学生t分布。该设计在增加少量推理开销的前提下,提供概率严谨的点云不确定性估计。我们在多样化的室内外基准上评估,对比了MASt3R内置置信图及常见不确定性感知基线(包括单次异方差回归和基于采样的方法如MC dropout、深度集成)。实验表明,Trust3R持续提升风险覆盖率与稀疏化性能,普遍改善几何精度。其不确定性排序能力更强,在ScanNet++上实现25%更低的AURC与41%更低的AUSE,为下游几何流水线中的不确定性加权提供实用的可靠性信号。
原文摘要 · Abstract (English)
Geometric foundation models hold promise for unconstrained dense geometry prediction from uncalibrated images. However, in current feed-forward designs, their predicted confidence scores are heuristic, lack probabilistic interpretation, and often fail to indicate where and how much the predicted geometry can be trusted. To address this gap, we present Trust3R, a lightweight evidential uncertainty framework for feed-forward 3D reconstruction. Trust3R combines gated residual mean refinement with a Normal-Inverse-Wishart evidential head, yielding a closed-form multivariate Student-t distribution for per-point geometric uncertainty. This design provides probabilistically grounded pointmap uncertainty estimates while adding moderate inference overhead. We evaluate on diverse indoor and outdoor benchmarks and compare against MASt3R's built-in confidence map as well as common uncertainty-aware baselines spanning single-pass heteroscedastic regression and sampling-based methods such as MC dropout and deep ensembles. Experimental results show that Trust3R consistently improves risk-coverage and sparsification, and generally improves geometric accuracy. These gains are reflected in stronger uncertainty ranking across benchmarks, with 25% lower AURC and 41% lower AUSE on ScanNet++, providing a practical reliability signal for uncertainty-aware weighting in downstream geometry pipelines. The project page and code are available at https://trust3r-z.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。