提出新方法PRIMU,用基础形状表示误差与覆盖度,精准估计新视角不确定性。
PRIMU: Uncertainty Estimation for Novel Views in Gaussian Splatting from Primitive-Based Representations of Error and Coverage
- 基于训练视图的误差和覆盖统计,构建基础形状级别的不确定性表示
- 在深度估计和前景物体上优于现有方法,相关性显著提升
- 无需额外数据即可泛化到新场景,适合机器人与医疗等安全敏感领域
我们提出基于基础形状的不确定性表示(PRIMU),一种针对高斯点阵(Gaussian Splatting, GS)的后处理不确定性估计(UE)框架。可靠的不确定性估计对机器人、医学等安全关键领域至关重要。现有方法通常依赖高斯基元方差并借助渲染过程获取像素级不确定性。相比之下,我们通过将视图相关的训练误差与覆盖度统计投影到基元上,构建可解释的基元级误差与可见性/覆盖度表示。新视角的不确定性通过渲染这些基元级表示生成特征图,并在保留数据上通过像素级回归聚合。我们分析了不同特征图组合与回归模型的交互影响,以优化预测精度与泛化能力。PRIMU还支持有效的主动视角选择策略,直接利用不确定性特征图。此外,我们研究了将点阵分离为前景与背景区域的影响。实验表明,该方法在真实误差上具有强相关性,尤其在深度不确定性估计与前景物体上超越当前最优方法。最后,其回归模型具备跨场景泛化能力,可在无额外保留数据的情况下实现不确定性估计。
原文摘要 · Abstract (English)
We introduce Primitive-based Representations of Uncertainty (PRIMU), a post-hoc uncertainty estimation (UE) framework for Gaussian Splatting (GS). Reliable UE is essential for deploying GS in safety-critical domains such as robotics and medicine. Existing approaches typically estimate Gaussian-primitive variances and rely on the rendering process to obtain pixel-wise uncertainties. In contrast, we construct primitive-level representations of error and visibility/coverage from training views, capturing interpretable uncertainty information. These representations are obtained by projecting view-dependent training errors and coverage statistics onto the primitives. Uncertainties for novel views are inferred by rendering these primitive-level representations, producing uncertainty feature maps, which are aggregate through pixel-wise regression on holdout data. We analyze combinations of uncertainty feature maps and regression models to understand how their interactions affect prediction accuracy and generalization. PRIMU also enables an effective active view selection strategy by directly leveraging these uncertainty feature maps. Additionally, we study the effect of separating splatting into foreground and background regions. Our estimates show strong correlations with true errors, outperforming state-of-the-art methods, especially for depth UE and foreground objects. Finally, our regression models show generalization capabilities to unseen scenes, enabling UE without additional holdout data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。