arXiv:2607.05522cs.CVcs.AI2026-07被引 1

让3D高斯点云自带不确定性,更好判断哪些视角值得拍。

Rendering-Aware Bayesian 3D Gaussian Splatting with Native Uncertainty and Adaptive Complexity Control

论文配图:Rendering-Aware Bayesian 3D Gaussian Splatting with Native Uncertainty and Adaptive Complexity Control
图 1 · 摘自论文原文
  • 用贝叶斯方法建模每个高斯点的位置和形状分布,自动评估置信度。
  • 在固定视角预算下,比传统方法提升0.453 dB PSNR,且预测区间更准。
  • 适合需要主动选视角的场景,如机器人导航或稀缺数据采集。

3D高斯点云(3DGS)是实时新视角合成的强大表示,但其标准训练依赖点估计和人工调参,无法原生提供不确定性或合理控制复杂度。这在视角稀疏或采集预算固定时尤为不利,模型需识别弱支持几何并选择信息量大的视角。本文提出一种渲染感知的贝叶斯3DGS框架,通过渲染器生成的代理摘要,对高斯点的位置与协方差使用正态-逆威沙特(NIW)后验进行追踪。可选的狄利克雷过程扩展引入概率成分使用信号,训练流程明确区分闭式与近似推断边界。重渲染后验样本可生成原生预测不确定性,用于区间校准与主动视角选择。在16至32个视角的固定预算任务中,原生NIW采集方式相比仅评分的3成员标准集成基线,提升PSNR 0.453 dB、LPIPS -0.0146,胜出39组场景种子中的29组、13组场景均值;优于PPU风格(+0.355 dB)与NIW代理(+0.401 dB)。NIW原生区间将95%覆盖误差降低约17倍(0.046 vs. 0.796),且距离名义覆盖率约为3成员深度集成的1/10(0.047 vs. 0.454),训练成本仅为三分之一。配对分析显示,在39次场景种子运行中,尼尔夫对比标准方法提升0.030 dB PSNR,仅增加1.6%训练时间。结果表明,贝叶斯3DGS是面向决策任务(如主动视角选择)的实用概率化场景表示。

原文摘要 · Abstract (English)

3D Gaussian splatting (3DGS) is a strong representation for real-time novel-view synthesis, but its standard training pipeline relies on point estimates and hand-tuned heuristics, providing no native uncertainty or principled complexity control. This is most limiting under sparse views or fixed acquisition budgets, where a model must identify weakly supported geometry and select informative views. We introduce a rendering-aware Bayesian 3DGS framework that tracks Gaussian geometry with a Normal-Inverse-Wishart posterior over means and covariances using renderer-derived surrogate summaries. An optional Dirichlet-process extension adds a probabilistic component-usage signal, and the training schedule makes the closed-form versus approximate inference boundary explicit. Re-rendering posterior geometry samples yields native predictive uncertainty for interval calibration and active view selection. In a fixed-budget 16-to-32 active-view task, native NIW acquisition improves PSNR by +0.453 dB and LPIPS by -0.0146 over a scoring-only 3-member standard-ensemble baseline, winning 29/39 scene-seed pairs and 10/13 scene means; it also improves over PPU-style (+0.355 dB) and NIW-proxy (+0.401 dB) acquisition. NIW native intervals reduce 95% coverage error by about 17x relative to a shared proxy (0.046 vs. 0.796) and are about 10x closer to nominal coverage than a 3-member deep ensemble (0.047 vs. 0.454) at roughly one-third the training cost. As a reconstruction compatibility check, paired NIW-vs-standard analysis over 39 scene-seed runs yields +0.030 dB PSNR with 1.6% additional training time. These results position Bayesian 3DGS as a practical probabilistic scene representation for decision-facing tasks such as active view selection.

3D高斯不确定性主动学习贝叶斯

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。