提升3D场景重建中视点选择的稳定性与精度
SA-ResGS: Self-Augmented Residual 3D Gaussian Splatting for Next Best View Selection
- 通过自增强点云生成实现更可靠的不确定性估计
- 残差学习策略改善稀疏视角下弱贡献高斯点的训练
- 适合需要精准视点规划的动态3D重建场景
我们提出Self-Augmented Residual 3D Gaussian Splatting(SA-ResGS),一种新型框架,用于稳定不确定性量化并增强主动场景重建中下一最佳视点(NBV)选择的不确定性感知监督。通过训练视图与光栅化外推视图之间的三角化生成自增强点云(SA-Points),实现高效场景覆盖估计。在物理引导视点选择提升场景覆盖的同时,针对宽基线稀疏视图导致的欠监督高斯点问题,首次引入专为3D Gaussian Splatting设计的残差学习策略。该策略结合不确定性驱动过滤与类似丢弃和困难负样本挖掘的采样方式,增强高不确定性高斯点的梯度传播。贡献包括:(1) 物理基础的视点选择策略,促进高效均匀的场景覆盖;(2) 不确定性感知的残差监督机制,强化弱贡献高斯点的学习信号,提升不同相机分布场景下的训练稳定性和不确定性估计;(3) 通过受限视点选择与残差监督隐式缓解宽基线探索与稀疏视图模糊之间的冲突。主动视点选择实验表明,SA-ResGS在重建质量与视点选择鲁棒性上均优于现有最优方法。
原文摘要 · Abstract (English)
We propose Self-Augmented Residual 3D Gaussian Splatting (SA-ResGS), a novel framework to stabilize uncertainty quantification and enhancing uncertainty-aware supervision in next-best-view (NBV) selection for active scene reconstruction. SA-ResGS improves both the reliability of uncertainty estimates and their effectiveness for supervision by generating Self-Augmented point clouds (SA-Points) via triangulation between a training view and a rasterized extrapolated view, enabling efficient scene coverage estimation. While improving scene coverage through physically guided view selection, SA-ResGS also addresses the challenge of under-supervised Gaussians, exacerbated by sparse and wide-baseline views, by introducing the first residual learning strategy tailored for 3D Gaussian Splatting. This targeted supervision enhances gradient flow in high-uncertainty Gaussians by combining uncertainty-driven filtering with dropout- and hard-negative-mining-inspired sampling. Our contributions are threefold: (1) a physically grounded view selection strategy that promotes efficient and uniform scene coverage; (2) an uncertainty-aware residual supervision scheme that amplifies learning signals for weakly contributing Gaussians, improving training stability and uncertainty estimation across scenes with diverse camera distributions; (3) an implicit unbiasing of uncertainty quantification as a consequence of constrained view selection and residual supervision, which together mitigate conflicting effects of wide-baseline exploration and sparse-view ambiguity in NBV planning. Experiments on active view selection demonstrate that SA-ResGS outperforms state-of-the-art baselines in both reconstruction quality and view selection robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。