用概率方法在CPU上实现高精度3D重建,还能规划最佳观测视角。
BayesFusion-SDF: Probabilistic Signed Distance Fusion with View Planning on CPU
- 将几何建模为带后验分布的稀疏高斯场,实现不确定性量化
- 在控制场景和CO3D数据集上,精度优于传统TSDF,且可输出可信度
- 全程运行于CPU,适合资源受限场景,支持主动感知决策
机器人、增强现实与数字检测的关键在于从深度观测中进行密集3D重建。传统体素融合方法(如截断有符号距离函数,TSDF)虽高效确定,但依赖启发式加权,无法系统性表达不确定性。近期神经隐式方法虽精度高,但通常需大量GPU算力优化,且决策解释性差。本文提出BayesFusion-SDF,一种以CPU为中心的概率有符号距离融合框架,将几何建模为稀疏高斯随机场,并定义体素距离的后验分布。首先用粗略的TSDF构建自适应窄带区域;随后通过异方差贝叶斯公式融合深度观测,采用稀疏线性代数与预处理共轭梯度求解;随机对角估计器快速提供后验不确定性。该方法可提取表面并基于不确定性规划下一最佳视点。在控制消融场景与CO3D物体序列上的测试表明,新方法几何精度优于TSDF基线,并为主动感知提供有效不确定性估计。该公式清晰易用,是替代高功耗神经重建的可行方案,同时保持可解释性与可预测性。
原文摘要 · Abstract (English)
Key part of robotics, augmented reality, and digital inspection is dense 3D reconstruction from depth observations. Traditional volumetric fusion techniques, including truncated signed distance functions (TSDF), enable efficient and deterministic geometry reconstruction; however, they depend on heuristic weighting and fail to transparently convey uncertainty in a systematic way. Recent neural implicit methods, on the other hand, get very high fidelity but usually need a lot of GPU power for optimization and aren't very easy to understand for making decisions later on. This work presents BayesFusion-SDF, a CPU-centric probabilistic signed distance fusion framework that conceptualizes geometry as a sparse Gaussian random field with a defined posterior distribution over voxel distances. First, a rough TSDF reconstruction is used to create an adaptive narrow-band domain. Then, depth observations are combined using a heteroscedastic Bayesian formulation that is solved using sparse linear algebra and preconditioned conjugate gradients. Randomized diagonal estimators are a quick way to get an idea of posterior uncertainty. This makes it possible to extract surfaces and plan the next best view while taking into account uncertainty. Tests on a controlled ablation scene and a CO3D object sequence show that the new method is more accurate geometrically than TSDF baselines and gives useful estimates of uncertainty for active sensing. The proposed formulation provides a clear and easy-to-use alternative to GPU-heavy neural reconstruction methods while still being able to be understood in a probabilistic way and acting in a predictable way. GitHub: https://mazumdarsoumya.github.io/BayesFusionSDF
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。