用连续高斯表面表示3D物体,提升检测精度与召回率
Gaussian-Det: Learning Closed-Surface Gaussians for 3D Object Detection
- 以高斯点云为表面特征描述符,实现物体连续建模
- 在合成与真实数据集上平均精度和召回率均优于现有方法
- 适合关注多视角3D检测与几何先验应用的研究者
人体衣物、沙发皮革、汽车钣金等均表明物体由连续表面包裹,这为物体性判断提供了重要几何先验。本文提出Gaussian-Det,利用高斯点阵(Gaussian Splatting)作为多视角3D物体检测的表面表示。与现有单目或基于NeRF的方法不同,Gaussian-Det通过将输入高斯点视为大量局部表面的特征描述符,实现物体的连续建模。针对高斯点阵固有的大量异常值问题,设计了闭合推断模块(CIM),首先估计在欠定条件下局部表面的特征残差,再融合成整体表面闭合的全局表征,从而利用表面信息作为物体性质量与可靠性先验,支撑候选框优化。在合成与真实世界数据集上的实验表明,Gaussian-Det在平均精度与召回率方面均优于现有方法。
原文摘要 · Abstract (English)
Skins wrapping around our bodies, leathers covering over the sofa, sheet metal coating the car - it suggests that objects are enclosed by a series of continuous surfaces, which provides us with informative geometry prior for objectness deduction. In this paper, we propose Gaussian-Det which leverages Gaussian Splatting as surface representation for multi-view based 3D object detection. Unlike existing monocular or NeRF-based methods which depict the objects via discrete positional data, Gaussian-Det models the objects in a continuous manner by formulating the input Gaussians as feature descriptors on a mass of partial surfaces. Furthermore, to address the numerous outliers inherently introduced by Gaussian splatting, we accordingly devise a Closure Inferring Module (CIM) for the comprehensive surface-based objectness deduction. CIM firstly estimates the probabilistic feature residuals for partial surfaces given the underdetermined nature of Gaussian Splatting, which are then coalesced into a holistic representation on the overall surface closure of the object proposal. In this way, the surface information Gaussian-Det exploits serves as the prior on the quality and reliability of objectness and the information basis of proposal refinement. Experiments on both synthetic and real-world datasets demonstrate that Gaussian-Det outperforms various existing approaches, in terms of both average precision and recall.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。