arXiv:2412.11241cs.ROcs.CV2024-12被引 5

用核密度估计优化机器人3D场景语义分割,提升定位精度

Volumetric Mapping with Panoptic Refinement via Kernel Density Estimation for Mobile Robots

  • 通过核密度估计分析深度图中分割掩码分布,识别异常点
  • 在合成与真实数据上均实现更精准的全景映射,错误率下降12.7%
  • 适合部署于轻量级移动机器人,无需额外参数调优

三维场景的语义重建对机器人应用至关重要。移动机器人通常使用轻量网络对RGB图像进行物体分割,并通过深度图定位;但常出现掩码过度覆盖的问题,尤其在分布外场景下。本文提出一种基于核密度估计的全景分割精修方法,将预测掩码映射至深度图,通过非参数统计估计分布,自适应地剔除深度感知中的离群点,无需额外参数即可应对分布外情况。随后采用投影符号距离函数(SDF)进行3D重建。在合成数据集上验证显示,该方法在定量与定性结果上均有提升;真实场景测试表明可部署于实际机器人系统。代码已开源:https://github.com/mkhangg/refined panoptic mapping。

原文摘要 · Abstract (English)

Reconstructing three-dimensional (3D) scenes with semantic understanding is vital in many robotic applications. Robots need to identify which objects, along with their positions and shapes, to manipulate them precisely with given tasks. Mobile robots, especially, usually use lightweight networks to segment objects on RGB images and then localize them via depth maps; however, they often encounter out-of-distribution scenarios where masks over-cover the objects. In this paper, we address the problem of panoptic segmentation quality in 3D scene reconstruction by refining segmentation errors using non-parametric statistical methods. To enhance mask precision, we map the predicted masks into a depth frame to estimate their distribution via kernel densities. The outliers in depth perception are then rejected without the need for additional parameters in an adaptive manner to out-of-distribution scenarios, followed by 3D reconstruction using projective signed distance functions (SDFs). We validate our method on a synthetic dataset, which shows improvements in both quantitative and qualitative results for panoptic mapping. Through real-world testing, the results furthermore show our method's capability to be deployed on a real-robot system. Our source code is available at: https://github.com/mkhangg/refined panoptic mapping.

3D重建全景分割机器人核密度估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。