arXiv:2503.02372cs.CVcs.RO2025-03中稿 · the IEEE/RSJ Inter…被引 2

用极少标注数据实现高精度激光雷达全景分割,提升机器人环境理解能力。

Label-Efficient LiDAR Panoptic Segmentation

论文配图:Label-Efficient LiDAR Panoptic Segmentation
图 1 · 摘自论文原文
  • 基于2D图像生成伪标签并投影到点云,结合几何特性进行3D优化
  • 通过聚类与扫描累积等技术,分割精度提升最高达10.6 PQ和7.9 mIoU
  • 显著降低标注需求,适合数据稀缺场景下的自动驾驶系统部署

基于学习的机器人环境理解方法常受限于大量标注数据,制约其泛化能力。在激光雷达全景分割中,由于需从复杂高维点云中同时完成语义与实例分割,此问题尤为突出。本文提出一种新方法L3PS,仅需少量标注样本即可实现高效分割。首先利用高效的2D网络生成全景伪标签,并投影至点云;随后引入新型3D精修模块,融合聚类、连续扫描累积与地面点分离技术,显著提升伪标签质量,使分割性能最高提升10.6 PQ和7.9 mIoU。实验表明,这些优化后的伪标签可有效训练现成的激光雷达分割网络。L3PS不仅超越现有方法,还大幅减少标注负担。代码已公开:https://l3ps.cs.uni-freiburg.de。

原文摘要 · Abstract (English)

A main bottleneck of learning-based robotic scene understanding methods is the heavy reliance on extensive annotated training data, which often limits their generalization ability. In LiDAR panoptic segmentation, this challenge becomes even more pronounced due to the need to simultaneously address both semantic and instance segmentation from complex, high-dimensional point cloud data. In this work, we address the challenge of LiDAR panoptic segmentation with very few labeled samples by leveraging recent advances in label-efficient vision panoptic segmentation. To this end, we propose a novel method, Limited-Label LiDAR Panoptic Segmentation (L3PS), which requires only a minimal amount of labeled data. Our approach first utilizes a label-efficient 2D network to generate panoptic pseudo-labels from a small set of annotated images, which are subsequently projected onto point clouds. We then introduce a novel 3D refinement module that capitalizes on the geometric properties of point clouds. By incorporating clustering techniques, sequential scan accumulation, and ground point separation, this module significantly enhances the accuracy of the pseudo-labels, improving segmentation quality by up to +10.6 PQ and +7.9 mIoU. We demonstrate that these refined pseudo-labels can be used to effectively train off-the-shelf LiDAR segmentation networks. Through extensive experiments, we show that L3PS not only outperforms existing methods but also substantially reduces the annotation burden. We release the code of our work at https://l3ps.cs.uni-freiburg.de.

激光雷达全景分割少样本学习点云处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。