利用时空关联提升低预算激光雷达语义分割的伪标签质量
Learning from Spatio-temporal Correlation for Semi-Supervised LiDAR Semantic Segmentation

- 基于相邻扫描的时空一致性生成高精度伪标签
- 在5%标注数据下性能超越全监督模型,20%标注即达76.0%准确率
- 适合标注成本受限的自动驾驶场景应用
针对低预算半监督激光雷达语义分割(SSLS)中伪标签质量差、真实标签与伪标签分布失衡导致性能下降的问题,本文利用相邻帧间显著的时间重叠特性,提出基于邻近度的伪标签估计方法。通过融合邻近有标注扫描的语义一致性,生成高质量伪标签,并逐步扩展至更远的未标注扫描以减少动态物体带来的误差。同时采用双分支结构缓解数据不平衡问题。实验表明,在极低标注比例(≤5%)下表现优异,正常预算(5%-50%)下也有明显提升。在SemanticKITTI和nuScenes上均达到新最佳结果:仅用5%标注数据即超越全监督基线;在nuScenes上,仅20%标注数据(76.0% mIoU)便超过此前最优方法在100%标注下的75.2%性能。
原文摘要 · Abstract (English)
We address the challenges of the semi-supervised LiDAR segmentation (SSLS) problem, particularly in low-budget scenarios. The two main issues in low-budget SSLS are the poor-quality pseudo-labels for unlabeled data, and the performance drops due to the significant imbalance between ground-truth and pseudo-labels. This imbalance leads to a vicious training cycle. To overcome these challenges, we leverage the spatio-temporal prior by recognizing the substantial overlap between temporally adjacent LiDAR scans. We propose a proximity-based label estimation, which generates highly accurate pseudo-labels for unlabeled data by utilizing semantic consistency with adjacent labeled data. Additionally, we enhance this method by progressively expanding the pseudo-labels from the nearest unlabeled scans, which helps significantly reduce errors linked to dynamic classes. Additionally, we employ a dual-branch structure to mitigate performance degradation caused by data imbalance. Experimental results demonstrate remarkable performance in low-budget settings (i.e., <= 5%) and meaningful improvements in normal budget settings (i.e., 5 - 50%). Finally, our method has achieved new state-of-the-art results on SemanticKITTI and nuScenes in semi-supervised LiDAR segmentation. With only 5% labeled data, it offers competitive results against fully-supervised counterparts. Moreover, it surpasses the performance of the previous state-of-the-art at 100% labeled data (75.2%) using only 20% of labeled data (76.0%) on nuScenes. The code is available on https://github.com/halbielee/PLE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。