arXiv:2504.01648cs.CV2025-04被引 2

解决3D点云增量学习中的类别混淆与长尾问题。

ProtoGuard-guided PROPEL: Class-Aware Prototype Enhancement and Progressive Labeling for Incremental 3D Point Cloud Segmentation

  • 用原型守卫保持类别的几何语义特征,提升分类稳定性。
  • 提出渐进式伪标签优化,在5步增量下提升mIoU达20.39%。
  • 适合处理动态环境下的3D点云分割任务,尤其对相似类别有效。

3D点云语义分割技术广泛应用,但在真实场景中环境持续变化,导致离线训练的模型产生灾难性遗忘。为应对这一问题,研究者提出类增量学习(CIL)。然而,点云数据存在类别间相似度高、边界模糊以及类别分布不均衡等问题,现有方法未能充分解决误分类和长尾难题。为此,本文提出ProtoGuard与PROPEL(渐进式伪标签优化)方法。在基础类别训练阶段,ProtoGuard通过注意力机制融合每类的几何与语义原型,构建原型特征;在新类别训练阶段,PROPEL沿用原有特征提取器与分类器,基于密度分布与语义相似性引导伪标签传播与更新。大量实验表明,该方法在S3DIS与ScanNet数据集上表现优异,在S3DIS的5步增量学习场景下,最大提升mIoU达20.39%。

原文摘要 · Abstract (English)

3D point cloud semantic segmentation technology has been widely used. However, in real-world scenarios, the environment is evolving. Thus, offline-trained segmentation models may lead to catastrophic forgetting of previously seen classes. Class-incremental learning (CIL) is designed to address the problem of catastrophic forgetting. While point clouds are common, we observe high similarity and unclear boundaries between different classes. Meanwhile, they are known to be imbalanced in class distribution. These lead to issues including misclassification between similar classes and the long-tail problem, which have not been adequately addressed in previous CIL methods. We thus propose ProtoGuard and PROPEL (Progressive Refinement Of PsEudo-Labels). In the base-class training phase, ProtoGuard maintains geometric and semantic prototypes for each class, which are combined into prototype features using an attention mechanism. In the novel-class training phase, PROPEL inherits the base feature extractor and classifier, guiding pseudo-label propagation and updates based on density distribution and semantic similarity. Extensive experiments show that our approach achieves remarkable results on both the S3DIS and ScanNet datasets, improving the mIoU of 3D point cloud segmentation by a maximum of 20.39% under the 5-step CIL scenario on S3DIS.

3D分割增量学习原型网络点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。