提升少数类道路细粒度分割性能,缓解多数类主导问题
Exploiting Minority Pseudo-Labels for Semi-Supervised Fine-grained Road Scene Understanding
- 用所有伪标签训练,不依赖传统过滤策略
- 设计新匹配度指标筛选可靠少数类伪标签,显著提升尾部类别识别率
- 跨模块互监督+均匀锚点分布,适合长尾场景的半监督学习
在细粒度道路场景理解中,语义分割通过为图像中每个像素分配特定类别标签,实现对道路细节特征的精确识别与定位,对高质量场景理解及下游感知任务至关重要。该领域核心挑战在于提升少数类识别性能,同时抑制多数类的主导影响,以实现整体平衡且鲁棒的性能。然而,传统半监督学习方法常忽略类别间的不平衡性。为此,本文提出一种通用训练模块,利用全部伪标签进行训练,无需传统过滤策略;并设计专业训练模块,基于新颖的不匹配度评分指标,专门学习可靠的少数类伪标签。两个模块相互交叉监督,降低模型耦合性,有利于半监督学习。在对比学习阶段,为避免多数类在特征空间中占据主导,提出对不同类别在特征空间中均匀分布锚点的策略。在多个公开基准上的实验结果表明,该方法在识别尾部类别方面优于传统方法。
原文摘要 · Abstract (English)
In fine-grained road scene understanding, semantic segmentation plays a crucial role in enabling vehicles to perceive and comprehend their surroundings. By assigning a specific class label to each pixel in an image, it allows for precise identification and localization of detailed road features, which is vital for high-quality scene understanding and downstream perception tasks. A key challenge in this domain lies in improving the recognition performance of minority classes while mitigating the dominance of majority classes, which is essential for achieving balanced and robust overall performance. However, traditional semi-supervised learning methods often train models overlooking the imbalance between classes. To address this issue, firstly, we propose a general training module that learns from all the pseudo-labels without a conventional filtering strategy. Secondly, we propose a professional training module to learn specifically from reliable minority-class pseudo-labels identified by a novel mismatch score metric. The two modules are crossly supervised by each other so that it reduces model coupling which is essential for semi-supervised learning. During contrastive learning, to avoid the dominance of the majority classes in the feature space, we propose a strategy to assign evenly distributed anchors for different classes in the feature space. Experimental results on multiple public benchmarks show that our method surpasses traditional approaches in recognizing tail classes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。