arXiv:2511.14097cs.CV2025-11被引 1

用BCE设计三重协同学习,解决长尾识别中特征与分类器的不平衡问题。

BCE3S: Binary Cross-Entropy Based Tripartite Synergistic Learning for Long-tailed Recognition

  • 采用BCE替代交叉熵,解耦特征与分类器间的耦合关系。
  • 在多个数据集上实现更优的类内紧凑性与类间可分性,性能达到新标杆。
  • 适合长尾识别任务,尤其对尾部类别识别有显著提升。

针对长尾识别(LTR)任务,理想的特征应具备头尾类别均高的类内紧凑性和类间可分性,且所有分类器向量间保持均衡可分性。现有基于交叉熵(CE)损失的方法不仅难以学习到理想特征,还因Softmax分母中分类器向量的不平衡而放大偏差。本文提出一种基于二元交叉熵(BCE)的三重协同学习方法BCE3S,包含三个组件:(1) 基于BCE的联合学习,通过多Sigmoid解耦特征与不平衡分类器向量之间的度量,优化分类器与样本特征,提升特征紧凑性与可分性;(2) 基于BCE的对比学习,进一步增强特征的类内紧凑性;(3) 基于BCE的均匀学习,平衡分类器间的可分性,并与联合学习交互提升特征性能。大量实验表明,使用BCE3S训练的模型在各类长尾数据集(如CIFAR10-LT、CIFAR100-LT、ImageNet-LT、iNaturalist2018)上均实现了更高的特征紧凑性与可分性,且分类器可分性更加均衡,达到当前最优(SOTA)性能。

原文摘要 · Abstract (English)

For long-tailed recognition (LTR) tasks, high intra-class compactness and inter-class separability in both head and tail classes, as well as balanced separability among all the classifier vectors, are preferred. The existing LTR methods based on cross-entropy (CE) loss not only struggle to learn features with desirable properties but also couple imbalanced classifier vectors in the denominator of its Softmax, amplifying the imbalance effects in LTR. In this paper, for the LTR, we propose a binary cross-entropy (BCE)-based tripartite synergistic learning, termed BCE3S, which consists of three components: (1) BCE-based joint learning optimizes both the classifier and sample features, which achieves better compactness and separability among features than the CE-based joint learning, by decoupling the metrics between feature and the imbalanced classifier vectors in multiple Sigmoid; (2) BCE-based contrastive learning further improves the intra-class compactness of features; (3) BCE-based uniform learning balances the separability among classifier vectors and interactively enhances the feature properties by combining with the joint learning. The extensive experiments show that the LTR model trained by BCE3S not only achieves higher compactness and separability among sample features, but also balances the classifier's separability, achieving SOTA performance on various long-tailed datasets such as CIFAR10-LT, CIFAR100-LT, ImageNet-LT, and iNaturalist2018.

长尾识别BCE特征优化分类器平衡

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。