arXiv:2501.03122cs.CV2025-01被引 5

通过归一化BN层参数,缓解长尾分布下稀有类特征弱化问题。

Normalizing Batch Normalization for Long-Tailed Recognition

  • 将BN层参数分解为方向与大小,分别学习以平衡特征强度。
  • 在CIFAR、ImageNet和iNaturalist上显著提升稀有类识别准确率。
  • 方法简单有效,适合长尾分类任务的模型优化。

现实场景中,各类别训练样本数量常呈长尾分布,传统训练网络对稀有类的性能远低于常见类。现有工作多从数据或分类器层面修正偏差,本文发现偏差可能已编码到特征中:稀有类特异性特征远弱于常见类特异性特征。为此,提出一种简单有效的方法:归一化批归一化(BN)层的权重/偏置参数。具体地,将BN参数表示为向量,归一化为单位向量,并乘以可学习标量。通过解耦参数的方向与幅度,使权重/偏置分布更均衡,从而提升特征强度的一致性。在多个长尾识别基准(如CIFAR-10/100-LT、ImageNet-LT和iNaturalist 2018)上的大量实验表明,该方法显著优于现有最先进方法。代码与模型检查点见https://github.com/yuxiangbao/NBN。

原文摘要 · Abstract (English)

In real-world scenarios, the number of training samples across classes usually subjects to a long-tailed distribution. The conventionally trained network may achieve unexpected inferior performance on the rare class compared to the frequent class. Most previous works attempt to rectify the network bias from the data-level or from the classifier-level. Differently, in this paper, we identify that the bias towards the frequent class may be encoded into features, i.e., the rare-specific features which play a key role in discriminating the rare class are much weaker than the frequent-specific features. Based on such an observation, we introduce a simple yet effective approach, normalizing the parameters of Batch Normalization (BN) layer to explicitly rectify the feature bias. To achieve this end, we represent the Weight/Bias parameters of a BN layer as a vector, normalize it into a unit one and multiply the unit vector by a scalar learnable parameter. Through decoupling the direction and magnitude of parameters in BN layer to learn, the Weight/Bias exhibits a more balanced distribution and thus the strength of features becomes more even. Extensive experiments on various long-tailed recognition benchmarks (i.e., CIFAR-10/100-LT, ImageNet-LT and iNaturalist 2018) show that our method outperforms previous state-of-the-arts remarkably. The code and checkpoints are available at https://github.com/yuxiangbao/NBN.

长尾识别批归一化特征平衡分类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。