通过均匀化特征幅度提升小样本细粒度识别效果
Enhancing Fine-Grained Visual Recognition in the Low-Data Regime Through Feature Magnitude Regularization
- 用特征幅度熵最大化实现均匀分布正则化
- 在多个细粒度数据集上显著提升准确率
- 适合小样本场景下的视觉分类任务
在有限数据下训练细粒度图像识别模型面临重大挑战,因为类别间的细微差异容易被噪声掩盖。尽管常采用预训练神经网络提取有效特征,但其原本针对不同任务训练,可能提取出不相关特征。在小样本条件下,这些无关特征会主导训练过程,压制更具泛化能力的判别性特征。本文提出一种简单有效的解决方案:通过最大化归一化特征的熵来均匀化特征幅度分布,消除预训练模型中特征幅度的偏差。此外,设计了动态权重机制以调节正则化强度。实验表明,该方法在多个细粒度视觉识别数据集上均取得显著性能提升。
原文摘要 · Abstract (English)
Training a fine-grained image recognition model with limited data presents a significant challenge, as the subtle differences between categories may not be easily discernible amidst distracting noise patterns. One commonly employed strategy is to leverage pretrained neural networks, which can generate effective feature representations for constructing an image classification model with a restricted dataset. However, these pretrained neural networks are typically trained for different tasks than the fine-grained visual recognition (FGVR) task at hand, which can lead to the extraction of less relevant features. Moreover, in the context of building FGVR models with limited data, these irrelevant features can dominate the training process, overshadowing more useful, generalizable discriminative features. Our research has identified a surprisingly simple solution to this challenge: we introduce a regularization technique to ensure that the magnitudes of the extracted features are evenly distributed. This regularization is achieved by maximizing the uniformity of feature magnitude distribution, measured through the entropy of the normalized features. The motivation behind this regularization is to remove bias in feature magnitudes from pretrained models, where some features may be more prominent and, consequently, more likely to be used for classification. Additionally, we have developed a dynamic weighting mechanism to adjust the strength of this regularization throughout the learning process. Despite its apparent simplicity, our approach has demonstrated significant performance improvements across various fine-grained visual recognition datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。