通过注意力筛选与图像引导,提升细粒度识别中的细微特征提取能力。
PP-SSL : Priority-Perception Self-Supervised Learning for Fine-Grained Recognition
- 构建细粒度文本描述库,用知识蒸馏去除无关特征干扰。
- 利用原始图像生成GradCAM,更精准捕捉类别间微小差异。
- 在CUB-200、FGVC-Aircraft等数据集上显著超越现有方法。
自监督学习在细粒度视觉识别中表现优异,但现有方法易受无关模式干扰,难以捕捉细粒度差异。为此,本文提出优先感知自监督学习框架PP-SSL,包含抗干扰策略(AIS)和图像引导区分模块(IADM)。AIS基于细粒度文本描述语料库,采用知识蒸馏机制,引导模型抑制冗余特征,增强判别性特征学习。IADM发现从原始图像生成GradCAM可有效揭示细粒度类间的细微差异,相比中间层或输出层特征,原始图像保留更多细节,有助于深入挖掘类别间微小差别。大量实验表明,PP-SSL在CUB-200、FGVC-Aircraft、Stanford Cars等多个数据集上均显著优于现有方法,验证了其在细粒度识别任务中的有效性。代码将在发表后公开。
原文摘要 · Abstract (English)
Self-supervised learning is emerging in fine-grained visual recognition with promising results. However, existing self-supervised learning methods are often susceptible to irrelevant patterns in self-supervised tasks and lack the capability to represent the subtle differences inherent in fine-grained visual recognition (FGVR), resulting in generally poorer performance. To address this, we propose a novel Priority-Perception Self-Supervised Learning framework, denoted as PP-SSL, which can effectively filter out irrelevant feature interference and extract more subtle discriminative features throughout the training process. Specifically, it composes of two main parts: the Anti-Interference Strategy (AIS) and the Image-Aided Distinction Module (IADM). In AIS, a fine-grained textual description corpus is established, and a knowledge distillation strategy is devised to guide the model in eliminating irrelevant features while enhancing the learning of more discriminative and high-quality features. IADM reveals that extracting GradCAM from the original image effectively reveals subtle differences between fine-grained categories. Compared to features extracted from intermediate or output layers, the original image retains more detail, allowing for a deeper exploration of the subtle distinctions among fine-grained classes. Extensive experimental results indicate that the PP-SSL significantly outperforms existing methods across various datasets, highlighting its effectiveness in fine-grained recognition tasks. Our code will be made publicly available upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。