通过捕捉批次内图像关系,提升细粒度分类精度
Enhancing Fine-grained Image Classification through Attentive Batch Training
- 设计关系注意力模块,利用批次内图像间关系融合特征
- 在CUB200-2011和斯坦福狗数据集上分别提升2.78%和3.83%
- 可作为插件模块接入多种网络,适用于细粒度与通用图像分类
细粒度图像分类是计算机视觉中极具挑战性的任务,需精确区分视觉相似的类别。本文提出:1)残差关系注意力(RRA)模块,利用训练批次内图像间的关系,有效整合图像的视觉特征向量;2)关系位置编码(RPE),编码批次中原始图像间关系的位置信息,保留批次内图像间的关联性。进一步设计关系批次融合(RBI)框架,结合RRA与RPE,使模型能识别单个图像代表类时可能忽略的关键视觉特征。大量实验表明,该方法显著提升各类细粒度分类器的准确率,在CUB200-2011和斯坦福狗数据集上分别提升2.78%和3.83%,并在斯坦福狗数据集达到95.79%的当前最优性能。即使在通用图像分类任务中,该方法仍表现优异,在Tiny-Imagenet上取得93.71%的顶尖结果。此外,本方法为可插拔式优化模块,可轻松集成至不同网络架构。
原文摘要 · Abstract (English)
Fine-grained image classification, which is a challenging task in computer vision, requires precise differentiation among visually similar object categories. In this paper, we propose 1) a novel module called Residual Relationship Attention (RRA) that leverages the relationships between images within each training batch to effectively integrate visual feature vectors of batch images and 2) a novel technique called Relationship Position Encoding (RPE), which encodes the positions of relationships between original images in a batch and effectively preserves the relationship information between images within the batch. Additionally, we design a novel framework, namely Relationship Batch Integration (RBI), which utilizes RRA in conjunction with RPE, allowing the discernment of vital visual features that may remain elusive when examining a singular image representative of a particular class. Through extensive experiments, our proposed method demonstrates significant improvements in the accuracy of different fine-grained classifiers, with an average increase of $(+2.78\%)$ and $(+3.83\%)$ on the CUB200-2011 and Stanford Dog datasets, respectively, while achieving a state-of-the-art results $(95.79\%)$ on the Stanford Dog dataset. Despite not achieving the same level of improvement as in fine-grained image classification, our method still demonstrates its prowess in leveraging general image classification by attaining a state-of-the-art result of $(93.71\%)$ on the Tiny-Imagenet dataset. Furthermore, our method serves as a plug-in refinement module and can be easily integrated into different networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。