利用几何特征提升小样本下的超细粒度识别性能
Geometry-Guided Self-Supervision for Ultra-Fine-Grained Recognition with Limited Data

- 通过视觉反馈增强细节,提取物体的几何属性作为新识别线索
- 在5个基准数据集上达到新最好效果,显著超越现有方法
- 适合研究小样本、高相似度图像分类问题的学者使用
本文研究高度相似物体的内在几何特征,提出通用自监督框架几何属性探索网络(GAEor),用于解决数据有限条件下的超细粒度视觉分类(Ultra-FGVC)任务。与以往仅关注细微视觉差异不同,GAEor将物体内部的几何模式(如大豆叶脉结构)转化为新的识别线索。每个类别具有独特的几何描述符,即使在视觉差异极小时也具备强区分能力,这一特性此前被忽视。GAEor首先通过主干网络的视觉反馈放大几何相关细节,再将这些细节的相对极坐标嵌入最终表示。大量实验表明,GAEor在五个广泛使用的Ultra-FGVC基准上均取得新最佳性能。
原文摘要 · Abstract (English)
This paper investigates the intrinsic geometrical features of highly similar objects and introduces a general self-supervised framework called the Geometric Attribute Exploration Network (GAEor), which is designed to address the ultra-fine-grained visual categorization (Ultra-FGVC) task in data-limited scenarios. Unlike prior work that often captures subtle yet critical distinctions, GAEor generates geometric attributes as novel alternative recognition cues. These attributes are determined by various details within the object, aligned with its geometric patterns, such as the intricate vein structures in soybean leaves. Crucially, each category exhibits distinct geometric descriptors that serve as powerful cues, even among objects with minimal visual variation -- a factor largely overlooked in recent research. GAEor discovers these geometric attributes by first amplifying geometry-relevant details via visual feedback from a backbone network, then embedding the relative polar coordinates of these details into the final representation. Extensive experiments demonstrate that GAEor significantly sets new state-of-the-art records in five widely-used Ultra-FGVC benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。