模仿人眼快速扫视,用分阶段视觉定位细粒度图像特征。
Saccadic Vision for Fine-Grained Visual Classification
- 先提取边缘特征生成采样图,再并行编码焦点区域。
- 在标准数据集上性能媲美顶尖方法,基准模型显著提升。
- 适合细粒度分类、小样本图像识别任务使用。
细粒度视觉分类(FGVC)需通过细微局部特征区分视觉相似类别,但类内差异大、类间差异小仍具挑战。现有基于部件的方法依赖复杂定位网络,从像素映射到样本空间,需深层理解图像内容且限制特征下游应用。同时,采样点常存在高空间冗余,难以确定最优部件数。受人类扫视视觉启发,我们提出两阶段流程:首先提取外围特征(粗略视角)生成采样图,从中采样焦点补丁并用共享权重编码器并行处理;再通过上下文感知选择性注意力加权各焦点补丁,融合外围与聚焦表征。为防止部件方法常见的空间坍缩问题,采样时采用非极大值抑制消除冗余。在标准FGVC基准(CUB-200-2011、NABirds、Food-101、Stanford-Dogs)及具有挑战性的昆虫数据集(EU-Moths、Ecuador-Moths、AMI-Moths)上的全面评估表明,该方法性能可比肩当前最优方案,且持续超越基线编码器。
原文摘要 · Abstract (English)
Fine-grained visual classification (FGVC) requires distinguishing between visually similar categories through subtle, localized features - a task that remains challenging due to high intra-class variability and limited inter-class differences. Existing part-based methods often rely on complex localization networks that learn mappings from pixel to sample space, requiring a deep understanding of image content while limiting feature utility for downstream tasks. In addition, sampled points frequently suffer from high spatial redundancy, making it difficult to quantify the optimal number of required parts. Inspired by human saccadic vision, we propose a two-stage process that first extracts peripheral features (coarse view) and generates a sample map, from which fixation patches are sampled and encoded in parallel using a weight-shared encoder. We employ contextualized selective attention to weigh the impact of each fixation patch before fusing peripheral and focus representations. To prevent spatial collapse - a common issue in part-based methods - we utilize non-maximum suppression during fixation sampling to eliminate redundancy. Comprehensive evaluation on standard FGVC benchmarks (CUB-200-2011, NABirds, Food-101 and Stanford-Dogs) and challenging insect datasets (EU-Moths, Ecuador-Moths and AMI-Moths) demonstrates that our method achieves comparable performance to state-of-the-art approaches while consistently outperforming our baseline encoder.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。