arXiv:2603.17729cs.CVcs.AI2026-03

让视觉模型按难易程度自动选择推理方式,提升细粒度识别准确率。

SARE: Sample-wise Adaptive Reasoning for Training-free Fine-grained Visual Recognition

  • 按样本难度动态决定是否启动精细推理,节省计算资源。
  • 通过复盘错误经验,对相似难题提供可迁移的判断指引。
  • 无需训练,在14个数据集上表现领先,适合部署在资源受限场景。

大型视觉语言模型(LVLM)已实现无需训练的细粒度视觉识别(FGVR),但子类别的视觉模糊性仍带来挑战。现有方法多采用检索或推理范式,却存在两大局限:一是对所有样本使用相同推理流程,忽略识别难度差异,导致精度与效率不足;二是缺乏对错误经验的积累与复用,同类难题反复出错。为此,本文提出SARE——一种样本自适应推理框架。其采用级联设计,先快速检索候选,仅在必要时启动精细推理;推理中引入自我反思机制,利用过往失败经验提供可迁移的判别指导,全程无需参数更新。在14个数据集上的实验证明,SARE达到当前最优性能,并显著降低计算开销。

原文摘要 · Abstract (English)

Recent advances in Large Vision-Language Models (LVLMs) have enabled training-free Fine-Grained Visual Recognition (FGVR). However, effectively exploiting LVLMs for FGVR remains challenging due to the inherent visual ambiguity of subordinate-level categories. Existing methods predominantly adopt either retrieval-oriented or reasoning-oriented paradigms to tackle this challenge, but both are constrained by two fundamental limitations:(1) They apply the same inference pipeline to all samples without accounting for uneven recognition difficulty, thereby leading to suboptimal accuracy and efficiency; (2) The lack of mechanisms to consolidate and reuse error-specific experience causes repeated failures on similar challenging cases. To address these limitations, we propose SARE, a Sample-wise Adaptive textbfREasoning framework for training-free FGVR. Specifically, SARE adopts a cascaded design that combines fast candidate retrieval with fine-grained reasoning, invoking the latter only when necessary. In the reasoning process, SARE incorporates a self-reflective experience mechanism that leverages past failures to provide transferable discriminative guidance during inference, without any parameter updates. Extensive experiments across 14 datasets substantiate that SARE achieves state-of-the-art performance while substantially reducing computational overhead.

细粒度识别视觉语言模型自适应推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。