用模型自身预测结果训练细粒度图像识别,提升泛化能力。
DiVE-k: Differential Visual Reasoning for Fine-grained Image Recognition
- 利用模型的前k个预测生成多选题,作为强化学习训练信号。
- 在5个数据集上显著超越现有方法,基类到新类任务提升10.04%。
- 适合需要细粒度区分、少样本场景的视觉理解任务。
大视觉语言模型虽具备丰富文本知识,但在细粒度图像识别中难以有效利用,常无法区分视觉相似类别。现有基于强化学习的微调方法使用精确匹配奖励信号,易导致模型脆弱、记忆训练类别,且难以激发泛化所需的差异化推理能力。为此,我们提出DiVE-k——一种基于模型前k个生成结果的差异化视觉推理框架。对每张训练图像,DiVE-k从模型的前k个输出构建多选题,并通过强化学习训练模型选择正确答案。该方法迫使模型在合理选项间进行精细区分,提供简单可验证的奖励信号,抑制记忆倾向,提升泛化性能。在五个标准细粒度数据集上的实验表明,本方法显著优于现有方法。在标准基类到新类泛化设置下,相较QWEN2.5-VL-7B和ViRFT,Harmonic Mean指标分别提升10.04%和6.16%。进一步实验显示,在混合领域和少样本场景中亦取得类似增益。代码已开源。
原文摘要 · Abstract (English)
Large Vision Language Models (LVLMs) possess extensive text knowledge but struggles to utilize this knowledge for fine-grained image recognition, often failing to differentiate between visually similar categories. Existing fine-tuning methods using Reinforcement Learning (RL) with exact-match reward signals are often brittle, encourage memorization of training categories, and fail to elicit differential reasoning needed for generalization to unseen classes. To address this, we propose $\textbf{DiVE-k}$, $\textbf{Di}$fferential $\textbf{V}$isual r$\textbf{E}$asoning using top-$\textbf{k}$ generations, framework that leverages model's own top-k predictions as a training signal. For each training image, DiVE-k creates a multiple-choice question from the model's top-k outputs and uses RL to train the model to select the correct answer. This approach requires the model to perform fine-grained differential reasoning among plausible options and provides a simple, verifiable reward signal that mitigates memorization and improves generalization. Experiments on five standard fine-grained datasets show that our method significantly outperforms existing approaches. In the standard base-to-novel generalization setting, DiVE-k surpasses the QWEN2.5-VL-7B and ViRFT by 10.04% and 6.16% on the Harmonic Mean metric, respectively. Further experiments show similar gains in mixed-domain and few-shot scenarios. Our code is available $\href{https://github.com/raja-kumar/DiVE-k}{here}$
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。