arXiv:2508.13229cs.LGcs.CV2025-08被引 1

让视觉语言模型自动生成靠谱的推理链条,提升复杂图像标注准确率。

RISE: Enhancing VLM Image Annotation with Self-Supervised Reasoning

  • 用强化学习闭环生成可验证的推理过程,避免依赖人工标注。
  • 在多个任务上超越传统微调方法,标注准确率显著提升。
  • 适合需要高可解释性的复杂视觉任务研究者使用。

视觉语言模型(VLMs)在情感分类、上下文驱动的目标检测等复杂图像标注任务中表现不佳,这类任务需要深度推理能力。标准监督微调(SFT)仅关注标注结果,忽视推理过程;而视觉强化微调(Visual-RFT)因预训练阶段缺乏高质量、可验证的思维链(CoTs),导致推理不一致。我们提出RISE(Reason-Inspire-Strengthen-Expertise)两阶段框架:第一阶段(RISE-CoT)通过强化学习驱动的“标注-推理-标注”闭环,生成视觉一致、逻辑连贯的CoTs,且能重建原始标注而不泄露信息;第二阶段(RISE-R1)利用高质CoT子集进行监督微调,再经强化微调,最终实现对复杂视觉任务的专家级表现。在复杂与简单图像标注任务上的评估显示,基于Qwen2-VL-2B的RISE模型优于SFT与Visual-RFT,兼具鲁棒性与可解释性。该方法无需人工标注思维链,代码与资源已公开于https://github.com/HSH55/RISE。

原文摘要 · Abstract (English)

Vision-Language Models (VLMs) struggle with complex image annotation tasks, such as emotion classification and context-driven object detection, which demand sophisticated reasoning. Standard Supervised Fine-Tuning (SFT) focuses solely on annotation outcomes, ignoring underlying rationales, while Visual Reinforcement Fine-Tuning (Visual-RFT) produces inconsistent Chains of Thought (CoTs) due to the absence of high-quality, verified CoTs during pre-training. We introduce RISE (Reason-Inspire-Strengthen-Expertise), a two-stage framework to overcome these limitations. In the Reason stage (RISE-CoT), a reinforcement learning-driven "annotation-reasoning-annotation" closed-loop generates visually grounded, logically consistent CoTs by verifying their ability to reconstruct original annotations without direct leakage. The Inspire and Strengthen stage (RISE-R1) leverages a high-quality CoT subset, filtered by RISE-CoT rewards, for supervised fine-tuning, followed by reinforcement fine-tuning to produce interpretable reasoning and accurate annotations, achieving Expertise in complex visual tasks. Evaluated on complex and simple image annotation tasks, RISE-trained Qwen2-VL-2B outperforms SFT and Visual-RFT, achieving robust performance and enhanced explainability. RISE offers a self-supervised solution for advancing VLM reasoning without requiring manually annotated CoTs.Code and resources are available at: https://github.com/HSH55/RISE.

视觉语言模型推理增强自监督学习可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。