arXiv:2606.25319cs.CV2026-06被引 5

无需答案标签,通过对比视觉证据提升细粒度视觉推理效率

V-Zero: Answer-Label-Free On-Policy Distillation with Contrastive Evidence Gating for Fine-Grained Visual Reasoning

论文配图:V-Zero: Answer-Label-Free On-Policy Distillation with Contrastive Evidence Gating for Fine-Grained Visual Reasoning
图 1 · 摘自论文原文
  • 用自采轨迹配对正负视觉样本,实现无监督的策略蒸馏
  • 在多个基准上超越现有方法,速度比监督微调快5倍以上
  • 适合追求高效、低标注依赖视觉推理系统的开发者

细粒度视觉推理要求多模态大语言模型识别任务相关的视觉证据,并将其推理锚定在图像局部区域。现有代理方法通常依赖可验证奖励的强化学习或大规模标注推理轨迹的监督微调,导致探索成本高、验证规则设计繁琐或严重依赖文本监督。一种自然的规避方式是让学生模型从自身采样的轨迹中学习,即在策略蒸馏(OPD)框架下进行训练。我们重新审视了OPD,提出其本质为无负样本的停梯度对齐。分析表明,尽管OPD能提供有效的标记级修正,但其上限受限于缺乏轨迹级判别能力。基于此,我们提出V-Zero:一种无需标注答案标签的视觉推理框架,采用对比证据门控机制。训练中,将问题相关区域裁剪与负向视觉视图配对,评估学生采样轨迹并控制密集标记级蒸馏。在多个视觉推理基准上的实验显示,V-Zero持续提升细粒度视觉推理性能,同时保持强泛化能力。值得注意的是,其训练速度比以往监督微调方法快5倍以上,比强化学习基线快10倍以上。代码与数据集将发布于https://github.com/eVI-group-SCU/V-Zero。

原文摘要 · Abstract (English)

Fine-grained visual reasoning requires multimodal large language models (MLLMs) to identify task-relevant visual evidence and ground their reasoning in local image regions. Existing agentic methods typically rely on reinforcement learning with verifiable rewards or supervised fine-tuning on large-scale annotated reasoning traces, leading to costly exploration, hand-designed verification rules, or heavy dependence on textual supervision. A natural way to avoid such external answer labels is to learn from trajectories sampled by the student itself, which points to On-Policy Distillation (OPD). To understand what OPD can and cannot provide for visual reasoning, we revisit it as negative-free stop-gradient alignment. This perspective shows that, although OPD provides effective token-level correction, its ceiling is constrained by the absence of trajectory-level discrimination. Motivated by these observations, we propose V-Zero, an answer-label-free framework for visual reasoning with contrastive evidence gating. V-Zero uses no annotated textual answer labels; instead, during training it pairs a question-relevant regional crop with a negative visual view to evaluate student-sampled trajectories and gate dense token-level distillation. Experiments on multiple visual reasoning benchmarks show that V-Zero consistently improves fine-grained visual reasoning while preserving strong generalization. Notably, V-Zero is more than 5$\times$ faster than previous supervised fine-tuning methods and more than 10$\times$ faster than reinforcement learning baselines. Code and dataset will be released at https://github.com/eVI-group-SCU/V-Zero

视觉推理对比学习无监督训练模型蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。