arXiv:2511.19900cs.CVcs.AI2025-11被引 30

让视觉语言模型自己纠错改进,不用人工标注也能越算越准。

Agent0-VL: Exploring Self-Evolving Agent for Tool-Integrated Vision-Language Reasoning

  • 用工具辅助推理和自检,让模型能自我验证每一步逻辑。
  • 在几何与科学图像分析任务中比基础模型提升12.5%准确率。
  • 适合做自主推理系统、无需人工标注的智能助手研发者。

视觉语言模型在多模态推理任务中取得显著进展,但其学习仍受限于人工标注监督的不足。现有自奖励方法虽尝试让模型自我评判,但纯文本评估难以验证复杂视觉推理步骤,常出现评估幻觉。为此,受工具增强推理启发,我们提出 Agent0-VL——一个具备持续自我演化的视觉语言代理,通过工具集成实现推理与自评、自修的一体化。该模型在单个大视觉语言模型中融合两个协同角色:执行多轮工具推理的求解器(Solver)与基于工具生成结构化反馈和细粒度自奖励的验证器(Verifier)。二者通过自演化推理循环交互,借助工具验证与强化学习共同对齐推理与评估分布,实现无外部奖励的零标注进化。实验表明,在几何问题求解与视觉科学分析任务中,Agent0-VL相较基线模型提升12.5%。代码已开源:https://github.com/aiming-lab/Agent0。

原文摘要 · Abstract (English)

Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to overcome this constraint by allowing models to act as their own critics or reward providers. Yet, purely text-based self-evaluation struggles to verify complex visual reasoning steps and often suffers from evaluation hallucinations. To address these challenges, inspired by recent advances in tool-integrated reasoning, we propose Agent0-VL, a self-evolving vision-language agent that achieves continual improvement with tool-integrated reasoning. Agent0-VL incorporates tool usage not only into reasoning but also into self-evaluation and self-repair, enabling the model to introspect, verify, and refine its reasoning through evidence-grounded analysis. It unifies two synergistic roles within a single LVLM: a Solver that performs multi-turn tool-integrated reasoning, and a Verifier that generates structured feedback and fine-grained self-rewards through tool-grounded critique. These roles interact through a Self-Evolving Reasoning Cycle, where tool-based verification and reinforcement learning jointly align the reasoning and evaluation distributions for stable self-improvement. Through this zero-external-reward evolution, Agent0-VL aligns its reasoning and verification behaviors without any human annotation or external reward models, achieving continual self-improvement. Experiments on geometric problem solving and visual scientific analysis show that Agent0-VL achieves an 12.5% improvement over the base model. Our code is available at https://github.com/aiming-lab/Agent0.

视觉语言自演化工具集成自主推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。