arXiv:2603.09206cs.CVcs.LG2026-03被引 14

零数据自进化视觉语言模型,让AI从无到有自主学习图文推理。

MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Data

  • 三角色协同:生成概念、写代码绘图、多模态推理,全靠自进化
  • 零数据启动,在多个基准上显著提升视觉语言模型推理能力
  • 适合研究自进化系统与多模态模型的开发者

自进化已成为提升大语言模型(LLM)和视觉语言模型(VLM)的关键范式,可最大限度减少人工干预。尽管已有方法证明LLM代理可在极少甚至无数据情况下实现自进化,但VLM引入了视觉模态,通常需要至少一些种子数据(如图像)来启动自进化过程。本文提出多模态零样本自进化框架MM-Zero,是首个基于强化学习实现零数据自进化视觉语言模型推理的方案。不同于以往双角色(提议者与求解者)设置,MM-Zero引入三角色协同机制:提议者生成抽象视觉概念并提出问题;编码者将概念转化为可执行代码(如Python、SVG)以生成图像;求解者对生成的视觉内容进行多模态推理。三个角色均从同一基础模型初始化,使用组相对策略优化(GRPO)训练,并结合执行反馈、视觉验证与难度平衡的奖励机制。实验表明,MM-Zero在多个多模态基准上显著提升VLM推理性能,为构建可扩展的多模型自进化系统开辟新路径,突破传统双模型范式的局限。

原文摘要 · Abstract (English)

Self-evolving has emerged as a key paradigm for improving foundational models such as Large Language Models (LLMs) and Vision Language Models (VLMs) with minimal human intervention. While recent approaches have demonstrated that LLM agents can self-evolve from scratch with little to no data, VLMs introduce an additional visual modality that typically requires at least some seed data, such as images, to bootstrap the self-evolution process. In this work, we present Multi-model Multimodal Zero (MM-Zero), the first RL-based framework to achieve zero-data self-evolution for VLM reasoning. Moving beyond prior dual-role (Proposer and Solver) setups, MM-Zero introduces a multi-role self-evolving training framework comprising three specialized roles: a Proposer that generates abstract visual concepts and formulates questions; a Coder that translates these concepts into executable code (e.g., Python, SVG) to render visual images; and a Solver that performs multimodal reasoning over the generated visual content. All three roles are initialized from the same base model and trained using Group Relative Policy Optimization (GRPO), with carefully designed reward mechanisms that integrate execution feedback, visual verification, and difficulty balancing. Our experiments show that MM-Zero improves VLM reasoning performance across a wide range of multimodal benchmarks. MM-Zero establishes a scalable path toward self-evolving multi-model systems for multimodal models, extending the frontier of self-improvement beyond the conventional two-model paradigm.

自进化多模态零样本视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。