让视觉语言模型主动找图练题,自动升级能力。
Active Zero: Self-Evolving Vision-Language Models through Active Environment Exploration
- 三代理协同:搜图、出题、解题,形成自进化闭环。
- 12个基准上推理准确率提升5.7%,通用理解提升3.9%。
- 适合想构建自主学习系统的研究者与开发者。
自对弈已使大语言模型通过自生成挑战实现自主提升。然而,现有视觉语言模型的自对弈方法依赖静态图像集的被动交互,严重依赖初始数据集且学习效率低。模型无法主动获取适配自身能力进化的视觉数据,导致在过于简单或超出当前水平的样本上浪费算力。为此,我们提出Active-Zero框架,将被动交互转为对视觉环境的主动探索。该框架包含三个协同演化的智能体:根据模型能力边界从开放世界库中检索图像的Searcher,生成校准推理任务的Questioner,以及通过准确率奖励优化的Solver。这一闭环实现自我搭建的自动课程,使模型自主规划学习路径。在Qwen2.5-VL-7B-Instruct上,12个基准测试中,推理任务平均准确率达53.97(提升5.7%),通用理解达59.77(提升3.9%),显著优于现有自对弈基线。结果表明,主动探索是构建可扩展、自适应自进化视觉语言系统的关键。
原文摘要 · Abstract (English)
Self-play has enabled large language models to autonomously improve through self-generated challenges. However, existing self-play methods for vision-language models rely on passive interaction with static image collections, resulting in strong dependence on initial datasets and inefficient learning. Without the ability to actively seek visual data tailored to their evolving capabilities, agents waste computational effort on samples that are either trivial or beyond their current skill level. To address these limitations, we propose Active-Zero, a framework that shifts from passive interaction to active exploration of visual environments. Active-Zero employs three co-evolving agents: a Searcher that retrieves images from open-world repositories based on the model's capability frontier, a Questioner that synthesizes calibrated reasoning tasks, and a Solver refined through accuracy rewards. This closed loop enables self-scaffolding auto-curricula where the model autonomously constructs its learning trajectory. On Qwen2.5-VL-7B-Instruct across 12 benchmarks, Active-Zero achieves 53.97 average accuracy on reasoning tasks (5.7% improvement) and 59.77 on general understanding (3.9% improvement), consistently outperforming existing self-play baselines. These results highlight active exploration as a key ingredient for scalable and adaptive self-evolving vision-language systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。