让多模态大模型通过可执行的视觉变换自我进化,无需伪标签。
EVE: Verifiable Self-Evolution of MLLMs via Executable Visual Transformations

- 用可执行代码生成动态视觉变换,自动构造带真答案的问题。
- 在VQA任务上超越现有方法,持续提升模型能力。
- 适合研究自进化系统、可验证训练的AI开发者。
多模态大语言模型的自进化仍面临挑战:基于伪标签的方法因模型预测漂移导致质量持续下降,而基于模板的方法受限于固定变换集,难以适应难度与多样性变化。本文提出EVE(Executable Visual transformation-based self-Evolution),一种完全摒弃伪标签的新框架,通过不断丰富且复杂化的可执行视觉变换代码库实现持续进化。EVE采用挑战者-求解者双策略架构:挑战者维护并扩展视觉变换代码示例队列,自动生成新颖的Python脚本进行动态视觉变换;执行这些脚本生成带绝对真值答案的VQA问题,彻底消除对模型生成监督的依赖。多维度奖励机制融合语义多样性与动态难度校准,驱动挑战者持续扩充代码库并提出更具挑战性的任务,防止模式坍缩,促进双策略协同进化。大量实验表明,EVE持续优于现有自进化方法,建立了可验证、可扩展的多模态大模型自进化范式。代码已开源:https://github.com/0001Henry/EVE。
原文摘要 · Abstract (English)
Self-evolution of multimodal large language models (MLLMs) remains a critical challenge: pseudo-label-based methods suffer from progressive quality degradation as model predictions drift, while template-based methods are confined to a static set of transformations that cannot adapt in difficulty or diversity. We contend that robust, continuous self-improvement requires not only deterministic external feedback independent of the model's internal certainty, but also a mechanism to perpetually diversify the training distribution. To this end, we introduce EVE (Executable Visual transformation-based self-Evolution), a novel framework that entirely bypasses pseudo-labels by harnessing executable visual transformations continuously enriched in both variety and complexity. EVE adopts a Challenger-Solver dual-policy architecture. The Challenger maintains and progressively expands a queue of visual transformation code examples, from which it synthesizes novel Python scripts to perform dynamic visual transformations. Executing these scripts yields VQA problems with absolute, execution-verified ground-truth answers, eliminating any reliance on model-generated supervision. A multi-dimensional reward system integrating semantic diversity and dynamic difficulty calibration steers the Challenger to enrich its code example queue while posing progressively more challenging tasks, preventing mode collapse and fostering reciprocal co-evolution between the two policies. Extensive experiments demonstrate that EVE consistently surpasses existing self-evolution methods, establishing a robust and scalable paradigm for verifiable MLLM self-evolution. The code is available at https://github.com/0001Henry/EVE .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。