让视觉语言模型自动进化,提升推理能力。
RISE: Reliable Improvement in Self-Evolving Vision-Language Models

- 细粒度角色交替,加快提问与解答的反馈速度。
- 引入质量监督,确保问题和伪标签可靠性。
- 动态平衡技能分布,避免问题类型单一化。
视觉语言模型(VLMs)已具备强大的多模态推理能力,但进一步提升仍严重依赖大规模人工构建的后训练监督数据,尤其在需要精细设计问题、答案和反馈信号的推理密集型任务中成本高昂。这推动了自演化学习的发展,即模型通过提问者与求解者双角色闭环自主改进。然而,现有方法面临三大挑战:角色交替粒度过粗,延迟互动;生成问题质量逐步下降;问题类型趋于单一。为此,我们提出RISE框架,包含三项互补设计:细粒度角色交替以缩短反馈周期;质量监督器提升问题有效性和伪标签可靠性;技能感知动态平衡缓解模式崩溃,保持技能多样性。实验在两个VLM骨干网络上覆盖七个基准测试,结果表明RISE能持续提升基线模型性能,实现广泛且稳定的增益。代码已开源:https://github.com/AMAP-ML/RISE。
原文摘要 · Abstract (English)
Vision-language models (VLMs) have achieved strong multimodal reasoning capabilities, but further improving them still relies heavily on large-scale human-constructed supervision for post-training. Such supervision is costly to obtain, especially for reasoning-intensive multimodal tasks where questions, answers, and feedback signals must be carefully designed. This motivates self-evolving learning, where a model improves itself through a dual-role closed loop: a questioner autonomously poses questions and a solver learns to solve them. However, we observe that current VLM self-evolving methods still face three major challenges: coarse-grained role alternation delays the interaction between question generation and solver adaptation; generated questions can progressively degrade in quality; and question types may collapse toward a narrow distribution. These issues limit the efficiency and reliability of self-evolution. Thus, we propose \textbf{RISE}, a reliable self-evolving framework for vision-language models. RISE is built on three complementary designs: fine-grained role alternation, which shortens the feedback loop between the questioner and the solver to improve efficiency; a quality supervisor, which improves question validity and pseudo-label reliability; and skill-aware dynamic balancing, which mitigates mode collapse and maintains broad skill coverage during evolution. Together, these components enable more reliable and effective self-evolution from unlabeled images. Experiments on two VLM backbones across seven benchmarks show that RISE consistently improves the base models, yielding broad and sustained gains. Our code is publicly available at https://github.com/AMAP-ML/RISE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。