arXiv:2606.27376cs.CV2026-06被引 1

无需人工标注,模型自动生成问题并自我改进视觉理解与图像生成能力。

Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards

论文配图:Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards
图 1 · 摘自论文原文
  • 三角色协同:提问、解答与生成,全靠内部一致性信号训练。
  • 在多个数据集上提升3.5%理解准确率,图像生成评测得分从82%升至85%。
  • 适用于多种模型架构,可直接复用原生接口,适合研究统一多模态系统者。

当前多数统一多模态模型仍依赖人工标注、偏好标签或外部奖励模型进行后训练。本文提出一种自演化训练框架,仅使用无标签图像,通过三个内生角色实现自主优化:提问者生成视觉问题,求解者回答并评估,生成者合成图像。训练全程依赖自衍生的一致性信号,无需人类标注、偏好标签或任务专用外部评分模型。为稳定学习,引入基于词元预测不确定性的求解者熵(STE)作为连续难度信号。针对图像生成,设计多尺度内部评估机制,结合问答保真度评分与循环一致的图文描述。该机制实现求解者对生成质量的反馈闭环,更好理解推动更可靠生成评估。框架在扩散模型BLIP3o、修正流BAGEL及自回归模型VARGPT-v1.1上均保持一致的角色分解、奖励逻辑与训练流程,仅需各基线模型的原生提示与生成接口。在八项理解指标上持续超越基础模型;在BAGEL上,MMMU准确率提升3.5%,GenEval生成性能从82%增至85%。代码与模型已公开。

原文摘要 · Abstract (English)

Most unified large multimodal models (LMMs) that support both visual understanding and image generation still rely on curated post-training supervision, such as human annotations, preference labels, or external reward models. We ask whether a unified LMM can improve both abilities autonomously using only unlabeled images. We propose a self-evolving training framework with three internal roles: a Proposer that generates visual questions, a Solver that answers and evaluates them, and a Generator that synthesizes images. Training uses only self-derived consistency signals, without human annotations, preference labels, or task-trained external reward/judge models. To stabilize learning, we introduce Solver Token Entropy (STE), a continuous difficulty signal based on token-level prediction uncertainty that remains useful even when sample-level consistency becomes unreliable. For image generation, we design a multi-scale internal evaluation scheme that combines question-answer fidelity scoring with cycle-consistent captioning. This creates a solver-mediated coupling, where better visual understanding enables more reliable generation assessment and stronger internal training signals. The framework preserves the same role decomposition, reward logic, and training schedule across diffusion-based BLIP3o, rectified-flow BAGEL, and autoregressive VARGPT-v1.1 architectures, requiring only each backbone's native prompting and generation interface. Across eight understanding metrics, our method consistently improves over the corresponding base models. On BAGEL, it achieves a $+3.5\%$ absolute gain on MMMU and improves GenEval image generation performance from $82\%$ to $85\%$. Code and models are publicly released.

多模态自演化生成评估统一模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。