用强化学习提升视觉生成模型的复杂场景理解能力。
GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
- 通过强化学习让模型自主探索推理策略,突破固定模板限制。
- 在T2I-CompBench上显著提升组合性任务表现,空间关系准确率大幅提高。
- 适合关注多对象精准布局生成的研究者与开发者。
视觉生成模型在根据文本提示生成逼真图像方面取得了显著进展,但在处理包含多个物体、精确空间关系和属性描述的复杂提示时仍存在困难。有效应对此类提示需要对语义内容和空间布局进行显式推理。我们提出GoT-R1框架,利用强化学习增强视觉生成中的语义-空间推理能力。基于生成链式思维方法,GoT-R1使模型能够通过精心设计的强化学习机制,自主发现超越预设模板的有效推理策略。为此,我们设计了双阶段多维奖励机制,利用多模态大模型(MLLM)评估推理过程与最终输出,实现对整个生成流程的有效监督。该奖励系统统一评估语义一致性、空间准确性与视觉质量。实验结果表明,GoT-R1在T2I-CompBench基准上取得显著提升,尤其在涉及精确空间关系与属性绑定的组合性任务中表现优异。GoT-R1成功将复杂推理能力迁移至视觉生成领域,推动了图像生成技术的前沿发展。为促进后续研究,代码与预训练模型已公开于https://github.com/gogoduan/GoT-R1。
原文摘要 · Abstract (English)
Visual generation models have made remarkable progress in creating realistic images from text prompts, yet struggle with complex prompts that specify multiple objects with precise spatial relationships and attributes. Effective handling of such prompts requires explicit reasoning about the semantic content and spatial layout. We present GoT-R1, a framework that applies reinforcement learning to enhance semantic-spatial reasoning in visual generation. Building upon the Generation Chain-of-Thought approach, GoT-R1 enables models to autonomously discover effective reasoning strategies beyond predefined templates through carefully designed reinforcement learning. To achieve this, we propose a dual-stage multi-dimensional reward framework that leverages MLLMs to evaluate both the reasoning process and final output, enabling effective supervision across the entire generation pipeline. The reward system assesses semantic alignment, spatial accuracy, and visual quality in a unified approach. Experimental results demonstrate significant improvements on T2I-CompBench benchmark, particularly in compositional tasks involving precise spatial relationships and attribute binding. GoT-R1 advances the state-of-the-art in image generation by successfully transferring sophisticated reasoning capabilities to the visual generation domain. To facilitate future research, we make our code and pretrained models publicly available at https://github.com/gogoduan/GoT-R1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。