让图像生成具备可执行的逻辑推理能力,突破现有模型的指令理解瓶颈。
Unified Thinker: A General Reasoning Modular Core for Image Generation
- 分离推理与生成模块,用可插拔的思维核心规划生成路径
- 通过像素级反馈强化学习,使计划更关注图像真实而非文字合理
- 适配多种生成模型,显著提升复杂指令下的图像质量
尽管高保真图像合成取得显著进展,生成模型在逻辑密集型指令遵循方面仍存在明显不足,暴露了推理与执行之间的鸿沟。封闭源代码系统(如 Nano Banana)已展现出强大的推理驱动图像生成能力,凸显当前开源模型的巨大差距。我们认为,弥补这一差距不仅需要更优的视觉生成器,更需可执行的推理:将高层意图分解为可验证、与现实对齐的计划,直接引导生成过程。为此,我们提出 Unified Thinker,一种面向通用图像生成的任务无关推理架构,作为可插入各类生成器与工作流的统一规划核心。Unified Thinker 将专用推理模块(Thinker)与图像生成器解耦,实现推理能力的模块化升级而无需重训练整个生成模型。我们进一步设计两阶段训练范式:首先构建思考者结构化规划接口,再通过强化学习将其策略基于像素级反馈进行优化,鼓励生成在视觉上正确而非仅文本合理的方案。在文本到图像生成和图像编辑任务上的大量实验表明,Unified Thinker 显著提升了图像推理与生成质量。
原文摘要 · Abstract (English)
Despite impressive progress in high-fidelity image synthesis, generative models still struggle with logic-intensive instruction following, exposing a persistent reasoning--execution gap. Meanwhile, closed-source systems (e.g., Nano Banana) have demonstrated strong reasoning-driven image generation, highlighting a substantial gap to current open-source models. We argue that closing this gap requires not merely better visual generators, but executable reasoning: decomposing high-level intents into grounded, verifiable plans that directly steer the generative process. To this end, we propose Unified Thinker, a task-agnostic reasoning architecture for general image generation, designed as a unified planning core that can plug into diverse generators and workflows. Unified Thinker decouples a dedicated Thinker from the image Generator, enabling modular upgrades of reasoning without retraining the entire generative model. We further introduce a two-stage training paradigm: we first build a structured planning interface for the Thinker, then apply reinforcement learning to ground its policy in pixel-level feedback, encouraging plans that optimize visual correctness over textual plausibility. Extensive experiments on text-to-image generation and image editing show that Unified Thinker substantially improves image reasoning and generation quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。