arXiv:2605.17969cs.CV2026-05

让AI自动理解用户意图,智能调整图像生成步骤。

Generation Navigator: A State-Aware Agentic Framework for Image Generation

论文配图:Generation Navigator: A State-Aware Agentic Framework for Image Generation
图 1 · 摘自论文原文
  • 基于状态动态决策下一步操作,避免反复试错。
  • 在T2I-ReasonBench上达到79.06%推理准确率和0.90的WISE分数。
  • 适合需要精准控制生成过程的研究者与开发者。

尽管文本到图像生成技术快速进步,但忠实实现用户意图仍具挑战性,常需人工多轮调试。现有系统或依赖简单提示重写,或采用规则驱动的闭环代理,难以自适应生成过程变化。本文将图像生成重构为状态感知的动作决策问题,提出Generation Navigator——一个能动态引导生成轨迹的多轮文本到图像代理。然而,通过强化学习训练该代理面临关键的信用分配难题:仅以单个状态奖励整个轨迹会平均分配信用,忽略各轮质量变化,无法区分促进进展与浪费步骤的动作。为此,我们提出PRE-GRPO(峰值保留效率组相对策略优化)目标,从三方面优化:奖励发现高质量图像(峰值)、避免后续质量下降(保留)、减少无效轮次(效率)。实验表明,该方法在多个基准上显著提升性能,达WISE分数0.90及T2I-ReasonBench上79.06%推理准确率。

原文摘要 · Abstract (English)

Despite rapid advances in text-to-image generation, faithfully realizing user intent remains challenging, often requiring manual multi-turn trial and error. To automate this process, existing systems rely on either simple prompt rewriting or closed-loop agents driven by hand-crafted rules, rather than learning to adapt actions to the evolving generation process. In this paper, we reformulate image generation as a state-conditioned action-making problem and propose Generation Navigator, a multi-turn T2I agent that learns to dynamically steer the generation trajectory and output the next action. However, training this agent via reinforcement learning introduces a critical credit assignment challenge: naively rewarding a trajectory based solely on a single state assigns equal credit to all actions in the rollout, ignores the quality dynamics across turns, and fails to distinguish actions that improve the trajectory from those that degrade it or waste turns without progress. We resolve this with PRE-GRPO (Peak-Retention-Efficiency Group Relative Policy Optimization), a trajectory-level reinforcement learning objective that explicitly rewards discovering a high-quality image (Peak), avoiding subsequent quality degradation across turns (Retention), and minimizing unnecessary turns (Efficiency). Experiments show substantial improvements across benchmarks, reaching a WISE score of 0.90 and 79.06% reasoning accuracy on T2I-ReasonBench.

图像生成强化学习智能代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。