让图像生成过程自动学习每张图的最佳参数,提升质量与效率。
AdaGen: Learning Adaptive Policy for Image Synthesis
- 用强化学习训练轻量策略网络,动态决定每一步生成参数。
- 在四种生成模型上验证,降低3倍推理成本,FID提升至1.59。
- 自适应奖励机制避免传统奖励失效,支持可控的画质多样性调节。
近期图像生成进展依赖于强大的生成模型,如掩码生成变压器(MaskGIT)、自回归模型、扩散模型和修正流模型。这些方法的成功普遍基于将生成过程分解为多个步骤,但这也导致每步需配置大量特定参数(如噪声水平或温度)。现有方法通常依赖人工设计规则管理复杂性,需专家经验且难以适配不同样本,性能受限。为此,我们提出AdaGen,一种通用、可学习、样本自适应的迭代生成调度框架。具体地,将调度问题建模为马尔可夫决策过程,由轻量策略网络根据当前生成状态确定参数,并通过强化学习训练。值得注意的是,我们发现简单奖励设计(如FID或预训练奖励模型)易被欺骗,无法可靠保证生成质量与多样性,因此提出对抗性奖励机制引导策略网络训练。最后引入推理时优化策略及可控保真度-多样性权衡机制,进一步提升性能与灵活性。在四种生成范式上的实验验证了其优越性:例如,在DiT-XL上实现3倍更低推理成本,将VAR的FID从1.92降至1.59,计算开销可忽略。
原文摘要 · Abstract (English)
Recent advances in image synthesis have been propelled by powerful generative models, such as Masked Generative Transformers (MaskGIT), autoregressive models, diffusion models, and rectified flow models. A common principle behind their success is the decomposition of synthesis into multiple steps. However, this introduces a proliferation of step-specific parameters (e.g., noise level or temperature at each step). Existing approaches typically rely on manually-designed rules to manage this complexity, demanding expert knowledge and trial-and-error. Furthermore, these static schedules lack the flexibility to adapt to the unique characteristics of each sample, yielding sub-optimal performance. To address this issue, we present AdaGen, a general, learnable, and sample-adaptive framework for scheduling the iterative generation process. Specifically, we formulate the scheduling problem as a Markov Decision Process, where a lightweight policy network determines suitable parameters given the current generation state, and can be trained through reinforcement learning. Importantly, we demonstrate that simple reward designs, such as FID or pre-trained reward models, can be easily hacked and may not reliably guarantee the desired quality or diversity of generated samples. Therefore, we propose an adversarial reward design to guide the training of the policy networks. Finally, we introduce an inference-time refinement strategy and a controllable fidelity-diversity trade-off mechanism to further enhance the performance and flexibility of AdaGen. Comprehensive experiments on four generative paradigms validate the superiority of AdaGen. For example, AdaGen achieves better performance on DiT-XL with 3 times lower inference cost and improves the FID of VAR from 1.92 to 1.59 with negligible computational overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。