arXiv:2608.29160cs.CVcs.AI2026-09

不修改模型权重,通过循环激活部分注意力层提升图像生成质量。

Training-Free Hidden-State Refinement for Flow-Matching Image Generators

论文配图:Training-Free Hidden-State Refinement for Flow-Matching Image Generators
图 1 · 摘自论文原文
  • 在去噪过程中循环调用选定的Transformer层,实现推理时增强。
  • 在Scale-RAE DiT2.4B上,GenEval提升至0.5691,DPG-Bench达0.8053。
  • 无需训练,兼容现有流程,适合追求高效高质生成的用户。

我们旨在通过在冻结的流匹配图像生成器中引入推理阶段计算来提升性能,而不改变模型权重或外部采样器。现有方法通常通过增加采样步数来提升质量,但会重复评估整个去噪器,导致质量提升与采样成本绑定。关键挑战在于如何在冻结的Transformer去噪器中有效利用额外计算:方法必须决定哪些令牌、层及采样时刻接受重复更新,同时保持原始生成流程不变。本文提出一种无需训练的循环框架,在每次去噪调用中反复应用选定的Transformer层。密集与稀疏令牌循环调整令牌作用范围;采样进度门控和循环层范围确定循环活跃时机与位置;循环次数与强度控制重复更新程度;循环引导融合普通与循环向量场预测。在两个Scale-RAE模型尺度上,循环变体均显著提升主指标与辅助指标,且具备良好的质量-效率权衡。循环引导进一步在所有三个测试模型上提升主指标;在Scale-RAE DiT2.4B上,GenEval从0.4471提升至0.5691,DPG-Bench从0.7656提升至0.8053。代码将开源。

原文摘要 · Abstract (English)

We aim to improve frozen flow-matching image generators by adding inference computation inside the denoiser, without changing model weights or the outer sampler. Existing generators usually spend extra test-time computation by increasing the number of sampling steps, which repeatedly evaluates the entire denoiser and couples quality gains to sampler cost. A key challenge is how to use extra computation inside a frozen transformer denoiser: the method must decide which tokens, layers, and sampling times receive repeated updates while preserving the original generation pipeline. We introduce a training-free looping framework that repeatedly applies selected transformer layers inside each denoising call. Dense and Sparse Token Loop vary the token scope; Sampling-Progress Gating and the loop layer range specify when and where looping is active; loop count and strength control the repeated updates; and Loop Guidance combines ordinary and looped vector-field predictions. Across two Scale-RAE model scales, loop variants improve primary and auxiliary quality metrics with competitive quality--efficiency trade-offs. Loop Guidance further improves both primary metrics across all three tested models; on Scale-RAE DiT2.4B, it raises GenEval from 0.4471 to 0.5691 and DPG-Bench from 0.7656 to 0.8053. Code will be released.

图像生成流匹配推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。