arXiv:2608.19540cs.LGcs.CV2026-08

统一加速多类生成模型,实现少步高质量图像生成。

Continuous Adversarial MeanFlow Transfer

论文配图:Continuous Adversarial MeanFlow Transfer
图 1 · 摘自论文原文
  • 将不同源模型映射到共享速度表示,统一适配与加速流程。
  • 新方法在125倍少计算量下达到或超越微调效果,少步生成质量提升29%。
  • 适合需要快速生成且数据有限的场景,如跨域图像合成。

在数据有限的情况下,快速训练新领域生成模型仍面临两大挑战:一是将预训练扩散或流模型迁移到新领域时,其高成本的多步采样难以解决;现有加速方法依赖特定参数化(ε, x, v, u),导致异构模型无法共享加速目标。二是对抗性优化虽能提升少步生成质量,但仅适用于瞬时速度流,不适用于平均速度流(MeanFlow)预测的有限区间平均速度。为此,本文提出MeanFlow-Transfer,将异构源模型输出映射至共享速度表示,用源权重初始化目标域的均值流生成器,并在目标域上优化均值流目标。该方法在单一训练流程中实现迁移与加速的统一。进一步提出连续对抗均值流(CAMF),将连续对抗流从瞬时速度扩展至均值流的有限区间平均速度。CAMF通过对比真实与生成区间端点的潜在函数变化,恢复均值流回归丢失的细节,在区间趋于零时退化为瞬时准则。在四个基于ImageNet的源模型(DiT(ε)、SiT(v)、JiT(x)、iMF(u))迁移至五个目标域的实验中,结合MF-T与CAMF的方法,在最多减少125倍神经函数评估次数(NFE)的前提下,达到或超越微调教师模型的FID和FDD性能,且在少步生成中平均提升FID 29%。

原文摘要 · Abstract (English)

Training fast generators on new domains with limited data remains challenging for two reasons. First, adapting a pretrained diffusion or flow model to a new domain leaves its costly multi-step sampling unaddressed, and existing acceleration methods are tied to the source parameterization--$ε$, $x$, $v$, or $u$--leaving heterogeneous pretrained models with no common acceleration target. Second, while adversarial refinement is proven effective for few-step quality, it is formulated only for instantaneous-velocity flows, not for the finite-interval average velocities that MeanFlow (MF) models predict. We address both problems. We propose MeanFlow-Transfer, which maps heterogeneous source outputs into a shared velocity representation, uses it to initialize an MF generator from the source weights, and optimizes an MF objective on the target domain. This unifies adaptation and acceleration in a single training loop across a broad range of pretrained models. We then introduce Continuous Adversarial MeanFlow, a post-training stage that extends continuous adversarial flow models from instantaneous velocities to MF's finite-interval average velocities. CAMF contrasts changes in a learned potential between real and predicted interval endpoints, recovering fine detail that MF regression averages away, and reduces to the instantaneous criterion in the vanishing-interval limit. Adapting four ImageNet-based source models--DiT ($ε$), SiT ($v$), JiT ($x$), iMF ($u$)--to five target domains, MF-T with CAMF matches or exceeds the fine-tuned teacher in FID and FDD at up to $125\times$ fewer Neural Function Evaluations (NFEs), while CAMF improves MF-T's few-step FID by $29\%$ on average.

生成模型加速采样跨域迁移均值流

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。