用可学习势能优化生成模型的路径选择,提升图像质量
Action-Inspired Generative Models

- 引入轻量级势能函数在线评分桥接样本,指导生成路径
- 仅占主网络1.4%参数,不增加推理开销,效果提升显著
- 适合希望改进扩散模型生成质量的研究者和开发者
我们提出动作启发的生成模型(AGMs),一种双网络生成框架。现有桥接匹配方法对运输路径中的每个随机转移赋予相同回归权重,无论其是否具有结构连贯性。为此,我们引入一个轻量级可学习标量势能 $V_ϕ$,在线评分桥接样本,并通过带停止梯度屏障的权重调节漂移目标,防止两网络间对抗反馈,同时保留 $V_ϕ$ 的引导信号。关键的是,$V_ϕ$ 仅占主漂移网络约1.4%的参数量,不增加推理图开销,无需迭代半桥拟合或辅助随机微分方程求解器,可直接嵌入任意桥接匹配训练循环。推理时完全丢弃 $V_ϕ$,仅使用指数移动平均(EMA)漂移的欧拉-马鲁雅姆积分。实验表明,通过学习势能选择性惩罚无信息运输路径,可在保真度与覆盖度指标上一致提升生成质量。
原文摘要 · Abstract (English)
We introduce Action-Inspired Generative Models (AGMs), a dual-network generative framework motivated by the observation that existing bridge-matching methods assign uniform regression weight to every stochastic transition in the transport landscape, regardless of whether a given bridge sample lies along a structurally coherent trajectory or a degenerate one. We address this by introducing a lightweight learned scalar potential $V_ϕ$ that scores bridge samples online and modulates the drift objective via importance weights derived through a stop-gradient barrier -- preventing adversarial feedback between the two networks whilst preserving $V_ϕ$'s guiding signal. Crucially, $V_ϕ$ comprises only $\sim$1.4% of the primary drift network's parameter count, adds no overhead to the inference graph, and requires no iterative half-bridge fitting or auxiliary stochastic differential equation (SDE) solvers: it is a plug-and-play enhancement to any bridge-matching training loop. At inference, $V_ϕ$ is discarded entirely, leaving standard Euler-Maruyama integration of the exponential moving average (EMA) drift. We demonstrate that selectively penalising uninformative transport paths through the learned potential yields consistent improvements in generation quality across fidelity and coverage metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。