arXiv:2411.15199cs.CVcs.AI2024-11

让扩散模型根据输入自动调整生成过程,提升效率与质量。

Input-Adaptive Generative Dynamics in Diffusion Models

  • 根据输入复杂度动态调整生成轨迹,取代固定流程。
  • 相同质量下平均采样步数减少,生成速度更快。
  • 适合需要高效生成的图像任务,如实时应用。

扩散模型通常通过共享的固定去噪路径生成数据。然而,不同生成目标的复杂度各异,单一预设扩散过程可能并非对所有输入都最优。本文研究输入自适应的生成动力学,使生成过程能根据每张样本的条件进行调整。不同于固定扩散路径,所提框架允许生成动态随输入变化,以满足其生成需求。为此,我们在不同时间步长和噪声调度下训练扩散主干网络,使其能在多种自适应轨迹下稳定运行。在条件图像生成实验中,扩散轨迹可因输入而异,同时保持生成质量并降低平均采样步数。结果证明,相较于依赖单一固定轨迹,输入自适应的生成动力学能带来实际收益。

原文摘要 · Abstract (English)

Diffusion models typically generate data through a fixed denoising trajectory that is shared across all samples. However, generation targets can differ in complexity, suggesting that a single pre-defined diffusion process may not be optimal for every input. In this work, we investigate input-adaptive generative dynamics for diffusion models, where the generation process itself adapts to the conditions of each sample. Instead of relying on a fixed diffusion trajectory, the proposed framework allows the generative dynamics to adjust across inputs according to their generation requirements. To enable this behavior, we train the diffusion backbone under varying horizons and noise schedules, so that it can operate consistently under different input-adaptive trajectories. Experiments on conditional image generation show that diffusion trajectories can vary across inputs while maintaining generation quality and reducing the average number of sampling steps. These results provide a proof of the concept that diffusion processes can benefit from input-adaptive generative dynamics rather than relying on a single fixed trajectory.

扩散模型生成动态自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。