arXiv:2606.26769cs.AIcs.CV2026-06中稿 · ECCV被引 8

提出ResilPhase框架,实现扩散模型高速推理且保持高画质。

ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Acceleration

论文配图:ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Acceleration
图 1 · 摘自论文原文
  • 将加速推理转化为稳定宏轨迹外推,避免特征错位与数值不稳。
  • 在FLUX.1-dev和HunyuanVideo上实现高压缩比下领先画质。
  • 适合需要高速生成且对稳定性要求高的视频/图像生成场景。

强大的扩散模型因推理延迟高而难以应用。现有‘缓存-预测’方案通过基于导数的多项式加速扩散模型(DiTs),但在高加速比下质量严重下降。我们分析发现根源在于:对与连续扩散轨迹错位且数值不稳定的表示进行离散外推,导致空间误差累积、导数放大噪声及高阶不稳定性。为此,我们将加速推理重新定义为常微分方程(ODE)空间中的稳定宏轨迹外推。不预测中间特征,而是对齐模型的全局漂移(GD),即端到端状态演化,从而消除特征不一致和内存开销。然而,即使该平滑宏轨迹仍受导数谬误影响——其高阶时间导数本质上噪声大。因此,我们引入无导数的重心拉格朗日外推器,有效规避导数不稳定性与近似误差。进一步设计有界相位映射,约束外推域以抑制振荡误差增长。上述组件共同构成抗噪的ResilPhase加速框架。在FLUX.1-dev和HunyuanVideo上的实验表明,该方法在激进加速比下实现了最先进保真度。

原文摘要 · Abstract (English)

The adoption of powerful diffusion models is hindered by their significant inference latency. Recent ``cache-then-forecast'' schemes alleviate this issue by accelerating DiTs using derivative-based polynomials, but they suffer from severe quality degradation at high acceleration ratios. Our analysis reveals its root cause: the discrete extrapolation performed on representations that are misaligned with the continuous diffusion trajectory and are numerically unstable. Thus, accelerated DiTs suffer from accumulated spatial errors, noisy derivative amplification, and high-order instability. We therefore reformulate accelerated inference as stable macro-trajectory extrapolation in ordinary differential equation (ODE) space. Instead of predicting intermediate features, we align forecasting with the model's Global Drift (GD), i.e., the end-to-end state evolution, thereby eliminating feature inconsistency and memory overhead. However, even this smooth macro-trajectory remains vulnerable to the derivative fallacy: its higher-order temporal derivatives are intrinsically noisy. Thus, we introduce a derivative-free barycentric Lagrange extrapolator to effectively bypass derivative instability and approximation error. We further propose a bounded Phase Mapping that regularizes the extrapolation domain, suppressing oscillatory error growth. These elements collectively constitute ResilPhase, a noise-resilient acceleration framework. Experiments on FLUX.1-dev and HunyuanVideo demonstrate state-of-the-art fidelity under aggressive acceleration ratios.

扩散模型加速推理轨迹外推抗噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。