arXiv:2605.16789cs.CV2026-05被引 1

通过轨迹感知缓存加速修正流模型,提升生成速度与质量。

Accelerating Rectified Flow Models via Trajectory-Aware Caching

论文配图:Accelerating Rectified Flow Models via Trajectory-Aware Caching
图 1 · 摘自论文原文
  • 将速度场分解为平行与正交分量,分离误差来源。
  • 文本到图像生成最高提速4.14倍,视频生成提速2.11倍。
  • 无需训练,适用于高保真图像视频生成任务。

扩散模型和修正流(RF)模型能生成高质量图像与视频,但其迭代速度场评估计算成本高昂。现有缓存方法通过跳过时间步加速采样,但粗略近似在长跳步间隔下累积误差,导致加速过激时质量下降。本文提出TACache(轨迹感知缓存),一种无需训练的加速框架,遵循‘先跳步再补偿’范式。TACache对离散速度场沿RF轨迹进行正交分解,分离出平行分量与正交残差,分别捕捉每步近似误差的大小与方向来源。该框架分两阶段运行:离线阶段,基于累积变化阈值确定跳步计划,并限制每段跳步最大长度;在线阶段,每个跳步处结合离线统计与样本历史正交方向,重建跳过的速度,无需额外模型评估。在BAGEL、FLUX.1-dev和Wan2.1-1.3B数据集上的实验表明,TACache在文本到图像生成中实现最高4.14倍加速,在文本到视频生成中实现2.11倍加速,且在所有参考基保真度指标上均优于已有缓存方法。代码即将发布。

原文摘要 · Abstract (English)

Diffusion and rectified flow (RF) models generate high-fidelity images and videos, but their iterative velocity-field evaluations are computationally expensive. Existing caching methods accelerate sampling by skipping timesteps, yet their coarse approximations introduce accumulated errors over long skip intervals and degrade quality under aggressive acceleration. We propose TACache (Trajectory-Aware Cache), a training-free acceleration framework following a skip-then-compensate paradigm. TACache performs an orthogonal decomposition of discrete velocity acceleration along the RF trajectory into a parallel component and an orthogonal residual, isolating the magnitude and directional sources of per-step approximation error. The framework operates in two stages: offline, cumulative variation thresholds on the magnitude and direction indicators yield the skip schedule and bound how far each skip interval may extend; online, at each skipped step the offline statistics are combined with the sample's historical orthogonal direction to reconstruct the skipped velocity without additional model evaluations. Experiments on BAGEL, FLUX.1-dev, and Wan2.1-1.3B show that TACache achieves up to 4.14 speedup on text-to-image generation and 2.11 speedup on text-to-video generation, with consistent improvements over prior cache-based methods on all reference-based fidelity metrics. Code will be released soon.

修正流加速生成缓存优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。