用轻量侧网加速生成模型,10次函数求值媲美传统100次效果
Bi-Anchor Interpolation Solver for Accelerating Generative Modeling
- 侧网学习双向速度,不重训练主干
- 5-10次求值即可达到100次精度
- 零训练成本,可直接接入现有生成流程
流匹配(Flow Matching)模型在高保真生成中表现突出,但依赖迭代常微分方程求解带来显著延迟。现有方法面临两难:无训练的求解器在低神经函数求值(NFE)下性能下降严重,而训练型或一步生成方法则训练成本高且难以即插即用。为此,我们提出双锚点插值求解器(BA-solver)。该方法在保持标准无训练求解器灵活性的同时,通过引入轻量级侧网(仅占主干1-2%大小)实现显著加速。核心由两个协同组件构成:1)双向时间感知,侧网无需重训练即可逼近未来与历史速度;2)双锚点速度融合,利用侧网与两个锚点速度高效近似中间速度,支持批处理高阶积分。通过主干建立高精度“锚点”,侧网密化轨迹,使大步长下误差最小化。在ImageNet-256²上的实验证明,BA-solver仅需10次NFE即可达到100+ NFE欧拉求解器的生成质量,并在5次NFE下仍保持高保真度,训练成本可忽略。此外,该方法可无缝集成至现有生成流程,支持图像编辑等下游任务。
原文摘要 · Abstract (English)
Flow Matching (FM) models have emerged as a leading paradigm for high-fidelity synthesis. However, their reliance on iterative Ordinary Differential Equation (ODE) solving creates a significant latency bottleneck. Existing solutions face a dichotomy: training-free solvers suffer from significant performance degradation at low Neural Function Evaluations (NFEs), while training-based one- or few-steps generation methods incur prohibitive training costs and lack plug-and-play versatility. To bridge this gap, we propose the Bi-Anchor Interpolation Solver (BA-solver). BA-solver retains the versatility of standard training-free solvers while achieving significant acceleration by introducing a lightweight SideNet (1-2% backbone size) alongside the frozen backbone. Specifically, our method is founded on two synergistic components: \textbf{1) Bidirectional Temporal Perception}, where the SideNet learns to approximate both future and historical velocities without retraining the heavy backbone; and 2) Bi-Anchor Velocity Integration, which utilizes the SideNet with two anchor velocities to efficiently approximate intermediate velocities for batched high-order integration. By utilizing the backbone to establish high-precision ``anchors'' and the SideNet to densify the trajectory, BA-solver enables large interval sizes with minimized error. Empirical results on ImageNet-256^2 demonstrate that BA-solver achieves generation quality comparable to 100+ NFEs Euler solver in just 10 NFEs and maintains high fidelity in as few as 5 NFEs, incurring negligible training costs. Furthermore, BA-solver ensures seamless integration with existing generative pipelines, facilitating downstream tasks such as image editing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。