arXiv:2502.02941cs.LG2025-02NeurIPS被引 60

让扩散模型一步生成高质量解,效率提升数十倍。

Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimization

  • 通过优化一致性训练,直接学习不同噪声水平到最优解的映射。
  • 单步生成即可超越需数百步的现有方法,且在TSP和MIS上表现更优。
  • 适合需要快速求解的组合优化场景,尤其适用于时间受限任务。

扩散模型最近成为神经求解器的强大骨干,但其多噪声层级的迭代采样过程带来显著开销。本文提出直接学习从不同噪声水平到给定实例最优解的映射,通过优化一致性训练协议,在同一实例上最小化不同生成轨迹与时间步样本相对于最优解的差异。所提模型支持单步生成高质量解,同时保留多步采样以权衡质量与速度,为神经求解器提供更高效替代方案。此外,在训练到测试(T2T)框架中,引入一种基于一致性的梯度搜索机制,通过在噪声注入与去噪交替过程中,以目标梯度引导潜变量解概率更新,增强对训练所学解空间的探索能力。该模型称为Fast T2T。在旅行商问题(TSP)与最大独立集(MIS)两个任务上的大量实验表明,其在解质量和效率上均具优势,甚至在有限时间预算下优于LKH。值得注意的是,仅需一步生成与一步梯度搜索的Fast T2T,即可普遍超越依赖数百步的最先进扩散模型,实现数十倍加速。

原文摘要 · Abstract (English)

Diffusion models have recently advanced Combinatorial Optimization (CO) as a powerful backbone for neural solvers. However, their iterative sampling process requiring denoising across multiple noise levels incurs substantial overhead. We propose to learn direct mappings from different noise levels to the optimal solution for a given instance, facilitating high-quality generation with minimal shots. This is achieved through an optimization consistency training protocol, which, for a given instance, minimizes the difference among samples originating from varying generative trajectories and time steps relative to the optimal solution. The proposed model enables fast single-step solution generation while retaining the option of multi-step sampling to trade for sampling quality, which offers a more effective and efficient alternative backbone for neural solvers. In addition, within the training-to-testing (T2T) framework, to bridge the gap between training on historical instances and solving new instances, we introduce a novel consistency-based gradient search scheme during the test stage, enabling more effective exploration of the solution space learned during training. It is achieved by updating the latent solution probabilities under objective gradient guidance during the alternation of noise injection and denoising steps. We refer to this model as Fast T2T. Extensive experiments on two popular tasks, the Traveling Salesman Problem (TSP) and Maximal Independent Set (MIS), demonstrate the superiority of Fast T2T regarding both solution quality and efficiency, even outperforming LKH given limited time budgets. Notably, Fast T2T with merely one-step generation and one-step gradient search can mostly outperform the SOTA diffusion-based counterparts that require hundreds of steps, while achieving tens of times speedup.

扩散模型组合优化快速求解T2T

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。