arXiv:2602.20730cs.LG2026-02

用Mamba提升组合优化效率,训练快内存省。

Rethinking Efficiency in Neural Combinatorial Optimization: Batched Preference Optimization with Mamba

  • 分两阶段训练:先预解法微调,再批量偏好优化
  • 在TSP和CVRP上比现有神经方法更快更省内存
  • 仅训练时用局部搜索增强对比,推理零开销

我们以效率为核心目标,提出ECO框架,结合批量偏好优化与Mamba主干网络。ECO通过两阶段解耦策略:先在预计算解上进行监督微调,再对当前策略生成的批量候选解集进行迭代直接偏好优化(DPO)。采用混合Mamba编码器-解码器结构,有效降低长序列下的内存增长并提升硬件利用率。训练中引入局部搜索引导的自举策略,扩大偏好差距,稳定迭代过程,但该策略仅用于训练构建更强偏好对,推理时完全不使用。在旅行商问题(TSP)和容量约束车辆路径问题(CVRP)上,ECO在所有对比神经基线中表现最优,同时显著降低内存占用并提升吞吐量。我们进一步分析了内存扩展性、吞吐量及各模块贡献。

原文摘要 · Abstract (English)

We study efficiency as a first-class objective in Neural Combinatorial Optimization (NCO) and present ECO, an efficient learning framework that combines batched preference optimization with a Mamba backbone. Instead of tightly interleaving every policy update with on-policy rollouts, ECO decouples trajectory generation from gradient updates through two stages: supervised warm-up on pre-computed solutions and iterative Direct Preference Optimization (DPO) on batched candidate sets generated by the current policy. We pair this learning pipeline with a mixed Mamba encoder-decoder that reduces memory growth on long sequences and improves hardware utilization. A local-search-guided bootstrapping strategy is further used during training to widen preference margins and stabilize iterative improvement. Importantly, local search is only used to construct stronger preference pairs during training and is never invoked at inference time. On TSP and CVRP, ECO achieves the strongest overall performance among the compared neural baselines while also delivering clear advantages in memory usage and throughput. We provide additional analysis on memory scaling, throughput, and the contribution of each design component.

组合优化Mamba高效训练偏好优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。