arXiv:2511.18723cs.AIcs.DC2025-11

N2N框架让大规模混合整数规划在分布式环境下更快求解。

N2N: A Parallel Framework for Large-Scale MILP under Distributed Memory

  • 将分支定界节点映射到分布式计算节点,实现高效并行。
  • 在1000个进程下比顶尖工具快1.98至2.08倍,确定性模式也显著领先。
  • 支持多种求解器接入,适合需要大规模优化的科研与工业场景。

并行化已成为加速混合整数线性规划(MILP)求解的有前景方法。然而,分支定界(B&B)框架的复杂性及MILP求解器中众多有效算法组件使得并行化困难。本文提出一种可扩展的并行框架N2N(节点到节点框架),将B&B节点映射至分布式计算节点,以在分布式内存环境中求解大规模问题。该框架支持确定性和非确定性模式,且易于集成现有求解器。在确定性模式下,设计了一种基于滑动窗口的新算法,确保任务按确定顺序生成与求解。此外,还开发了利用约束规划搜索和通用原始启发式等先进技术,充分挖掘分布式资源与基础求解器能力。研究了自适应求解与数据通信优化。将开源求解器SCIP集成至N2N,形成N2N-SCIP。通过大量实验评估其性能,相较于基于UG框架的前沿分布式求解器ParaSCIP,非确定性模式下的N2N-SCIP在鲲鹏和x86集群上分别实现22.52和12.71倍加速,速度提升1.98和2.08倍。在确定性模式下,不同进程数与集群环境下均显著优于ParaSCIP。为验证N2N通用性,还将另一开源求解器HiGHS集成至该框架,分析相关结果,并总结出对基础求解器的要求。

原文摘要 · Abstract (English)

Parallelization has emerged as a promising approach for accelerating MILP solving. However, the complexity of the branch-and-bound (B&B) framework and the numerous effective algorithm components in MILP solvers make it difficult to parallelize. In this study, a scalable parallel framework, N2N (a node-to-node framework that maps the B&B nodes to distributed computing nodes), was proposed to solve large-scale problems in a distributed memory computing environment. Both deterministic and nondeterministic modes are supported, and the framework is designed to be easily integrated with existing solvers. Regarding the deterministic mode, a novel sliding-window-based algorithm was designed and implemented to ensure that tasks are generated and solved in a deterministic order. Moreover, several advanced techniques, such as the utilization of CP search and general primal heuristics, have been developed to fully utilize distributed computing resources and capabilities of base solvers. Adaptive solving and data communication optimization were also investigated. A popular open-source MILP solver, SCIP, was integrated into N2N as the base solver, yielding N2N-SCIP. Extensive computational experiments were conducted to evaluate the performance of N2N-SCIP compared to ParaSCIP, which is a state-of-the-art distributed parallel MILP solver under the UG framework. The nondeterministic N2N-SCIP achieves speedups of 22.52 and 12.71 with 1,000 MPI processes on the Kunpeng and x86 computing clusters, which is 1.98 and 2.08 times faster than ParaSCIP, respectively. In the deterministic mode, N2N-SCIP also shows significant performance improvements over ParaSCIP across different process numbers and computing clusters. To validate the generality of N2N, HiGHS, another open-source solver, was integrated into N2N. The related results are analyzed, and the requirements of N2N on base solvers are also concluded.

优化并行计算MILP分布式

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。