arXiv:2605.19052stat.MLcs.LG2026-05中稿 · ICML被引 2

用机器学习优化整数规划松弛法,理论证明其效果极限与最优算法。

Provably Data-driven Lagrangian Relaxation for Mixed Integer Linear Programming

  • 将松弛乘子学习建模为统计学习问题,给出通用泛化误差界。
  • 证明样本量N下误差至少为Ω(s/√N),线性依赖不可避免。
  • 提出平均随机梯度上升法,达到理论最优收敛速度。

拉格朗日松弛(LR)是求解大规模混合整数线性规划(MILP)的强大工具,尤其适用于具有可分解结构的问题,如车辆路径或机组组合。通过松弛耦合约束,LR支持并行求解子问题,常比标准线性规划松弛提供更紧的对偶界,这对高效分支定界剪枝至关重要。尽管近期实证研究显示机器学习在预测这些乘子方面表现良好,但其理论理解仍不清晰。本文从数据驱动算法设计视角分析学习LR,将其视为问题实例分布上的统计学习问题。贡献如下:首先,推导出学习乘子的泛化界为 𝒪(s^{1.5}/√N),其中s为耦合约束数,N为样本量;其次,给出极小极大下界 Ω(s/√N),证明线性依赖不可避免;第三,构造性地证明带平均的随机梯度上升(SGA)能达到最小极大最优率 Θ(s/√N);最后,将框架扩展至学习预热设置,证明其达到快速且最小极大最优率 Θ(s/N),建立优于直接乘子预测的理论优势。

原文摘要 · Abstract (English)

Lagrangian Relaxation (LR) is a powerful technique for solving large-scale Mixed Integer Linear Programming (MILP), particularly those with decomposable structures, such as vehicle routing or unit commitment problems. By relaxing the coupling constraints, LR enables parallel subproblem solving and often yields tighter dual bounds than standard linear programming relaxations, which is crucial for efficient branch-and-bound pruning. While recent empirical work has shown promising results using machine learning to predict these multipliers, a theoretical understanding of such methods remains an open question. In this work, we bridge this gap by analyzing the problem of learning LR through the lens of Data-driven Algorithm Design, i.e., a statistical learning problem over a distribution of problem instances. Our contributions are as follows: first, we derive a generalization bound of $\mathcal{O}(s^{1.5}/\sqrt{N})$ for the learned multipliers, where $s$ is the number of coupling constraints and $N$ is the sample size. Second, we provide a minimax lower-bound of $Ω(s/\sqrt{N})$, proving that a linear dependency is unavoidable. Third, we constructively close this theoretical gap by proving that Stochastic Gradient Ascent (SGA) with averaging achieves the minimax optimal rate $Θ(s/\sqrt{N})$. Finally, we extend our framework to the learning-to-warm-start setting, proving that it achieves a fast, minimax-optimal rate of $Θ(s/N)$ and establishing a theoretical advantage over direct multiplier prediction.

整数规划机器学习优化理论数据驱动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。