用机器学习提升混合二元二次规划求解速度与质量。
ML-Guided Primal Heuristics for Mixed Binary Quadratic Programs
- 设计新神经网络与训练方法,专用于预测MBQP问题解。
- 结合对比损失与加权交叉熵,显著提升解的质量与泛化能力。
- 在真实风电场布局等任务中表现优于现有方法,适合工业优化场景。
混合二元二次规划(MBQPs)是组合优化中的重要且复杂问题。由于其组合复杂性与非线性特征,大规模求解极具挑战。本文提出基于机器学习的MBQP原始启发式算法,通过扩展已有机器学习指导混合整数线性规划(MILP)求解的方法,构建适用于MBQP的新神经网络架构与训练数据生成流程。我们引入新的损失函数组合,结合对比损失与加权交叉熵,以提升模型预测精度与跨区域泛化能力。在标准与真实世界MBQP基准测试中,所提方法显著优于现有原始启发式及主流求解器。尤其在真实风电场布局优化任务中,采用联合损失训练的模型展现出更强的泛化性能。
原文摘要 · Abstract (English)
Mixed Binary Quadratic Programs (MBQPs) are an important and complex set of problems in combinatorial optimization. As solving large-scale combinatorial optimization problems is challenging, primal heuristics have been developed to quickly identify high-quality solutions within a short amount of time. Recently, a growing body of research has also used machine learning to accelerate solution methods for challenging combinatorial optimization problems. Despite the increasing popularity of these ML-guided methods, a large body of work has focused on Mixed-Integer Linear Programs (MILPs). MBQPs are challenging to solve due to the combinatorial complexity coupled with nonlinearities. This work proposes ML-guided primal heuristics for Mixed Binary Quadratic Programs (MBQPs) by adapting and extending existing work on ML-guided MILP solution prediction to MBQPs. We introduce a new neural network architecture for MBQP solution prediction and a new training data collection procedure. Moreover, we extend existing loss functions in solution prediction and propose to combine contrastive and weighted cross-entropy losses. We evaluate the methods on standard and real-world MBQP benchmarks and show that the developed ML-guided methods significantly outperform existing primal heuristics and state-of-the-art solvers. Furthermore, models trained with our proposed extension with combined losses outperform other ML-based methods adapted from MILPs and improve generalization in cross-regional inference on a real-world wind farm layout optimization problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。