用强化学习优化约束规划搜索树,提速超2倍并刷新多项基准记录
Reinforcement Learning for Search Tree Size Minimization in Constraint Programming: New Results on Scheduling Benchmarks
- 将搜索树最小化转化为多臂赌博机问题,用强化学习动态选择分支策略
- 在JSSP和RCPSP上分别提速1.7倍和2.1倍,且优于当前最优算法
- 在有限时间内提升大量实例下界,部分难题被完全求解
失败导向搜索(FDS)是约束规划中一种高效的完整搜索算法,尤其适用于调度问题。本文分析发现,通过有排名的分支决策来最小化FDS搜索树大小,等价于多臂赌博机(MAB)问题。基于此,将MAB强化学习算法引入FDS,结合问题特异性改进与参数调优,并在作业车间调度(JSSP)和资源受限项目调度(RCPSP)两大基础调度问题上进行评估。所提出的增强型FDS在新开发的OptalCP求解器中,相较原版实现分别提速1.7倍(JSSP)和2.1倍(RCPSP);同时比IBM CP Optimizer 22.1中的现有最先进FDS算法快3.5倍(JSSP)和2.1倍(RCPSP)。此外,在每实例仅900秒时间限制下,该方法提升了84个标准JSSP实例中的78个、393个RCPSP实例中的226个的已有最优下界,并成功完全关闭其中若干难题。
原文摘要 · Abstract (English)
Failure-Directed Search (FDS) is a significant complete generic search algorithm used in Constraint Programming (CP) to efficiently explore the search space, proven particularly effective on scheduling problems. This paper analyzes FDS's properties, showing that minimizing the size of its search tree guided by ranked branching decisions is closely related to the Multi-armed bandit (MAB) problem. Building on this insight, MAB reinforcement learning algorithms are applied to FDS, extended with problem-specific refinements and parameter tuning, and evaluated on the two most fundamental scheduling problems, the Job Shop Scheduling Problem (JSSP) and Resource-Constrained Project Scheduling Problem (RCPSP). The resulting enhanced FDS, using the best extended MAB algorithm and configuration, performs 1.7 times faster on the JSSP and 2.1 times faster on the RCPSP benchmarks compared to the original implementation in a new solver called OptalCP, while also being 3.5 times faster on the JSSP and 2.1 times faster on the RCPSP benchmarks than the current state-of-the-art FDS algorithm in IBM CP Optimizer 22.1. Furthermore, using only a 900-second time limit per instance, the enhanced FDS improved the existing state-of-the-art lower bounds of 78 of 84 JSSP and 226 of 393 RCPSP standard open benchmark instances while also completely closing a few of them.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。