arXiv:2605.18454cs.LGcs.AI2026-05

用可读可改的程序代替黑箱模型,实现高效且可信的排产决策。

Scheduling That Speaks: An Interpretable Programmatic Reinforcement Learning Framework

论文配图:Scheduling That Speaks: An Interpretable Programmatic Reinforcement Learning Framework
图 1 · 摘自论文原文
  • 设计专用编程语言表示排产策略,将规则写成人类可读的程序。
  • 在仅100次训练下仍能超越传统启发式和深度强化学习方法。
  • 适合需要透明决策、资源受限的工业场景使用。

深度强化学习(DRL)在解决作业车间调度等组合优化问题上展现出潜力,但其策略通常由深层神经网络(DNN)表示,存在架构不透明、决策难解释的问题,影响人类信任与实际应用。此外,DNN的高计算需求也限制了其在资源受限环境中的部署。本文提出ProRL,一种可解释的程序化强化学习框架,通过结构化程序实现高性能排产。我们首先设计面向调度的领域特定语言(DSL-S),将调度策略表示为可读程序;随后利用局部搜索探索程序空间,识别不完整程序,并通过贝叶斯优化学习参数完成程序。ProRL能够自动选择现有工业中使用的启发式规则,实现自然集成。在广泛使用的基准实例上,其性能优于现有启发式和DRL基线。尤其在极端资源约束下表现优异,如仅用100次训练迭代即可达成良好效果。代码已开源:https://github.com/HcPlu/ProRL。

原文摘要 · Abstract (English)

Deep reinforcement learning (DRL) has recently emerged as a promising approach to solve combinatorial optimization problems such as job shop scheduling. However, the policies learned by DRL are typically represented by deep neural networks (DNNs), whose opaque neural architectures and non-interpretable policy decisions can lead to critical trust and usability concerns for human decision makers. In addition, the computational requirements of DNNs can further hinder practical deployment in resource constrained environments. In this work, we propose ProRL, a novel interpretable programmatic reinforcement learning framework that achieves high-performance scheduling with human-readable and editable programmatic policies (i.e., programs). We first introduce a domain-specific language for scheduling (DSL-S) to represent scheduling strategies as structured programs. ProRL then explores the program space defined by DSL-S using local search to identify incomplete programs, which are subsequently completed by learning their parameters via Bayesian optimization. ProRL learns which scheduling heuristic rules to select, and hence, it naturally incorporates existing heuristics already used in industrial scenarios. Experiments on widely used benchmark instances demonstrate the strong performance of ProRL against existing heuristics and DRL baselines. Furthermore, ProRL performs well under strongly constrained computational resources, such as training with only 100 episodes. Our code is available at https://github.com/HcPlu/ProRL.

强化学习可解释性调度优化程序化策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。