用变分推理解车间调度,训练更稳,泛化更强。
Variational Approach for Job Shop Scheduling
- 将变分推断引入调度问题,分离表征学习与策略优化
- 在DMU和SWV等难题上实现超越现有DRL方法的零样本泛化
- 适合需要稳定、通用调度方案的制造场景
本文提出一种新型变分图到调度器(VG2S)框架,用于求解车间调度问题(JSSP),该问题直接影响制造业的运营效率与资源利用率。传统深度强化学习(DRL)方法常因训练过程非平稳及对未见实例泛化能力差而受限,因其同时优化表征学习与策略执行。为解决此问题,首次将变分推断引入JSSP领域,基于证据下界(ELBO)与最大熵强化学习构建概率目标函数。通过数学上解耦表征学习与策略优化,VG2S框架使智能体通过变分图编码器学习调度实例的鲁棒结构表示,显著提升训练稳定性与对超参数变化的鲁棒性。大量实验表明,该方法在零样本泛化性能上优于当前最优的DRL基线与传统派工规则,尤其在大型且具有挑战性的基准实例(如DMU和SWV)上表现突出。
原文摘要 · Abstract (English)
This paper proposes a novel Variational Graph-to-Scheduler (VG2S) framework for solving the Job Shop Scheduling Problem (JSSP), a critical task in manufacturing that directly impacts operational efficiency and resource utilization. Conventional Deep Reinforcement Learning (DRL) approaches often face challenges such as non-stationarity during training and limited generalization to unseen problem instances because they optimize representation learning and policy execution simultaneously. To address these issues, we introduce variational inference to the JSSP domain for the first time and derive a probabilistic objective based on the Evidence of Lower Bound (ELBO) with maximum entropy reinforcement learning. By mathematically decoupling representation learning from policy optimization, the VG2S framework enables the agent to learn robust structural representations of scheduling instances through a variational graph encoder. This approach significantly enhances training stability and robustness against hyperparameter variations. Extensive experiments demonstrate that the proposed method exhibits superior zero-shot generalization compared with state-of-the-art DRL baselines and traditional dispatching rules, particularly on large-scale and challenging benchmark instances such as DMU and SWV.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。