用Transformer学习最优调度模式,提升流水线作业效率。
Transformer-Based Flow Shop Scheduling Using MILP-Generated Training Data

- 将调度问题转为令牌预测任务,用MILP生成训练数据
- 在8工件4机器场景下,解质量优于遗传算法和启发式方法
- 适合重复出现相同工件的生产场景,可拓展至复杂调度
机器学习进展为补充传统运筹学方法提供了新机遇。本文利用Transformer模型,通过注意力机制捕捉令牌序列中的复杂交互,将非排列式流水车间调度(含辅助资源)建模为下一个令牌预测任务,其中令牌代表工件-机器-辅助资源三元组。训练数据由混合整数线性规划(MILP)生成的最优调度序列分词得到。推理时,随机生成部分令牌序列(前缀),并通过约束解码完成。在包含8个工件、4台机器、3个辅助资源的场景下,工件从20个固定候选池中采样生成,该方法在训练和推断阶段均使用同一池子。实验表明,该Transformer模型在最小化完工时间方面优于遗传算法(GA)、NEH启发式和随机搜索,仅略逊于MILP模型和迭代贪婪(IG)启发式。研究证实,Transformer能在一定程度上从MILP优化的调度方案中学习规律,为未来基于模型的调度研究提供新方向,尤其适用于工件集合固定且重复出现的场景。
原文摘要 · Abstract (English)
Advances in machine learning (ML) have created new opportunities to complement traditional operations research (OR) methods. In particular, transformer models can capture complex interactions in token sequences by mapping tokens into a high-dimensional embedding space and propagating contextual information via attention. This makes them a candidate to model non-permutation flow shop scheduling with secondary resources as a next-token prediction task, where tokens represent job-machine-secondary resource tuples. For training, mixed-integer linear programming (MILP)-generated schedules are tokenized and used as next-token prediction data. During inference, partial token sequences (prefixes) are randomly generated and completed by the trained transformer through constrained decoding. A computational study is conducted on a flow shop with 8 jobs, 4 machines, and 3 secondary resources, where jobs are selected from a fixed pool of 20 jobs that is sampled during training and provides the candidates during prefix completion. The transformer achieves better solution quality (smaller makespans) compared to a genetic algorithm (GA), the NEH heuristic, and random search. It is outperformed only by the MILP model and the iterated greedy (IG) heuristic. The study concludes that transformer models can, to some extent, learn patterns from MILP-optimized non-permutation flow shop schedules and that transformer-based scheduling represents an interesting direction for future research, particularly in settings with a fixed, recurring job set.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。