用强化学习训练的Transformer改进遗传编程,提升动态调度适应性
Genetic Programming with Reinforcement Learning Trained Transformer for Real-World Dynamic Scheduling Problems
- 用Transformer指导遗传编程进化,双向优化调度策略
- 在码头卡车调度中优于传统方法和现有先进模型
- 兼具可解释性与易修改性,适用多种动态调度场景
现实世界中的动态调度常因突发干扰难以应对,传统静态调度方法和人工设计启发式算法已显不足。本文提出一种创新方法——基于强化学习训练的Transformer与遗传编程结合(GPRT),专门应对动态调度复杂性。GPRT利用Transformer优化遗传编程生成的启发式规则,同时反向引导遗传编程的演化过程,实现双向协同。该方法显著提升了调度策略的适应性与有效性,可在动态任务环境中快速响应。在集装箱码头卡车调度的实际应用中,GPRT表现优于传统遗传编程、独立Transformer模型及其他先进方法。研究核心贡献在于构建了融合遗传编程与强化学习的新型框架,不仅适用于港口调度,更可推广至各类动态调度问题。其高实用性、可解释性及易于调整的特性,使其成为多种真实场景下的有力工具。
原文摘要 · Abstract (English)
Dynamic scheduling in real-world environments often struggles to adapt to unforeseen disruptions, making traditional static scheduling methods and human-designed heuristics inadequate. This paper introduces an innovative approach that combines Genetic Programming (GP) with a Transformer trained through Reinforcement Learning (GPRT), specifically designed to tackle the complexities of dynamic scheduling scenarios. GPRT leverages the Transformer to refine heuristics generated by GP while also seeding and guiding the evolution of GP. This dual functionality enhances the adaptability and effectiveness of the scheduling heuristics, enabling them to better respond to the dynamic nature of real-world tasks. The efficacy of this integrated approach is demonstrated through a practical application in container terminal truck scheduling, where the GPRT method outperforms traditional GP, standalone Transformer methods, and other state-of-the-art competitors. The key contribution of this research is the development of the GPRT method, which showcases a novel combination of GP and Reinforcement Learning (RL) to produce robust and efficient scheduling solutions. Importantly, GPRT is not limited to container port truck scheduling; it offers a versatile framework applicable to various dynamic scheduling challenges. Its practicality, coupled with its interpretability and ease of modification, makes it a valuable tool for diverse real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。