用大模型增强图强化学习,实现智能制造中低碳调度的实时优化。
LLM-Upgraded Graph Reinforcement Learning for Carbon-Aware Job Scheduling in Smart Manufacturing
- 结合图神经网络与大模型,生成融合结构与语义的调度状态嵌入。
- 在合成数据上使完工时间降低4.1%~12.2%,碳排放不变;公开数据上双目标均更优。
- 适合关注绿色制造、智能排产及多目标优化的研究者与工业界应用者。
本文提出 extsc{Luca},一个大型语言模型(LLM)升级的图强化学习框架,用于碳感知的柔性作业车间调度。该框架通过精心设计的内部提示策略,将图神经网络与大模型结合,生成融合调度状态结构特征与上下文语义的联合嵌入。该嵌入由深度强化学习策略网络处理,生成同时优化完工时间和碳排放的实时调度决策。为支持可持续发展目标, extsc{Luca} 引入双目标奖励函数,兼顾能效与及时性。在合成数据集和公开数据集上的实验表明, extsc{Luca} 持续优于对比算法:在合成数据上,平均完工时间比最优对比算法低4.1%,最高降低12.2%,且碳排放水平保持一致;在公开数据集上,完工时间和碳排放均有进一步提升。结果验证了 extsc{Luca} 在智能制造碳感知调度中的有效性与实用性。
原文摘要 · Abstract (English)
This paper presents \textsc{Luca}, a \underline{l}arge language model (LLM)-\underline{u}pgraded graph reinforcement learning framework for \underline{c}arbon-\underline{a}ware flexible job shop scheduling. \textsc{Luca} addresses the challenges of dynamic and sustainable scheduling in smart manufacturing systems by integrating a graph neural network and an LLM, guided by a carefully designed in-house prompting strategy, to produce a fused embedding that captures both structural characteristics and contextual semantics of the latest scheduling state. This expressive embedding is then processed by a deep reinforcement learning policy network, which generates real-time scheduling decisions optimized for both makespan and carbon emission objectives. To support sustainability goals, \textsc{Luca} incorporates a dual-objective reward function that encourages both energy efficiency and scheduling timeliness. Experimental results on both synthetic and public datasets demonstrate that \textsc{Luca} consistently outperforms comparison algorithms. For instance, on the synthetic dataset, it achieves an average of 4.1\% and up to 12.2\% lower makespan compared to the best-performing comparison algorithm while maintaining the same emission level. On public datasets, additional gains are observed for both makespan and emission. These results demonstrate that \textsc{Luca} is effective and practical for carbon-aware scheduling in smart manufacturing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。