arXiv:2601.04887cs.AI2026-01被引 5

用强化学习优化工厂物流与工具共享,效率更高且计算快十倍。

Flexible Manufacturing Systems Intralogistics: Dynamic Optimization of AGVs and Tool Sharing Using Coloured-Timed Petri Nets and Actor-Critic RL with Actions Masking

  • 结合有色定时佩特里网与演员-评论家强化学习,动态缩小动作空间。
  • 大模型实例上比传统方法更优,使完工时间更短,计算速度提升十倍。
  • 适合智能制造、工业自动化领域研究者参考,开源环境便于复现。

柔性制造系统(FMS)在快速变化的制造环境中对生产流程优化至关重要。本文将传统作业车间调度问题扩展,同时整合自动导引车(AGV)与工具共享系统,提出一种结合有色定时佩特里网(CTPNs)与基于模型的强化学习(MBRL)的新方法。CTPNs提供形式化建模结构并实现动态动作掩码,显著降低动作搜索空间;MBRL通过学习策略增强环境适应性。结合前瞻策略优化AGV位置,提升运行效率。在小型公开基准和受Taillard基准启发的新大型基准上验证,本方法在小规模实例上媲美传统方法,在大规模实例上更优,且计算时间减少十倍。为保证可复现性,提出gym兼容环境与实例生成器,并通过消融实验评估各组件贡献。

原文摘要 · Abstract (English)

Flexible Manufacturing Systems (FMS) are pivotal in optimizing production processes in today's rapidly evolving manufacturing landscape. This paper advances the traditional job shop scheduling problem by incorporating additional complexities through the simultaneous integration of automated guided vehicles (AGVs) and tool-sharing systems. We propose a novel approach that combines Colored-Timed Petri Nets (CTPNs) with actor-critic model-based reinforcement learning (MBRL), effectively addressing the multifaceted challenges associated with FMS. CTPNs provide a formal modeling structure and dynamic action masking, significantly reducing the action search space, while MBRL ensures adaptability to changing environments through the learned policy. Leveraging the advantages of MBRL, we incorporate a lookahead strategy for optimal positioning of AGVs, improving operational efficiency. Our approach was evaluated on small-sized public benchmarks and a newly developed large-scale benchmark inspired by the Taillard benchmark. The results show that our approach matches traditional methods on smaller instances and outperforms them on larger ones in terms of makespan while achieving a tenfold reduction in computation time. To ensure reproducibility, we propose a gym-compatible environment and an instance generator. Additionally, an ablation study evaluates the contribution of each framework component to its overall performance.

智能制造强化学习物流优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。