arXiv:2409.11820cs.AIcs.LG2024-09被引 1

用强化学习优化家具厂排产,兼顾换机、批次和物流复杂性。

Optimizing Job Shop Scheduling in the Furniture Industry: A Reinforcement Learning Approach Considering Machine Setup, Batch Variability, and Intralogistics

  • 基于深度强化学习构建动态排产模型,融合换机、批次与物流信息。
  • 在真实制造场景中实现更精准的生产调度,提升交付准时率。
  • 提出两种部署方案,适配不同自动化水平的工厂需求。

本文探讨深度强化学习在家具行业的应用潜力。为提供多样化产品,多数家具制造商采用作业车间模式,导致作业车间调度问题(JSSP)。现有方法常忽略换机时间与批次规模变化等关键因素。本文提出一种新模型,通过引入工作量、缓冲管理、运输时间和换机时间,增强对实际生产环境复杂性的建模能力。该模型利用强化学习代理在离散动作空间中做出决策,基于详细观测并依据奖励函数优化调度策略。研究讨论了两种集成策略:适用于低自动化环境的周期性规划,以及适合高度自动化产线的持续规划。后者需与ERP和制造执行系统集成,支持实时调度调整,从而有效应对动态生产变化。

原文摘要 · Abstract (English)

This paper explores the potential application of Deep Reinforcement Learning in the furniture industry. To offer a broad product portfolio, most furniture manufacturers are organized as a job shop, which ultimately results in the Job Shop Scheduling Problem (JSSP). The JSSP is addressed with a focus on extending traditional models to better represent the complexities of real-world production environments. Existing approaches frequently fail to consider critical factors such as machine setup times or varying batch sizes. A concept for a model is proposed that provides a higher level of information detail to enhance scheduling accuracy and efficiency. The concept introduces the integration of DRL for production planning, particularly suited to batch production industries such as the furniture industry. The model extends traditional approaches to JSSPs by including job volumes, buffer management, transportation times, and machine setup times. This enables more precise forecasting and analysis of production flows and processes, accommodating the variability and complexity inherent in real-world manufacturing processes. The RL agent learns to optimize scheduling decisions. It operates within a discrete action space, making decisions based on detailed observations. A reward function guides the agent's decision-making process, thereby promoting efficient scheduling and meeting production deadlines. Two integration strategies for implementing the RL agent are discussed: episodic planning, which is suitable for low-automation environments, and continuous planning, which is ideal for highly automated plants. While episodic planning can be employed as a standalone solution, the continuous planning approach necessitates the integration of the agent with ERP and Manufacturing Execution Systems. This integration enables real-time adjustments to production schedules based on dynamic changes.

强化学习排产优化制造业

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。