用强化学习优化药品供应链补货,降低库存成本。
Learning to replenish: A hybrid deep reinforcement learning for dynamic inventory management in the pharmaceutical supply chains
- 结合A3C与DPPO的混合强化学习算法,处理连续补货动作。
- 动态场景下补货策略自适应调整,库存成本显著低于基准方法。
- 基于真实药品数据验证,适合医药供应链管理者参考。
药品供应链(PSCs)因需求波动和补货周期变化,面临复杂的库存管理挑战。药品有限的保质期要求在保证供应的同时尽量减少浪费。本文将该问题建模为马尔可夫决策过程,提出一种混合异步优势演员-评论家分布式近端策略优化(A3C DPPO)的深度强化学习算法,专门应对库存管理中的连续动作空间。数值结果表明,该算法能在动态环境下自适应更新补货策略,相比多种基准方法显著降低库存成本。同时,利用真实药品库存数据进行数值验证,证实了所提算法的实际可行性。
原文摘要 · Abstract (English)
Pharmaceutical supply chains (PSCs) struggle with inventory management (IM) due to unpredictable demand patterns and variable lead times associated with restocking. This complexity is further compounded by the finite shelf lives of pharmaceutical products, which necessitate a delicate balance between adequate stock and minimal waste. These intertwined factors create a complex optimization problem that requires sophisticated inventory strategies to ensure both product availability and PSC efficiency. This study aims to develop an optimal inventory replenishment policy for pharmaceutical products that can handle the stochasticity arising from uncertain demand and variable PSC conditions. The objective is to maximize the profitability of the PSC while maintaining a high patient service level. We formulate the problem as a Markov decision process and propose a deep reinforcement learning (DRL) approach, specifically, a hybrid asynchronous advantage actor critic distributed proximal policy optimization (A3C DPPO)algorithm. The A3C DPPO algorithm is tailored to handle the continuous action space inherent in IM. The numerical results demonstrate that the proposed algorithm adaptively updates the inventory replenishment strategy under dynamic scenarios, resulting in lower inventory costs compared to various benchmarks. We also conduct numerical validation using real-world pharmaceutical inventory data to confirm the practical feasibility of the proposed algorithm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。