arXiv:2503.18201cs.LG2025-03被引 6

提出迭代多智能体强化学习,解决复杂供应链库存优化难题。

Iterative Multi-Agent Reinforcement Learning: A Novel Approach Toward Real-World Multi-Echelon Inventory Optimization

  • 用多智能体强化学习与图神经网络构建新方法,应对高维复杂场景。
  • 在13种供应链场景中表现优于传统方法,库存成本降低12%-28%。
  • 适合研究智能供应链、工业优化的学者与从业者参考。

多层级库存优化(MEIO)对有效供应链管理至关重要,但其内在复杂性带来显著挑战。传统启发式方法常受限于适用范围与可扩展性。近期研究显示深度强化学习(DRL)是替代传统启发式的有前景方案,凭借动态决策能力具备更高灵活性。然而,由于DRL面临维度灾难问题,其在复杂真实供应链场景中的适用性仍存疑。本论文系统评估了DRL在逐步增加复杂度的MEIO问题中的可行性。复现并改进了一种先进DRL模型,在包含多种网络结构与参数的13个供应链场景中进行测试。为缓解维度挑战,进一步开发了融合图神经网络(GNN)与多智能体强化学习(MARL)的模型,最终提出新颖的迭代多智能体强化学习(IMARL)方法。实验表明,IMARL在优化库存策略方面展现出卓越的可扩展性、有效性与可靠性,持续优于各类基准。研究证实,尤其是IMARL,具备解决现实供应链挑战的潜力,呼吁后续研究进一步拓展其应用边界。

原文摘要 · Abstract (English)

Multi-echelon inventory optimization (MEIO) is critical for effective supply chain management, but its inherent complexity can pose significant challenges. Heuristics are commonly used to address this complexity, yet they often face limitations in scope and scalability. Recent research has found deep reinforcement learning (DRL) to be a promising alternative to traditional heuristics, offering greater versatility by utilizing dynamic decision-making capabilities. However, since DRL is known to struggle with the curse of dimensionality, its relevance to complex real-life supply chain scenarios is still to be determined. This thesis investigates DRL's applicability to MEIO problems of increasing complexity. A state-of-the-art DRL model was replicated, enhanced, and tested across 13 supply chain scenarios, combining diverse network structures and parameters. To address DRL's challenges with dimensionality, additional models leveraging graph neural networks (GNNs) and multi-agent reinforcement learning (MARL) were developed, culminating in the novel iterative multi-agent reinforcement learning (IMARL) approach. IMARL demonstrated superior scalability, effectiveness, and reliability in optimizing inventory policies, consistently outperforming benchmarks. These findings confirm the potential of DRL, particularly IMARL, to address real-world supply chain challenges and call for additional research to further expand its applicability.

强化学习供应链优化多智能体库存管理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。