开源基准框架统一评估库存管理方法,揭示不同条件下的最优策略。
gym-invmgmt: An Open Benchmarking Framework for Inventory Management Methods

- 构建兼容Gymnasium的统一评估环境,支持多种策略横向对比。
- 在22种场景下,启发式随机规划表现最佳但计算成本高,PPO-Transformer推理最快且效果强。
- 适合研究库存优化、强化学习与多智能体系统的研究者使用。
库存策略的比较常因评估条件差异而难以解读,拓扑结构、需求模式、信息获取、可行性约束、缺货处理方式及关键绩效指标(KPI)定义均会影响方法排名。本文提出 gym-invmgmt,一个基于 OR-Gym 的 Gymnasium 兼容扩展,支持可审计的跨范式评估。该基准在统一的 CoreEnv 转移、奖励、动作边界和 KPI 合约下,通过 22 种核心场景加 4 个补充多智能体强化学习(MARL)行,测试优化、启发式与学习型控制器。在给定场景中,具备预测信息的启发式随机规划表现最强,体现情景对冲价值,但在线计算开销显著更高。学习型控制器中,近端策略优化变换器(PPO-Transformer)在快速推理下达到最优性能,残差强化学习(Residual RL)提供有竞争力的混合表现。图神经网络变体(PPO-GNN)在默认非串行拓扑上表现优异,但在串行拓扑上鲁棒性较差。模仿学习在稳定需求下表现良好,但在需求漂移时下降明显;有限制的大语言模型(LLM)策略基线更适合作为诊断工具而非自主优化器。总体而言,该基准识别出依赖场景的领导者,表明性能受信息获取、需求变化、拓扑结构及策略表示共同影响。
原文摘要 · Abstract (English)
Inventory-policy comparisons are often difficult to interpret because performance depends on the evaluation contract as much as on the policy itself. Differences in topology, demand regime, information access, feasibility constraints, shortage treatment, and Key Performance Indicator (KPI) definitions can change method rankings. We present gym-invmgmt, a Gymnasium-compatible extension of the OR-Gym inventory-management lineage for auditable cross-paradigm evaluation. The benchmark evaluates optimization, heuristic, and learned controllers under a shared CoreEnv transition, reward, action-bound, and KPI contract, while varying stress conditions through a 22-scenario core grid plus four supplemental MARL-mode rows. Within these released scenarios, informed stochastic programming provides the strongest non-oracle reference, reflecting the value of scenario hedging under forecast access, but at substantially higher online computational cost. Among learned controllers, the Proximal Policy Optimization Transformer variant (PPO-Transformer) achieves the strongest learned-policy quality at fast inference, while Residual Reinforcement Learning (Residual RL) provides competitive hybrid performance. The graph neural network variant (PPO-GNN) is highly competitive on the default divergent topology but less robust on the serial topology. Imitation learning performs well in stationary regimes but degrades under demand shift, and the bounded Large Language Model (LLM) policy-parameter baseline is best interpreted as a diagnostic controller rather than an autonomous inventory optimizer. Overall, the benchmark identifies scenario-conditioned leaders while showing that performance depends jointly on information access, demand shift, topology, and policy representation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。