arXiv:2505.13580cs.LGcs.AI2025-05被引 2

用生成式Transformer解决运营决策中的序列问题,无需假设模型结构。

OMGPT: A Sequence Modeling Framework for Data-driven Operational Decision Making

  • 构建通用序列建模框架,将定价、库存等任务统一为历史到动作的预测。
  • 在多个运营任务中表现优异,无需依赖解析模型假设。
  • 适合数据驱动的运营管理研究者,尤其关注复杂决策场景的应用。

我们从头构建了一个生成式预训练变换器(GPT)模型——OMGPT,用于解决运筹与管理科学中的序列决策问题。提出一个通用序列建模框架,涵盖动态定价、库存管理、资源分配和排队控制等任务,将它们统一为基于历史信息预测最优未来动作的序列预测问题。在此框架下,训练一个基于Transformer的神经网络模型(OMGPT),作为序列建模的自然且强大的架构。相比现有方法,该模型具有两大优势:(i)可利用大量预训练数据;(ii)不假设任何解析模型结构,实现从历史到未来动作的直接、丰富映射。这两个特性在现有方法中均未实现。我们从贝叶斯视角理论分析了该模型的工作机制,揭示其性能与预训练任务多样性及测试任务与预训练任务间差异的关系。数值实验显示,该模型在上述所有任务中均表现出色。

原文摘要 · Abstract (English)

We build a Generative Pre-trained Transformer (GPT) model from scratch to solve sequential decision making tasks arising in contexts of operations research and management science which we call OMGPT. We first propose a general sequence modeling framework to cover several operational decision making tasks as special cases, such as dynamic pricing, inventory management, resource allocation, and queueing control. Under the framework, all these tasks can be viewed as a sequential prediction problem where the goal is to predict the optimal future action given all the historical information. Then we train a transformer-based neural network model (OMGPT) as a natural and powerful architecture for sequential modeling. This marks a paradigm shift compared to the existing methods for these OR/OM tasks in that (i) the OMGPT model can take advantage of the huge amount of pre-trained data; (ii) when tackling these problems, OMGPT does not assume any analytical model structure and enables a direct and rich mapping from the history to the future actions. Either of these two aspects, to the best of our knowledge, is not achieved by any existing method. We establish a Bayesian perspective to theoretically understand the working mechanism of the OMGPT on these tasks, which relates its performance with the pre-training task diversity and the divergence between the testing task and pre-training tasks. Numerically, we observe a surprising performance of the proposed model across all the above tasks.

序列建模运营决策GPTTransformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。