arXiv:2511.17435cs.LG2025-11AAAI被引 2

用自回归指针网络解决多车动态配送的协同决策问题

Multi-Agent Pointer Transformer: Seq-to-Seq Reinforcement Learning for Multi-Vehicle Dynamic Pickup-Delivery Problems

  • 基于Transformer的序列到序列框架,联合生成多车动作
  • 在8个数据集上性能显著优于基线方法,计算效率高
  • 适合大规模动态配送场景,如即时配送系统

本文针对具有随机需求的多车动态取送货问题(MVDPDPSR),提出一种端到端的集中式决策框架——多智能体指针Transformer(MAPT)。该问题属于车辆路径问题的扩展,广泛应用于按需配送等时空优化场景。传统运筹学方法在处理大规模动态问题时面临计算复杂度和效率瓶颈;现有强化学习方法仍存在三个挑战:1)多车独立解码无法建模联合动作分布;2)特征提取网络难以捕捉实体间关系;3)联合动作空间呈指数级增长。为此,我们设计了MAPT框架,采用Transformer编码器提取实体表示,结合带有指针网络的Transformer解码器,以自回归方式生成联合动作序列,并引入关系感知注意力模块捕捉实体间关系。同时,通过信息性先验引导决策,促进有效探索。在8个数据集上的实验表明,MAPT在性能上显著优于现有基线方法,并相比经典运筹学方法展现出显著的计算时间优势。

原文摘要 · Abstract (English)

This paper addresses the cooperative Multi-Vehicle Dynamic Pickup and Delivery Problem with Stochastic Requests (MVDPDPSR) and proposes an end-to-end centralized decision-making framework based on sequence-to-sequence, named Multi-Agent Pointer Transformer (MAPT). MVDPDPSR is an extension of the vehicle routing problem and a spatio-temporal system optimization problem, widely applied in scenarios such as on-demand delivery. Classical operations research methods face bottlenecks in computational complexity and time efficiency when handling large-scale dynamic problems. Although existing reinforcement learning methods have achieved some progress, they still encounter several challenges: 1) Independent decoding across multiple vehicles fails to model joint action distributions; 2) The feature extraction network struggles to capture inter-entity relationships; 3) The joint action space is exponentially large. To address these issues, we designed the MAPT framework, which employs a Transformer Encoder to extract entity representations, combines a Transformer Decoder with a Pointer Network to generate joint action sequences in an AutoRegressive manner, and introduces a Relation-Aware Attention module to capture inter-entity relationships. Additionally, we guide the model's decision-making using informative priors to facilitate effective exploration. Experiments on 8 datasets demonstrate that MAPT significantly outperforms existing baseline methods in terms of performance and exhibits substantial computational time advantages compared to classical operations research methods.

多智能体强化学习路径规划动态配送

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。