arXiv:2510.03257cs.LGcs.AI2025-10被引 4

用单智能体强化学习解决网约车调度难题,性能显著优于现有方法。

Triple-BERT: Do We Really Need MARL for Order Dispatch on Ride-Sharing Platforms?

  • 将复杂调度问题分解为独立司机动作概率,降低决策难度
  • 通过改进TD3算法和BERT结构,实现大规模场景下的高效调度
  • 在真实纽约数据集上提升4.26%接单率,减少22.25%接送时间

按需网约车平台面临实时匹配乘客与车辆的复杂挑战,需在大量司机与订单背景下完成高效调度。传统多智能体强化学习(MARL)难以捕捉全局信息且协作性差,而集中训练分散执行(CTDE)方法则面临维度灾难。为此,本文提出Triple-BERT,一种专为大规模网约车调度设计的集中式单智能体强化学习方法。基于改进的TD3算法,通过动作分解策略将联合动作概率拆解为个体司机动作概率,缓解动作空间过大问题;引入新型基于BERT的网络结构,利用参数复用控制参数增长,并通过注意力机制有效建模司机与订单间的复杂关系。在纽约曼哈顿真实数据集上验证,Triple-BERT相较当前最优方法提升约11.95%,其中接单量增加4.26%,平均接送时间减少22.25%。代码、模型参数及处理后的数据已公开于https://github.com/RS2002/Triple-BERT。

原文摘要 · Abstract (English)

On-demand ride-sharing platforms, such as Uber and Lyft, face the intricate real-time challenge of bundling and matching passengers-each with distinct origins and destinations-to available vehicles, all while navigating significant system uncertainties. Due to the extensive observation space arising from the large number of drivers and orders, order dispatching, though fundamentally a centralized task, is often addressed using Multi-Agent Reinforcement Learning (MARL). However, independent MARL methods fail to capture global information and exhibit poor cooperation among workers, while Centralized Training Decentralized Execution (CTDE) MARL methods suffer from the curse of dimensionality. To overcome these challenges, we propose Triple-BERT, a centralized Single Agent Reinforcement Learning (MARL) method designed specifically for large-scale order dispatching on ride-sharing platforms. Built on a variant TD3, our approach addresses the vast action space through an action decomposition strategy that breaks down the joint action probability into individual driver action probabilities. To handle the extensive observation space, we introduce a novel BERT-based network, where parameter reuse mitigates parameter growth as the number of drivers and orders increases, and the attention mechanism effectively captures the complex relationships among the large pool of driver and orders. We validate our method using a real-world ride-hailing dataset from Manhattan. Triple-BERT achieves approximately an 11.95% improvement over current state-of-the-art methods, with a 4.26% increase in served orders and a 22.25% reduction in pickup times. Our code, trained model parameters, and processed data are publicly available at the repository https://github.com/RS2002/Triple-BERT .

网约车调度强化学习BERT单智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。