用分治专家网络提升网约车匹配效率,降低延迟。
RAST-MoE-RL: A Regime-Aware Spatio-Temporal MoE Framework for Deep Reinforcement Learning in Ride-Hailing
- 设计分段自适应的时空专家混合模型,动态捕捉供需变化。
- 在旧金山真实数据上,匹配延迟降10%,接驾延迟降15%。
- 适合大规模时空决策场景,尤其对复杂动态系统有效。
网约车平台在高度不确定的供需环境下,需平衡乘客等待时间与系统整体效率。自适应延迟匹配通过控制请求与车辆批处理的持有间隔,显现出匹配延迟与接驾延迟之间的固有权衡。由于请求到达模式随时间变化且交通拥堵动态演化,需要具备强表达能力的网络来捕捉非平稳性。为克服现有方法依赖浅层编码器、无法建模动态供需与拥堵效应的局限,本文提出一种基于分段感知的时空混合专家(RAST-MoE)框架,将自适应延迟匹配形式化为分段感知马尔可夫决策过程,并引入自注意力混合专家编码器。该设计使不同专家自动专注于特定运营状态,提升表征能力的同时保持单样本计算效率。尽管仅1200万参数,其性能持续优于强基线:在旧金山真实Uber轨迹数据上,平均匹配延迟降低10%,接驾延迟降低15%。此外,模型对未见需求状态具有鲁棒性,训练稳定无奖励欺骗现象,专家能有效分化至不同运行模式。研究证明了混合专家增强强化学习在具复杂时空动态的大规模决策任务中的优势。
原文摘要 · Abstract (English)
Ride-hailing platforms face the challenge of balancing passenger waiting times with overall system efficiency under highly uncertain supply-demand conditions. Adaptive delayed matching, which controls the holding intervals for batched sets of requests and vehicles, reveals an inherent trade-off between matching and pickup delays. The resulting environment with temporally varying request arrival patterns and dynamic congestion calls for more expressive networks with sufficient capacity to capture their non-stationarity. To address the limitations of existing methods that rely on shallow encoders that cannot capture dynamic supply-demand patterns and congestion effects, we introduce the Regime-Aware Spatio-Temporal Mixture-of-Experts (RAST-MoE) framework, which formalizes adaptive delayed matching as a regime-aware Markov Decision Process and equips RL agents with a self-attention MoE encoder. Instead of relying on a single monolithic network, our design allows different experts to specialize automatically in varying operational conditions, improving representation capacity while maintaining per-sample computation efficiency. Despite its modest size of only 12M parameters, our framework consistently outperforms strong baselines. On real-world Uber trajectory data from San Francisco, it reduces average matching delay by 10%, and pickup delay by 15%. In addition, it demonstrates robustness to unseen demand regimes, stable training behavior without reward hacking, and expert specialization to different regimes. This study shows the strength of MoE-enhanced RL for large-scale decision-making tasks with complex spatiotemporal dynamics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。