用深度强化学习动态决定匹配时机,减少乘客等待时间。
Timing the Match: A Deep Reinforcement Learning Approach for Ride-Hailing and Ride-Pooling Services
- 基于实时系统状态动态决策匹配时机,替代固定间隔。
- 相比固定时间匹配,乘客等待时间显著降低,绕路延迟减少。
- 引入奖励塑形加速训练,适合高并发网约车场景优化。
高效匹配时机对提升网约车与拼车服务性能至关重要,因为它决定了每次匹配中可考虑的司机和乘客数量。传统批量匹配方法采用固定时间间隔累积请求后再分配,虽增加匹配资源,却难以适应供需实时波动,常导致乘客等待时间长、司机空驶。为此,本文提出一种基于深度强化学习(RL)的自适应匹配策略,根据实时系统状态动态决定匹配时机,以最小化总乘客等待时间。此外,引入基于势能的奖励塑形(PBRS)机制缓解稀疏奖励问题,加速训练并提升决策质量。在基于真实数据训练的现实模拟器上进行的大量实验表明,该方法优于固定间隔匹配策略,在显著降低乘客等待时间和绕路延迟的同时,整体提升了网约车与拼车系统的效率。
原文摘要 · Abstract (English)
Efficient timing in ride-matching is crucial for improving the performance of ride-hailing and ride-pooling services, as it determines the number of drivers and passengers considered in each matching process. Traditional batched matching methods often use fixed time intervals to accumulate ride requests before assigning matches. While this approach increases the number of available drivers and passengers for matching, it fails to adapt to real-time supply-demand fluctuations, often leading to longer passenger wait times and driver idle periods. To address this limitation, we propose an adaptive ride-matching strategy using deep reinforcement learning (RL) to dynamically determine when to perform matches based on real-time system conditions. Unlike fixed-interval approaches, our method continuously evaluates system states and executes matching at moments that minimize total passenger wait time. Additionally, we incorporate a potential-based reward shaping (PBRS) mechanism to mitigate sparse rewards, accelerating RL training and improving decision quality. Extensive empirical evaluations using a realistic simulator trained on real-world data demonstrate that our approach outperforms fixed-interval matching strategies, significantly reducing passenger waiting times and detour delays, thereby enhancing the overall efficiency of ride-hailing and ride-pooling systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。