arXiv:2511.01218cs.LG2025-11被引 1

用强化学习与模拟优化充电桩布局,降低用户等待时间。

Optimizing Electric Vehicle Charging Station Placement Using Reinforcement Learning and Agent-Based Simulations

  • 结合深度强化学习与代理仿真,动态建模车辆移动和充电需求。
  • 在河内实验中使平均等待时间减少53.28%,优于静态方法。
  • 适合城市规划者、交通政策制定者用于智能充电基建部署。

电动汽车(EV)的快速增长要求对充电站进行战略性布局,以优化资源利用并减少用户不便。强化学习(RL)为识别最优充电站位置提供了创新途径,但现有方法因采用确定性奖励机制而效率受限。由于现实环境具有动态性和不确定性,确定性奖励无法充分反映充电站选址的复杂性,导致评估成本高且不够贴近实际。为此,我们提出一种新框架,将深度强化学习与代理基仿真相结合,实时建模电动车行为并估算充电需求。该方法采用双Q网络的混合强化学习代理,根据融合确定性因素与仿真反馈的混合奖励函数,选择最优位置并配置充电端口。在越南河内的案例研究显示,相比初始状态,平均等待时间减少了53.28%,优于静态基准方法。该可扩展且自适应的解决方案有效应对现实复杂性,提升了电动汽车基础设施规划水平与用户体验。

原文摘要 · Abstract (English)

The rapid growth of electric vehicles (EVs) necessitates the strategic placement of charging stations to optimize resource utilization and minimize user inconvenience. Reinforcement learning (RL) offers an innovative approach to identifying optimal charging station locations; however, existing methods face challenges due to their deterministic reward systems, which limit efficiency. Because real-world conditions are dynamic and uncertain, a deterministic reward structure cannot fully capture the complexities of charging station placement. As a result, evaluation becomes costly and time-consuming, and less reflective of real-world scenarios. To address this challenge, we propose a novel framework that integrates deep RL with agent-based simulations to model EV movement and estimate charging demand in real time. Our approach employs a hybrid RL agent with dual Q-networks to select optimal locations and configure charging ports, guided by a hybrid reward function that combines deterministic factors with simulation-derived feedback. Case studies in Hanoi, Vietnam, show that our method reduces average waiting times by 53.28% compared to the initial state, outperforming static baseline methods. This scalable and adaptive solution enhances EV infrastructure planning, effectively addressing real-world complexities and improving user experience.

强化学习充电桩优化城市规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。