用生成模型让电动车自助选桩,省通信又保效率
A Generative Model Enhanced Multi-Agent Reinforcement Learning Method for Electric Vehicle Charging Navigation
- 用本地信息+生成模型预测充电竞争,避免全局通信
- 只损失不到8%性能,比纯本地方法更优
- 适合注重隐私和实时性的智能交通系统
随着电动汽车普及,如何在动态交通、电价波动和车辆竞争下选择经济充电站成为难题。现有深度强化学习方法需全局信息,增加通信开销并引发隐私问题。本文提出一种基于生成模型的多智能体强化学习方法,仅依赖本地信息即可达到接近全局方法的性能。通过在车端部署策略网络,并设计基于条件变分自编码器-长短期记忆(CVAE-LSTM)的推荐模型提供决策支持;引入新型未来充电竞争编码器压缩全局信息,提升训练效果;采用多梯度下降算法(MGDA)自适应平衡训练目标权重,使训练更稳定。基于中国西安某实际区域的仿真结果表明,该方法仅使用本地信息,性能优于现有本地方法,相比全局方法损失小于8%。
原文摘要 · Abstract (English)
With the widespread adoption of electric vehicles (EVs), navigating for EV drivers to select a cost-effective charging station has become an important yet challenging issue due to dynamic traffic conditions, fluctuating electricity prices, and potential competition from other EVs. The state-of-the-art deep reinforcement learning (DRL) algorithms for solving this task still require global information about all EVs at the execution stage, which not only increases communication costs but also raises privacy issues among EV drivers. To overcome these drawbacks, we introduce a novel generative model-enhanced multi-agent DRL algorithm that utilizes only the EV's local information while achieving performance comparable to these state-of-the-art algorithms. Specifically, the policy network is implemented on the EV side, and a Conditional Variational Autoencoder-Long Short Term Memory (CVAE-LSTM)-based recommendation model is developed to provide recommendation information. Furthermore, a novel future charging competition encoder is designed to effectively compress global information, enhancing training performance. The multi-gradient descent algorithm (MGDA) is also utilized to adaptively balance the weight between the two parts of the training objective, resulting in a more stable training process. Simulations are conducted based on a practical area in Xián, China. Experimental results show that our proposed algorithm, which relies on local information, outperforms existing local information-based methods and achieves less than 8\% performance loss compared to global information-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。