arXiv:2606.19199cs.LGcs.AI2026-06

用决策导向强化学习,让电动车充电更智能,即使出发时间未知也能高效充能。

Forecasting what Matters: Decision-Focused RL for Controlled EV Charging with Unknown Departure Times

  • 联合训练预测器与充电策略,端到端优化决策质量。
  • 相比无预测的强化学习,充电成功率提升14%,未完成充电量减少55%。
  • 特别适合电网调度和充电桩管理场景,应对用户出行不确定性。

电动汽车普及带来电网峰值负荷上升和不稳定性风险。基于强化学习的智能充电可缓解此问题,但实际中出发时间等关键信息常不可知,影响策略学习效果。传统预测模型仅追求精度,其误差会传递给下游控制器,降低整体性能。为此,本文提出决策导向强化学习(DF-RL)框架,将预测器与充电策略联合训练,通过充电动作反馈优化预测。实验表明,该方法相比无预测的强化学习,总奖励提升最高达14%,未供电能量(因车辆提前离开导致的充电失败)减少55%,显著提升了充电决策质量。

原文摘要 · Abstract (English)

The recent growth of EV adoption poses challenges for power systems, including increased peak demand and potential grid instability. Smart control of EV charging -- e.g., based on reinforcement learning (RL) -- can alleviate these issues by learning temporal and contextual patterns from historical data. Yet, in real-world scenarios, key features, such as departure time, often are unavailable. This, in turn, makes it harder for an RL agent to learn and execute an effective charging policy. To mitigate this uncertainty, a trained forecaster can approximate the unknown features from available data. However, since these forecasting models are typically trained for accuracy (rather than their impact on a downstream agent's decision quality), their errors may propagate and hinder the overall performance of a controller that is using the forecasts. To avoid this, we propose a decision-focused RL (DF-RL) framework in which the forecaster is trained end-to-end, i.e., with feedback from the charging policy actions taken by the RL agent. Such joint training of both the forecaster and controller ultimately results in higher-quality actions: our proposed DF-RL method yields superior charging decisions compared to other baselines, achieving up to a 14% improvement in total reward and a 55% reduction of unsupplied energy (i.e., charging that failed to happen because the EV already left), relative to the RL method without departure time forecasting.

强化学习电动车充电决策优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。