用强化学习优化混动卡车油耗,能自适应不同驾驶场景。
Sequence Aware SAC Control for Engine Fuel Consumption Optimization in Electrified Powertrain
- 用GRU和决策Transformer增强SAC算法,捕捉时间依赖性。
- 在高速测试中油耗比动态规划仅差1.8%,优于传统网络3%以上。
- 适合需要长期稳定节能的重型混动车辆控制场景。
随着混合动力重卡应用增多,如何在保证电池续航的前提下高效管理能量成为关键。本文提出一种基于软演员-评论家(SAC)算法的强化学习框架,将发动机控制重构为序列决策问题,并在策略和评论家网络中引入门控循环单元(GRUs)与决策变压器(DTs),以捕捉时间依赖关系并提升长期规划能力。为评估鲁棒性与泛化性能,模型在多种初始电量、行驶周期长度、功率需求及输入序列长度下进行训练。实验表明,在高速燃油经济性测试(HFET)循环中,采用DT策略网络和GRU评论家网络的SAC代理燃油节省率仅比动态规划(DP)低1.8%;而全GRU结构与前馈网络(FFN)结构分别低3.16%和3.43%。在未见过的工况(US06和HHDDT巡航段)中,具备序列感知能力的代理持续优于FFN基线,展现出强适应性与实际部署潜力。
原文摘要 · Abstract (English)
As hybrid electric vehicles (HEVs) gain traction in heavy-duty trucks, adaptive and efficient energy management is critical for reducing fuel consumption while maintaining battery charge for long operation times. We present a new reinforcement learning (RL) framework based on the Soft Actor-Critic (SAC) algorithm to optimize engine control in series HEVs. We reformulate the control task as a sequential decision-making problem and enhance SAC by incorporating Gated Recurrent Units (GRUs) and Decision Transformers (DTs) into both actor and critic networks to capture temporal dependencies and improve planning over time. To evaluate robustness and generalization, we train the models under diverse initial battery states, drive cycle durations, power demands, and input sequence lengths. Experiments show that the SAC agent with a DT-based actor and GRU-based critic was within 1.8% of Dynamic Programming (DP) in fuel savings on the Highway Fuel Economy Test (HFET) cycle, while the SAC agent with GRUs in both actor and critic networks, and FFN actor-critic agent were within 3.16% and 3.43%, respectively. On unseen drive cycles (US06 and Heavy Heavy-Duty Diesel Truck (HHDDT) cruise segment), generalized sequence-aware agents consistently outperformed feedforward network (FFN)-based agents, highlighting their adaptability and robustness in real-world settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。