arXiv:2602.00027cs.LGcs.AI2026-02

用表示学习提升氢能多能系统强化学习效率,降低运行成本。

Representation Learning Enhanced Deep Reinforcement Learning for Optimal Operation of Hydrogen-based Multi-Energy Systems

  • 融合表示学习的深度强化学习框架,优化复杂多能系统决策。
  • 相比传统方法,收敛更快,运行成本降低且约束满足率更高。
  • 适合能源系统优化、强化学习应用研究者参考。

基于氢的多能系统(HMES)作为低碳高效解决方案受到关注,可协调电、热、冷供需,提升运行灵活性与能源效率,并增加可再生能源消纳。然而,氢储能系统(HESS,含电解槽、燃料电池和储氢罐)的非线性多物理场耦合动态及供需不确定性,使最优运行面临挑战。本文构建了全面的HMES运行模型,完整捕捉HESS的非线性动态与多物理过程。同时,提出一种融合表示学习的增强型深度强化学习(SR-DRL)框架,显著加速并改进空间-时间耦合复杂网络系统的策略优化,这是传统DRL无法实现的。基于真实数据集的实验表明,该综合模型对确保HESS安全可靠运行至关重要。所提SR-DRL方法在降低系统运行成本与处理运行约束方面,相较传统DRL具有更优的收敛速度与性能。最后,分析了表示学习在DRL中的作用,推测其可将原始状态空间重构为结构良好、聚类感知的几何表示,从而平滑并促进强化学习过程。

原文摘要 · Abstract (English)

Hydrogen-based multi-energy systems (HMES) have emerged as a promising low-carbon and energy-efficient solution, as it can enable the coordinated operation of electricity, heating and cooling supply and demand to enhance operational flexibility, improve overall energy efficiency, and increase the share of renewable integration. However, the optimal operation of HMES remains challenging due to the nonlinear and multi-physics coupled dynamics of hydrogen energy storage systems (HESS) (consisting of electrolyters, fuel cells and hydrogen tanks) as well as the presence of multiple uncertainties from supply and demand. To address these challenges, this paper develops a comprehensive operational model for HMES that fully captures the nonlinear dynamics and multi-physics process of HESS. Moreover, we propose an enhanced deep reinforcement learning (DRL) framework by integrating the emerging representation learning techniques, enabling substantially accelerated and improved policy optimization for spatially and temporally coupled complex networked systems, which is not provided by conventional DRL. Experimental studies based on real-world datasets show that the comprehensive model is crucial to ensure the safe and reliable of HESS. In addition, the proposed SR-DRL approaches demonstrate superior convergence rate and performance over conventional DRL counterparts in terms of reducing the operation cost of HMES and handling the system operating constraints. Finally, we provide some insights into the role of representation learning in DRL, speculating that it can reorganize the original state space into a well-structured and cluster-aware geometric representation, thereby smoothing and facilitating the learning process of DRL.

强化学习多能系统氢能表示学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。