用图神经网络让电网各节点自主协同调控,提升稳定性与效率。
Power Grid Control with Graph-Based Distributed Reinforcement Learning
- 每条线路设一个智能体,通过图神经网络理解全局拓扑结构。
- 在电网仿真中性能超越传统基线方法,计算效率远高于专家模拟法。
- 适合需要实时、分布式控制的大型智能电网系统研究者参考。
可再生能源大规模接入与电网规模持续扩大,给现代电力系统控制带来严峻挑战。传统依赖人工与优化算法的控制方式难以适应动态变化且难以扩展。本文提出一种基于图神经网络的分布式强化学习框架,实现电网的实时、可扩展管理。系统由多个低层代理(作用于单条输电线路)与一个高层协调代理构成,每个低层代理利用图神经网络编码网络拓扑信息,构建结构化、高信息量的局部观测。为加速收敛并提升学习稳定性,引入模仿学习与基于势能的奖励设计。相比仅分解动作空间而依赖全局观测的传统去中心化方法,本方案同时分解观测空间,使各代理基于本地化结构化视图进行决策。在Grid2Op仿真环境中的实验表明,该方法持续优于领域内常用基准,且计算效率显著高于基于仿真的专家方法。
原文摘要 · Abstract (English)
The necessary integration of renewable energy sources, combined with the expanding scale of power networks, presents significant challenges in controlling modern power grids. Traditional control systems, which are human and optimization-based, struggle to adapt and to scale in such an evolving context, motivating the exploration of more dynamic and distributed control strategies. This work advances a graph-based distributed reinforcement learning framework for real-time, scalable grid management. The proposed architecture consists of a network of distributed low-level agents acting on individual power lines and coordinated by a high-level manager agent. A Graph Neural Network (GNN) is employed to encode the network's topological information within the single low-level agent's observation. To accelerate convergence and enhance learning stability, the framework integrates imitation learning and potential-based reward shaping. In contrast to conventional decentralized approaches that decompose only the action space while relying on global observations, this method also decomposes the observation space. Each low-level agent acts based on a structured and informative local view of the environment constructed through the GNN. Experiments on the Grid2Op simulation environment show the effectiveness of the approach, which consistently outperforms the standard baseline commonly adopted in the field. Additionally, the proposed model proves to be much more computationally efficient than the simulation-based Expert method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。