用图神经网络增强强化学习,让储能系统更智能地应对电网拓扑变化。
Topology-Aware Graph Reinforcement Learning for Energy Storage Systems Optimal Dispatch in Distribution Networks
- 用GNN编码电网结构,结合TD3算法实现动态调度决策
- 在69节点系统中电压越限减少,节能效果优于传统方法
- 跨系统迁移时性能下降明显,需谨慎应用
配电网络中储能系统的最优调度需兼顾经济性与电压安全,且面对动态运行条件和可能的拓扑变化。为支持快速在线决策,本文提出一种拓扑感知的强化学习架构,基于双延迟深度确定性策略梯度(TD3),引入图神经网络(GNN)作为电网特征编码器。在34节点和69节点系统上系统评估了三种GNN变体:图卷积网络(GCNs)、拓扑自适应图卷积网络(TAGConv)和图注意力网络(GATs),并测试其在多种拓扑重构情形下的鲁棒性及不同规模系统间的跨系统迁移能力。结果表明,基于GNN的控制器显著降低电压越限次数与幅度,尤其在69节点系统和拓扑重构条件下优势更明显;在69节点系统中,TD3-GCN与TD3-TAGConv相比非线性规划基准,成本节约更优。此外,迁移收益具有依赖性,零样本跨系统迁移导致性能显著下降并引发电压幅值越限。代码已开源:https://github.com/ShuyiGao/GNNs_RL_ESSs 和 https://github.com/distributionnetworksTUDelft/GNNs_RL_ESSs。
原文摘要 · Abstract (English)
Optimal dispatch of energy storage systems (ESSs) in distribution networks involves jointly improving operating economy and voltage security under time-varying conditions and possible topology changes. To support fast online decision making, we develop a topology-aware Reinforcement Learning architecture based on Twin Delayed Deep Deterministic Policy Gradient (TD3), which integrates graph neural networks (GNNs) as graph feature encoders for ESS dispatch. We conduct a systematic investigation of three GNN variants: graph convolutional networks (GCNs), topology adaptive graph convolutional networks (TAGConv), and graph attention networks (GATs) on the 34-bus and 69-bus systems, and evaluate robustness under multiple topology reconfiguration cases as well as cross-system transfer between networks with different system sizes. Results show that GNN-based controllers consistently reduce the number and magnitude of voltage violations, with clearer benefits on the 69-bus system and under reconfiguration; on the 69-bus system, TD3-GCN and TD3-TAGConv also achieve lower saved cost relative to the NLP benchmark than the NN baseline. We also highlight that transfer gains are case-dependent, and zero-shot transfer between fundamentally different systems results in notable performance degradation and increased voltage magnitude violations. This work is available at: https://github.com/ShuyiGao/GNNs_RL_ESSs and https://github.com/distributionnetworksTUDelft/GNNs_RL_ESSs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。