用软标签模仿学习优化电网拓扑控制,提升拥堵管理效率。
Learning Topology Actions for Power Grid Control: A Graph-Based Soft-Label Imitation Learning Approach
- 基于模拟结果生成软标签,允许多个有效操作共存
- 融合图神经网络编码电网结构,提升决策适应性
- 相比贪心专家模型性能提升17%,优于主流强化学习方法
电力系统中可再生能源比例上升带来了显著的运行挑战。有效的电网管理需要能够应对动态变化的自适应决策策略。随着系统复杂度增加,越来越多深度学习方法被用于寻找合适的电网拓扑以缓解拥塞。本文提出一种新型模仿学习方法,利用模拟拓扑动作结果生成软标签,从而捕捉每个状态下多个可行的操作。不同于依赖硬标签强制单一最优动作的传统方法,本方法通过软标签反映多种有效操作的合理性。为进一步提升决策能力,引入图神经网络(GNN)编码电网结构特征,使代理具备拓扑感知能力。实验表明,该方法显著优于硬标签基线及当前最先进的深度强化学习基准模型,尤其在与模仿目标——贪心专家代理相比时,性能提升达17%。
原文摘要 · Abstract (English)
The rising proportion of renewable energy in the electricity mix introduces significant operational challenges for power grid operators. Effective power grid management demands adaptive decision-making strategies capable of handling dynamic conditions. With the increase in complexity, more and more Deep Learning (DL) approaches have been proposed to find suitable grid topologies for congestion management. In this work, we contribute to this research by introducing a novel Imitation Learning (IL) approach that leverages soft labels derived from simulated topological action outcomes, thereby capturing multiple viable actions per state. Unlike traditional IL methods that rely on hard labels to enforce a single optimal action, our method constructs soft labels that capture the effectiveness of actions that prove suitable in resolving grid congestion. To further enhance decision-making, we integrate Graph Neural Networks (GNNs) to encode the structural properties of power grids, ensuring that the topology-aware representations contribute to better agent performance. Our approach significantly outperforms its hard-label counterparts as well as state-of-the-art Deep Reinforcement Learning (DRL) baseline agents. Most notably, it achieves a 17% better performance compared to the greedy expert agent from which the imitation targets were derived.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。