用强化学习动态调整控制参数,自动抑制电网振荡。
Policy Gradient-Based EMT-in-the-Loop Learning to Mitigate Sub-Synchronous Control Interactions
- 基于策略梯度的强化学习,结合电网实时信号处理。
- 在真实事件场景中实现振荡抑制,效果优于固定参数方案。
- 适合电力系统工程师与智能控制研究者参考。
本文探索了基于EMT(电磁暂态)仿真闭环框架(如PSCAD与基于Python的学习模块联动)的可调控制参数学习方法,以应对严重的次同步振荡问题。由于次同步控制相互作用(SSCI)源于特定电网配置下的控制参数失调,有效的缓解策略需自适应地重新调整这些参数。为此,本文采用受马尔可夫决策过程启发的强化学习方法,重点使用较简单的深度策略梯度算法,并引入针对SSCI特性的信号处理模块,包括降采样、带通滤波及基于振荡能量的奖励计算。实验在真实事件场景下进行,结果表明,基于深度策略梯度训练出的策略能够根据电网条件变化自适应地计算最优增益设置,有效抑制由控制交互引发的振荡。
原文摘要 · Abstract (English)
This paper explores the development of learning-based tunable control gains using EMT-in-the-loop simulation framework (e.g., PSCAD interfaced with Python-based learning modules) to address critical sub-synchronous oscillations. Since sub-synchronous control interactions (SSCI) arise from the mis-tuning of control gains under specific grid configurations, effective mitigation strategies require adaptive re-tuning of these gains. Such adaptiveness can be achieved by employing a closed-loop, learning-based framework that considers the grid conditions responsible for such sub-synchronous oscillations. This paper addresses this need by adopting methodologies inspired by Markov decision process (MDP) based reinforcement learning (RL), with a particular emphasis on simpler deep policy gradient methods with additional SSCI-specific signal processing modules such as down-sampling, bandpass filtering, and oscillation energy dependent reward computations. Our experimentation in a real-world event setting demonstrates that the deep policy gradient based trained policy can adaptively compute gain settings in response to varying grid conditions and optimally suppress control interaction-induced oscillations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。