arXiv:2506.06204cs.LG2025-06被引 2

用深度强化学习优化风电场风机偏航,提升动态风况下的发电效率

How to craft a deep reinforcement learning policy for wind farm flow control

  • 融合图注意力与多头自注意力的新型网络架构
  • 训练步数少10倍,发电量最高提升14%
  • 首个在动态风况下有效泛化的强化学习控制方案

风电场中风机间的尾流效应会显著降低整体发电量。风场流控通过协调控制风机来缓解此问题。例如,尾流转向技术通过有意调整部分风机朝向以优化气流,提升发电效率。然而,设计鲁棒的尾流转向控制器仍具挑战,现有机器学习方法仅适用于准静态风况或小型风电场。本文提出一种新的深度强化学习方法,构建可应对上述限制的尾流转向策略。该方法结合图注意力网络与多头自注意力模块,引入新颖奖励函数与训练策略,实时计算各风机偏航角,在时变风况下优化发电量。在稳态、低保真度仿真环境中进行的实证研究显示,该模型所需训练步数约为全连接神经网络的十分之一,且性能优于强基准优化方法,发电量最高提升14%。据我们所知,这是首个在低保真、稳态数值模拟环境下,能有效泛化至任意时变风况的基于深度强化学习的尾流转向控制器。

原文摘要 · Abstract (English)

Within wind farms, wake effects between turbines can significantly reduce overall energy production. Wind farm flow control encompasses methods designed to mitigate these effects through coordinated turbine control. Wake steering, for example, consists in intentionally misaligning certain turbines with the wind to optimize airflow and increase power output. However, designing a robust wake steering controller remains challenging, and existing machine learning approaches are limited to quasi-static wind conditions or small wind farms. This work presents a new deep reinforcement learning methodology to develop a wake steering policy that overcomes these limitations. Our approach introduces a novel architecture that combines graph attention networks and multi-head self-attention blocks, alongside a novel reward function and training strategy. The resulting model computes the yaw angles of each turbine, optimizing energy production in time-varying wind conditions. An empirical study conducted on steady-state, low-fidelity simulation, shows that our model requires approximately 10 times fewer training steps than a fully connected neural network and achieves more robust performance compared to a strong optimization baseline, increasing energy production by up to 14 %. To the best of our knowledge, this is the first deep reinforcement learning-based wake steering controller to generalize effectively across any time-varying wind conditions in a low-fidelity, steady-state numerical simulation setting.

强化学习风电控制尾流转向深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。