arXiv:2501.13592cs.LGcs.MA2025-01NeurIPS被引 19

首个风电场强化学习基准,支持多智能体协同优化发电与设备保护。

WFCRL: A Multi-Agent Reinforcement Learning Benchmark for Wind Farm Control

  • 将每台风力机视为智能体,通过强化学习联合优化偏航、桨距等参数。
  • 提供10种风况布局,含5个真实风电场数据,兼容静态/动态仿真器。
  • 支持跨仿真器迁移学习,解决动态仿真训练耗时难题,适合风电与强化学习研究者。

风场控制问题复杂,传统基于模型的方法需简化复杂的气动耦合关系,且在风机数量增多时面临维度灾难。近年来,无模型的多智能体强化学习方法被用于应对该挑战。本文提出WFCRL(基于强化学习的风场控制),首个面向风场控制的多智能体强化学习开源环境。WFCRL将风场建模为协作式多智能体强化学习(MARL)问题:每台风力机作为智能体,可学习调整偏航、桨距或扭矩以最大化全厂总发电量。同时提供风机载荷观测,支持在提升性能的同时降低结构损伤风险。系统集成两种先进风场仿真器接口:静态仿真器FLORIS与动态仿真器FAST.Farm。每个仿真器均提供10种风况布局,包括5个真实风场数据。为展示可扩展性挑战,实现两种前沿在线MARL算法。由于在FAST.Farm上在线学习耗时极高,WFCRL支持从FLORIS到FAST.Farm的迁移学习策略设计。

原文摘要 · Abstract (English)

The wind farm control problem is challenging, since conventional model-based control strategies require tractable models of complex aerodynamical interactions between the turbines and suffer from the curse of dimension when the number of turbines increases. Recently, model-free and multi-agent reinforcement learning approaches have been used to address this challenge. In this article, we introduce WFCRL (Wind Farm Control with Reinforcement Learning), the first open suite of multi-agent reinforcement learning environments for the wind farm control problem. WFCRL frames a cooperative Multi-Agent Reinforcement Learning (MARL) problem: each turbine is an agent and can learn to adjust its yaw, pitch or torque to maximize the common objective (e.g. the total power production of the farm). WFCRL also offers turbine load observations that will allow to optimize the farm performance while limiting turbine structural damages. Interfaces with two state-of-the-art farm simulators are implemented in WFCRL: a static simulator (FLORIS) and a dynamic simulator (FAST.Farm). For each simulator, $10$ wind layouts are provided, including $5$ real wind farms. Two state-of-the-art online MARL algorithms are implemented to illustrate the scaling challenges. As learning online on FAST.Farm is highly time-consuming, WFCRL offers the possibility of designing transfer learning strategies from FLORIS to FAST.Farm.

强化学习风电控制多智能体仿真基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。