arXiv:2503.22775cs.LGphysics.flu-dyn2025-03被引 6

用图神经网络提升流体控制策略的通用性,让强化学习更省力、更适用。

Invariant Control Strategies for Active Flow Control using Graph Neural Networks

  • 用图神经网络处理三维非结构化流场数据,自动保留空间关系
  • 训练后的控制策略在不同条件下表现稳定,泛化能力显著提升
  • 适合需要跨工况适应的复杂流体控制场景,如飞行器设计

强化学习在主动流控任务中逐渐兴起,早期应用聚焦于二维圆柱绕流的阻力抑制。随后扩展至更复杂的湍流场景,展现出学习复杂控制策略的巨大潜力。然而,这类方法仍面临样本效率低、仿真成本高的挑战,且训练好的策略常与特定输入条件强绑定,缺乏泛化能力。本文提出使用图神经网络(GNN)解决此问题,显著提升策略的适用范围,更好发挥前期强化学习训练投入的价值。GNN能自然处理无结构、三维流场数据,无需依赖笛卡尔网格,同时在学习过程中内嵌旋转、反射和排列不变性,增强控制策略的泛化能力,克服传统CNN或MLP架构的局限。为验证该方法,我们重审了经典的二维圆柱主动流控基准问题。强化学习训练采用高性能框架Relexi,流场模拟通过高阶间断伽辽金框架FLEXI并行完成。结果表明,基于GNN的控制策略性能与现有方法相当,但具备更优的泛化特性。本工作确立了GNN在基于强化学习的流控中的前景,并凸显Relexi与FLEXI在大规模流体动力学强化学习应用中的能力。

原文摘要 · Abstract (English)

Reinforcement learning has gained traction for active flow control tasks, with initial applications exploring drag mitigation via flow field augmentation around a two-dimensional cylinder. RL has since been extended to more complex turbulent flows and has shown significant potential in learning complex control strategies. However, such applications remain computationally challenging due to its sample inefficiency and associated simulation costs. This fact is worsened by the lack of generalization capabilities of these trained policy networks, often being implicitly tied to the input configurations of their training conditions. In this work, we propose the use of graph neural networks to address this particular limitation, effectively increasing the range of applicability and getting more value out of the upfront RL training cost. GNNs can naturally process unstructured, threedimensional flow data, preserving spatial relationships without the constraints of a Cartesian grid. Additionally, they incorporate rotational, reflectional, and permutation invariance into the learned control policies, thus improving generalization and thereby removing the shortcomings of commonly used CNN or MLP architectures. To demonstrate the effectiveness of this approach, we revisit the well-established two-dimensional cylinder benchmark problem for active flow control. The RL training is implemented using Relexi, a high-performance RL framework, with flow simulations conducted in parallel using the high-order discontinuous Galerkin framework FLEXI. Our results show that GNN-based control policies achieve comparable performance to existing methods while benefiting from improved generalization properties. This work establishes GNNs as a promising architecture for RL-based flow control and highlights the capabilities of Relexi and FLEXI for large-scale RL applications in fluid dynamics.

强化学习流体控制图神经网络泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。