用编码智能体搜索可解释的流控规则,性能媲美深度强化学习。
Heuristic Learning for Active Flow Control Using Coding Agents

- 通过编码智能体直接搜索显式反馈控制律,无需训练神经网络。
- 在13个流控任务中,10个表现优于或持平最强DRL基线。
- 控制器简洁可读,物理意义明确,适应性强,适合工程部署。
主动流控涉及非线性动力学、部分观测和计算成本高的模拟,控制器设计极具挑战。深度强化学习(DRL)虽具潜力,但通常依赖大量仿真交互,且生成的神经网络策略决策过程难以解释。本文提出新范式:不优化神经网络参数,而是利用现代编码智能体直接搜索显式可执行的反馈控制律。引入约束启发式学习协议,智能体通过公共基准接口迭代提出、评估并修正控制器实现。该框架在涵盖一维、二维和三维问题的13个主动流控基准上测试,与最强DRL基线在相同仿真预算下对比。所发现的启发式控制器在10个环境中匹配或超越最优DRL策略,同时保持紧凑、可解释、可直接检查。此外,控制器揭示出有意义的物理反馈机制,可在更复杂配置间迁移,并在雷诺数、瑞利数、执行器数量和观测稀疏性变化下保持竞争力。结果表明,基于编码智能体的启发式学习是传统强化学习的可信互补方案,兼具优异性能与可解释的控制器表示。提示词与源码见https://github.com/DonsetPG/fluid-heuristic-learning。
原文摘要 · Abstract (English)
Active flow control involves nonlinear dynamics, partial observations, and computationally expensive simulations, making controller design particularly challenging. Deep reinforcement learning (DRL) has emerged as a powerful framework for such problems, but its success typically relies on large numbers of simulator interactions and produces neural-network policies whose decision process often remains difficult to interpret. In this work, we investigate a different paradigm: instead of optimizing neural-network parameters, we use modern coding agents to search directly for explicit executable feedback laws. We introduce a constrained heuristic-learning protocol in which an agent iteratively proposes, evaluates, and revises controller implementations while interacting exclusively through the public benchmark interface. The proposed framework is evaluated on 13 active flow-control benchmarks spanning one, two, and three-dimensional problems and compared against the strongest available DRL baselines under identical simulation budgets. The discovered heuristic controllers match or outperform the best DRL policy in 10 of the 13 environments while remaining compact, interpretable, and directly inspectable. Beyond aggregate performance, the resulting controllers reveal physically meaningful feedback mechanisms, transfer successfully across more challenging configurations, and remain competitive under varying Reynolds and Rayleigh numbers, actuator counts, and observation sparsity. These results suggest that heuristic learning through coding agents constitutes a credible and complementary alternative to conventional reinforcement learning, combining competitive performance with physically interpretable controller representations. Prompts and source code are available at https://github.com/DonsetPG/fluid-heuristic-learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。