用可解释的模型加速偏微分方程系统控制,减少采样需求。
Interpretable and Efficient Data-driven Discovery and Control of Distributed Systems
- 结合SINDy-C与自编码器,实现高维状态压缩与可解释建模。
- 在1D Burgers和2D Navier-Stokes上验证,采样效率提升显著。
- 适合需要快速反馈与可解释性的流体控制研究者使用。
控制由偏微分方程(PDE)描述的系统在应用科学与工程中至关重要。这类系统因非线性动态、部分可观测性、离散后高维度、分布特性及低延迟反馈需求,给传统控制方法带来挑战。深度强化学习(DRL)近年展现出管理高维非线性系统的潜力,但存在样本效率低、鲁棒性差、缺乏可解释性等问题。为此,本文提出一种数据高效、可解释且可扩展的基于模型的强化学习框架,融合稀疏非线性动力学识别与控制(SINDy-C)算法和自编码器(AE),实现对PDE状态与动作的降维。该方法支持快速模拟,减少环境交互需求,并提供可解释的潜空间动态表示。我们在两个描述流体流动的PDE问题上验证方法:1D Burgers方程和2D Navier-Stokes方程,与无模型基线对比,并深入分析了所学动力学。
原文摘要 · Abstract (English)
Effectively controlling systems governed by Partial Differential Equations (PDEs) is crucial in several fields of Applied Sciences and Engineering. These systems usually yield significant challenges to conventional control schemes due to their nonlinear dynamics, partial observability, high-dimensionality once discretized, distributed nature, and the requirement for low-latency feedback control. Reinforcement Learning (RL), particularly Deep RL (DRL), has recently emerged as a promising control paradigm for such systems, demonstrating exceptional capabilities in managing high-dimensional, nonlinear dynamics. However, DRL faces challenges including sample inefficiency, robustness issues, and an overall lack of interpretability. To address these issues, we propose a data-efficient, interpretable, and scalable Dyna-style Model-Based RL framework for PDE control, combining the Sparse Identification of Nonlinear Dynamics with Control (SINDy-C) algorithm and an autoencoder (AE) framework for the sake of dimensionality reduction of PDE states and actions. This novel approach enables fast rollouts, reducing the need for extensive environment interactions, and provides an interpretable latent space representation of the PDE forward dynamics. We validate our method on two PDE problems describing fluid flows - namely, the 1D Burgers equation and 2D Navier-Stokes equations - comparing it against a model-free baseline, and carrying out an extensive analysis of the learned dynamics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。