提出可逆自编码器,解决传统模型降维中误差停滞问题。
Deep Invertible Autoencoders for Dimensionality Reduction of Dynamical Systems
- 设计可逆神经网络层,逐步恢复高维系统信息。
- 在1D伯格斯方程和2D流体问题中,降低投影误差并突破误差平台。
- 适合需要高精度降维的工程与科学计算场景。
构建能高效预测高维参数化系统演化的降阶模型(ROM)在工程与应用科学中至关重要。基于投影的ROM方法常将全阶模型(FOM)动力学投影到低维流形上,传统方法如本征正交分解(POD)虽有理论保证,但在输运和对流主导问题中奇异值衰减缓慢;而自编码器(AE)虽能更好实现降维,常以少数模式捕捉特征,但存在投影误差随流形维度增加趋于平缓的问题。本文提出深度可逆自编码器(inv-AE),由多个可逆神经网络层组成,可随降维流形维度提升逐步恢复更多原始解信息。在参数化1D伯格斯方程和参数化2D障碍物绕流问题上的实验表明:(i) inv-AE有效缓解了传统卷积自编码器的误差平台现象;(ii) 可与主流投影式ROM方法结合,显著提升其精度。
原文摘要 · Abstract (English)
Constructing reduced-order models (ROMs) capable of efficiently predicting the evolution of high-dimensional, parametric systems is crucial in many applications in engineering and applied sciences. A popular class of projection-based ROMs projects the high-dimensional full-order model (FOM) dynamics onto a low-dimensional manifold. These projection-based ROMs approaches often rely on classical model reduction techniques such as proper orthogonal decomposition (POD) or, more recently, on neural network architectures such as autoencoders (AEs). In the case that the ROM is constructed by the POD, one has approximation guaranteed based based on the singular values of the problem at hand. However, POD-based techniques can suffer from slow decay of the singular values in transport- and advection-dominated problems. In contrast to that, AEs allow for better reduction capabilities than the POD, often with the first few modes, but at the price of theoretical considerations. In addition, it is often observed, that AEs exhibits a plateau of the projection error with the increment of the dimension of the trial manifold. In this work, we propose a deep invertible AE architecture, named inv-AE, that improves upon the stagnation of the projection error typical of traditional AE architectures, e.g., convolutional, and the reconstructions quality. Inv-AE is composed of several invertible neural network layers that allows for gradually recovering more information about the FOM solutions the more we increase the dimension of the reduced manifold. Through the application of inv-AE to a parametric 1D Burgers' equation and a parametric 2D fluid flow around an obstacle with variable geometry, we show that (i) inv-AE mitigates the issue of the characteristic plateau of (convolutional) AEs and (ii) inv-AE can be combined with popular projection-based ROM approaches to improve their accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。