arXiv:2410.18148cs.LGcs.AI2024-10被引 3

用可学习权重融合SVD与深度自编码器,突破物理系统降维瓶颈。

Beyond the Kolmogorov Barrier: A Learnable Weighted Hybrid Autoencoder for Model Order Reduction

论文配图:Beyond the Kolmogorov Barrier: A Learnable Weighted Hybrid Autoencoder for Model Order Reduction
图 1 · 摘自论文原文
  • 通过可学习权重融合SVD与深度自编码器,构建混合降维模型。
  • 在1D Kuramoto-Sivashinsky和湍流数据集上显著提升泛化性能。
  • 模型尖锐度仅为其他模型的千分之一,适合高维多尺度系统建模。

高维复杂物理系统的表征学习旨在识别低维内在隐空间,对降阶建模与模态分析至关重要。为突破著名的柯尔莫哥洛夫障碍,近年引入了深度自编码器(AE),但其在隐空间秩增加时常出现收敛性差的问题。为此,我们提出可学习加权混合自编码器,通过可学习加权框架结合奇异值分解(SVD)与深度自编码器的优势。研究发现,可学习权重参数至关重要——缺乏它们将导致模型退化为标准POD或无法实现预期收敛行为。有趣的是,实验发现训练后模型的尖锐度比其他模型小数千倍。在经典混沌偏微分方程系统(包括1D Kuramoto-Sivashinsky和受迫各向同性湍流数据集)上的实验表明,该方法相比多种竞争方法显著提升了泛化性能。此外,结合时间序列建模技术(如Koopman算子、LSTM),该方法在高维多尺度偏微分方程系统代理建模中也表现出显著优势。

原文摘要 · Abstract (English)

Representation learning for high-dimensional, complex physical systems aims to identify a low-dimensional intrinsic latent space, which is crucial for reduced-order modeling and modal analysis. To overcome the well-known Kolmogorov barrier, deep autoencoders (AEs) have been introduced in recent years, but they often suffer from poor convergence behavior as the rank of the latent space increases. To address this issue, we propose the learnable weighted hybrid autoencoder, a hybrid approach that combines the strengths of singular value decomposition (SVD) with deep autoencoders through a learnable weighted framework. We find that the introduction of learnable weighting parameters is essential -- without them, the resulting model would either collapse into a standard POD or fail to exhibit the desired convergence behavior. Interestingly, we empirically find that our trained model has a sharpness thousands of times smaller compared to other models. Our experiments on classical chaotic PDE systems, including the 1D Kuramoto-Sivashinsky and forced isotropic turbulence datasets, demonstrate that our approach significantly improves generalization performance compared to several competing methods. Additionally, when combining with time series modeling techniques (e.g., Koopman operator, LSTM), the proposed technique offers significant improvements for surrogate modeling of high-dimensional multi-scale PDE systems.

降维物理信息自编码器湍流建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。