arXiv:2412.05175cs.LGstat.ML2024-12

用变分编码解码器学习物理系统的低维隐空间表示,更紧凑且可生成。

Variational Encoder-Decoders for Learning Latent Representations of Physical Systems

  • 通过变分自编码框架将高维参数映射到低维隐码,再解码为可观测响应。
  • 仅用50个隐维度即可保持重建精度,显著低于传统方法。
  • 正则化提升隐空间解耦性,支持高质量数据生成,适合物理建模研究者。

我们提出一种基于深度学习的变分编码解码器(VED)框架,用于学习物理系统高维参数与其高维可观测响应之间关系的低维数据驱动表示。该框架包含两个基于深度学习的概率变换:编码器将参数映射为隐码,解码器将隐码映射为可观测响应。通过最大化可观测响应给定参数的对数条件分布的变分下界来优化变换的超参数。为促进隐码解耦,我们在变分损失中加入对隐码聚合分布协方差非对角项的惩罚项,该正则化促使标准高斯隐码的前推分布逼近可观测响应的边缘分布。利用该框架,我们成功将地下水流动模型中观测井的水压响应建模为离散对数水力传导率场的函数。相比典型相关分析编码,VED模型实现了更低维的隐空间表示,最低可达 $r = 50$ 隐维度,且重建精度未明显下降。我们研究了正则化对模型性能的影响,发现KL散度与协方差正则化均能提升隐空间特征解耦性,同时保持重建准确性。此外,通过解码随机高斯噪声评估模型生成能力,结果表明同时调节 $β$ 与 $λ$ 参数可显著提升生成可观测响应数据的质量。

原文摘要 · Abstract (English)

We present a deep-learning Variational Encoder-Decoder (VED) framework for learning data-driven low-dimensional representations of the relationship between high-dimensional parameters of a physical system and the system's high-dimensional observable response. The framework consists of two deep learning-based probabilistic transformations: An encoder mapping parameters to latent codes and a decoder mapping latent codes to the observable response. The hyperparameters of these transformations are identified by maximizing a variational lower bound on the log-conditional distribution of the observable response given parameters. To promote the disentanglement of latent codes, we equip this variational loss with a penalty on the off-diagonal entries of the aggregate distribution covariance of codes. This regularization penalty encourages the pushforward of a standard Gaussian distribution of latent codes to approximate the marginal distribution of the observable response. Using the proposed framework we successfully model the hydraulic pressure response at observation wells of a groundwater flow model as a function of its discrete log-hydraulic transmissivity field. Compared to the canonical correlation analysis encoding, the VED model achieves a lower-dimensional latent representation, with as low as $r = 50$ latent dimensions without a significant loss of reconstruction accuracy. We explore the impact of regularization on model performance, finding that KL-divergence and covariance regularization improve feature disentanglement in latent space while maintaining reconstruction accuracy. Furthermore, we evaluate the generative capabilities of the regularized model by decoding random Gaussian noise, revealing that tuning both $β$ and $λ$ parameters enhances the quality of the generated observable response data.

变分自编码物理建模隐空间表示生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。