用变分自编码器发现并解码多体系统的隐含平均场结构
Discovering and decoding latent mean-field structure with variational autoencoders

- 通过比较潜空间速率与数据双体互信息,建立VAE容量上限判据
- 成功重构即表明存在隐含平均场结构,可直接读取微观参数
- 在神经数据中仅用两个集体变量就复现群体统计特征
生成模型被越来越多用于捕捉多体系统中的相关性,但其学习到的表示仍难以进行物理解释。本文提出一个直观准则,量化变分自编码器(VAE)重建多体系统联合概率分布的能力。核心是将潜空间通道速率与数据双体互信息进行比较,得到VAE容量的上界。由此证明:任何成功重构的VAE,其条件独立解码器在结构上等价于有限尺寸的平均场因子分解。因此,成功重构即为隐含平均场理论的直接证据,该理论的微观参数可从训练好的解码器中读出。我们在一系列可解模型上验证结论,包括标量(Curie-Weiss)、向量(Hopfield)和张量(Maier-Saupe)序参量,仅用平衡样本就恢复了完整的Hopfield模式矩阵。应用于蝾螈视网膜记录时,两潜变量的VAE仅用两个有效集体变量即可精确复现群体统计,并从中提取出神经群体的‘存储模式’,构建出能准确描述实验数据的广义霍普菲尔德模型。
原文摘要 · Abstract (English)
Generative models are increasingly used to capture correlations in many-body systems, but the representations they learn remain largely opaque to physical interpretation. Here, we establish an intuitive criterion that quantifies the capacity of a variational autoencoder (VAE) to faithfully reconstruct the joint probability distribution of a many body system. In a nutshell, a bound on the VAE capacity is obtained by comparing the rate of the latent channel to the bipartite mutual information of the data. Using this bound, we show that the conditionally independent decoder of any successful VAE is structurally identical to a finite-size mean-field factorization. Hence, a successful reconstruction is direct evidence for a latent mean-field theory and the microscopic parameters of that theory can be read off the trained decoder. We validate these conclusions on a hierarchy of solvable models with scalar (Curie-Weiss), vector (Hopfield) and tensor (Maier-Saupe) order parameters, recovering the full Hopfield pattern matrix from equilibrium samples alone. We find that, when applied to Salamander retinal recordings, a two-latent VAE reproduces the population statistics with only two effective collective variables allowing us to recover the `stored patterns' of the neural population and write a generalized Hopfield model which correctly models the experimental data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。