arXiv:2511.15172cs.LG2025-11

复数变分自编码器具有凯勒几何结构,可提升生成质量

Complex variational autoencoders admit Kähler structure

  • 基于复数潜空间构造凯勒势函数,替代传统费雪信息度量
  • 新方法计算高效,避免大规模自动微分的开销
  • 适用于需平滑潜空间表示的生成模型研究者

已知潜欧几里得变分自编码器(VAEs)在多种情形下具有黎曼结构。本文将此思想拓展至具有复数潜变量的变分自编码器,证明其在一定程度上具备凯勒几何结构。针对解码器几何,我们推导了在潜变量为复高斯分布且协方差矩阵为单位阵时的费雪信息度量。根据信息论,费雪信息等于相对熵(KL散度)的海森矩阵,因此该度量与凯勒势函数精确对应。我们提出一种复高斯混合模型的凯勒势函数导数,作为费雪度量的近似,同时保持底层凯勒几何一致性。该势函数为强拟凸函数(PSH),可将自动微分的计算负担从大规模降至小规模。通过全协方差定律,建立该势函数与费雪度量间的行为联系。结果表明,利用解码器几何正则化潜空间,并按加权复体积元素采样,可在牺牲部分样本多样性前提下,获得更平滑的表示和更少语义异常点。

原文摘要 · Abstract (English)

It has been discovered that latent-Euclidean variational autoencoders (VAEs) admit, in various capacities, Riemannian structure. We adapt these arguments but for complex VAEs with a complex latent stage. We show that complex VAEs reveal to some level Kähler geometric structure. Our methods will be tailored for decoder geometry. We derive the Fisher information metric in the complex case under a latent complex Gaussian with trivial relation matrix. It is well known from statistical information theory that the Fisher information coincides with the Hessian of the Kullback-Leibler (KL) divergence. Thus, the metric Kähler potential relation is exactly achieved under relative entropy. We propose a Kähler potential derivative of complex Gaussian mixtures that acts as a rough proxy to the Fisher information metric while still being faithful to the underlying Kähler geometry. Computation of the metric via this potential is efficient, and through our potential, valid as a plurisubharmonic (PSH) function, large scale computational burden of automatic differentiation is displaced to small scale. Our methods leverage the law of total covariance to bridge behavior between our potential and the Fisher metric. We show that we can regularize the latent space with decoder geometry, and that we can sample in accordance with a weighted complex volume element. We demonstrate these strategies, at the exchange of sample variation, yield consistently smoother representations and fewer semantic outliers.

变分自编码器凯勒几何复数潜空间生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。