arXiv:2606.07058cs.LGcs.CV2026-06被引 1

让VAE的潜在空间匹配数据真实拓扑,提升生成质量

Constructing VAE Latent Spaces with Prescribed Topology

论文配图:Constructing VAE Latent Spaces with Prescribed Topology
图 1 · 摘自论文原文
  • 用可分解分布构造非欧几何潜空间,支持环面、莫比乌斯带等复杂结构
  • 在旋转和循环移位的MNIST上,新方法在所有正则化强度下均优于标准VAE
  • 适合处理周期性或有对称性的数据,如图像方向、时间序列等场景

变分自编码器(VAE)学习高维数据的低维潜在表示。当数据位于具有非欧几里得拓扑的流形上时,标准高斯先验会引入拓扑不匹配,降低重建质量并阻碍忠实表征。本文提出一种构造性数学框架,解决所有具有乘积覆盖空间的流形的拓扑不匹配问题。这类流形可表示为圆、区间或直线的乘积,或其通过有限对称群商化得到,包括圆柱、环面、莫比乌斯带、克莱因瓶和实射影空间。对基本因子的因子化分布产生乘积拓扑,具有闭式解且解耦的KL散度,使每个潜在因子可独立塑造,同时保持训练可操作性。我们列出了适用于周期性、有界和无界支撑的可重参数化编码器-先验对,并提供坐标变换,使标准神经网络能输出非欧参数且梯度平滑。对于商流形,解码器接收覆盖空间坐标的群不变特征,使得被识别点产生相同输出。锚定约束可固定坐标系相对数据位置,或创建软拓扑空洞。在合成流形和真实图像数据集(旋转与循环移位的MNIST)上的实验表明,拓扑匹配的先验使KL正则化与数据流形对齐。所得拓扑感知模型在所有实际正则化强度下均优于高斯基线。代码见:https://github.com/JvHulst/VAE-Topology。

原文摘要 · Abstract (English)

Variational autoencoders (VAEs) learn low-dimensional latent representations of high-dimensional data. When the data lies on a manifold with non-Euclidean topology, the standard Gaussian prior introduces a topological mismatch that degrades reconstruction quality and prevents faithful representation. We present a constructive mathematical framework that resolves this mismatch for all manifolds that admit a product covering space. These are manifolds expressible as products of elementary factors (circles, intervals, or lines) or as quotients of such products by a finite symmetry group. The class includes cylinders, tori, Möbius strips, Klein bottles, and real projective spaces. Factorized distributions over the elementary factors yield product topologies with closed-form, decoupled KL divergences, so that each latent factor can be shaped independently while keeping training tractable. We catalogue reparametrizable encoder-prior pairs for periodic, bounded, and unbounded supports, and provide coordinate transformations that allow standard neural networks to output non-Euclidean parameters with smooth gradients. For quotient manifolds, the decoder receives group-invariant features of the covering-space coordinates, so that identified points produce identical outputs. Anchor constraints fix the coordinate system relative to the data or create soft topological holes. Experiments on synthetic manifolds and real-image datasets (rotated and cyclically shifted MNIST) confirm that a topology-matched prior aligns KL regularization with the data manifold. The resulting topology-aware models outperform the Gaussian baseline at all practically relevant regularization strengths. The code is available at https://github.com/JvHulst/VAE-Topology.

VAE拓扑学习生成模型流形学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。