arXiv:2510.13622cs.LG2025-10

为t-SNE等降维方法设计可逆解码器,实现数据生成与重建。

Manifold Decoders: A Framework for Generative Modeling from Nonlinear Embeddings

  • 构建神经解码器框架,实现非线性降维嵌入的双向映射。
  • 重建效果接近自编码器,但生成样本质量低于标准扩散模型。
  • 揭示经典降维嵌入不适配连续生成过程的根本矛盾。

传统非线性降维(NLDR)方法如t-SNE、Isomap和LLE在数据可视化中表现优异,但缺乏将低维嵌入映射回原始高维空间的能力,限制了其在生成任务中的应用。本文提出系统性框架,为典型NLDR方法构建神经解码器架构,首次实现双向映射。进一步在学习到的流形空间内引入基于扩散的生成过程。在CelebA数据集上的实验表明,尽管解码器能有效重构数据,其性能仍逊于端到端优化的自编码器;而流形约束下的扩散生成样本质量较差,说明经典NLDR嵌入的离散稀疏特性不适用于生成模型所需的连续插值。本工作揭示了为以可视化为导向的降维方法添加生成能力所面临的根本挑战。

原文摘要 · Abstract (English)

Classical nonlinear dimensionality reduction (NLDR) techniques like t-SNE, Isomap, and LLE excel at creating low-dimensional embeddings for data visualization but fundamentally lack the ability to map these embeddings back to the original high-dimensional space. This one-way transformation limits their use in generative applications. This paper addresses this critical gap by introducing a system- atic framework for constructing neural decoder architectures for prominent NLDR methods, enabling bidirectional mapping for the first time. We extend this framework by implementing a diffusion-based generative process that operates directly within these learned manifold spaces. Through experiments on the CelebA dataset, we evaluate the reconstruction and generative performance of our approach against autoencoder and standard diffusion model baselines. Our findings reveal a fundamental trade- off: while the decoders successfully reconstruct data, their quality is surpassed by end-to-end optimized autoencoders. Moreover, manifold-constrained diffusion yields poor-quality samples, suggesting that the discrete and sparse nature of classical NLDR embeddings is ill-suited for the continuous inter- polation required by generative models. This work highlights the inherent challenges in retrofitting generative capabilities onto NLDR methods designed primarily for visualization and analysis.

生成模型降维扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。