arXiv:2608.29867cs.LG2026-08被引 1

线性编码器配合非线性解码器,也能实现高效降维。

Partially Linear Autoencoders for Manifold Learning and Dimensionality Reduction

  • 用线性编码器+非线性解码器构建新自编码器
  • 在多个数据集上重建误差接近全非线性模型
  • 适合追求可解释性和效率的降维场景

自编码器广泛用于非线性降维与流形学习。尽管多数实现依赖于非线性编码器和解码器,我们研究了编码器的作用及其线性约束的极限。在合成流形、计算力学数据集及真实图像数据集(包括MNIST)上,对比了四种架构:标准全非线性自编码器(AE)、线性编码器自编码器(Lenc-AE)、线性解码器自编码器(Ldec-AE)和全线性自编码器(LAE)。结果表明,只要解码器保持非线性,线性编码器可保留大部分表示能力。特别是,Lenc-AE始终优于Ldec-AE和LAE,且重建质量接近全非线性AE,同时具有更简洁和可解释的潜在表示。这说明非线性解码器是流形学习的关键,而非编码器。我们进一步提出了几何解释,明确了线性编码器充分性的条件及局限性暴露的流形配置。

原文摘要 · Abstract (English)

Autoencoders are widely used for nonlinear dimensionality reduction and manifold learning. While most common implementations rely on both nonlinear encoders and decoders, we investigate the specific role of the encoder and the extent to which it can be constrained to be linear without reducing accuracy. We conduct a comparative study on four autoencoder architectures: standard fully nonlinear autoencoders (AE), linear-encoder autoencoders (Lenc-AE), linear-decoder autoencoders (Ldec-AE), and fully linear autoencoders (LAE), evaluated on synthetic manifolds, computational mechanics data sets, and real-world image data sets including MNIST. We demonstrate that imposing a linear encoder preserves most of the representational capacity of the autoencoder, provided the decoder remains nonlinear. In particular, Lenc-AE consistently outperforms both Ldec-AE and LAE, and achieves reconstruction quality comparable to fully nonlinear AE, while offering advantages in terms of parsimony and interpretability of the latent representation. These results suggest that the nonlinear decoder is the critical component for manifold learning, rather than the encoder. A geometric interpretation of this finding is developed, which identifies the precise conditions under which a linear encoder is sufficient, and the specific manifold configurations that expose its limitations.

降维自编码器流形学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。