提出可保证单射性的双向利普希茨自编码器,提升降维稳定性与几何保真度。
Bi-Lipschitz Autoencoder With Injectivity Guarantee
- 基于分离准则的单射正则化,消除病态局部极小点。
- 双向利普希茨约束在数据分布漂移下仍保持结构保真。
- 适合对降维鲁棒性要求高的场景,如稀疏采样或分布变化数据。
自编码器广泛用于降维,其假设高维数据位于低维流形上。正则化自编码器旨在保留流形几何结构,但现有方法常因编码器非单射和过度刚性约束导致性能受限。本文识别出编码器非单射是收敛差与潜在表示失真的核心瓶颈。为确保跨数据分布的鲁棒性,我们形式化了可接受正则化的概念,并给出充分条件。提出双向利普希茨自编码器(BLAE),引入两项关键创新:(1) 基于分离准则的单射正则化,消除病态局部极小;(2) 双向利普希茨松弛,保留几何结构并具备对数据分布漂移的鲁棒性。在多种数据集上的实证结果表明,BLAE在保持流形结构方面持续优于现有方法,且对采样稀疏性和分布偏移具有强韧性。代码已开源:https://github.com/qipengz/BLAE。
原文摘要 · Abstract (English)
Autoencoders are widely used for dimensionality reduction, based on the assumption that high-dimensional data lies on low-dimensional manifolds. Regularized autoencoders aim to preserve manifold geometry during dimensionality reduction, but existing approaches often suffer from non-injective mappings and overly rigid constraints that limit their effectiveness and robustness. In this work, we identify encoder non-injectivity as a core bottleneck that leads to poor convergence and distorted latent representations. To ensure robustness across data distributions, we formalize the concept of admissible regularization and provide sufficient conditions for its satisfaction. In this work, we propose the Bi-Lipschitz Autoencoder (BLAE), which introduces two key innovations: (1) an injective regularization scheme based on a separation criterion to eliminate pathological local minima, and (2) a bi-Lipschitz relaxation that preserves geometry and exhibits robustness to data distribution drift. Empirical results on diverse datasets show that BLAE consistently outperforms existing methods in preserving manifold structure while remaining resilient to sampling sparsity and distribution shifts. Code is available at https://github.com/qipengz/BLAE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。