提出新型自编码器,同时保留数据全局与局部几何结构。
Multi-Scale Geometric Autoencoder
- 采用不对称架构,编码器保全局距离,解码器保局部几何。
- 在合成与真实数据集上均优于现有方法。
- 适合需要精确结构保持的可视化与降维任务。
自编码器作为可视化和降维的强大工具,其核心假设是高维数据由低维流形生成。自编码器设计的关键挑战在于保持潜在空间中的几何结构,现有方法通常只关注全局或局部几何特性之一。全局方法常因距离近似误差累积而失效,局部方法则易收敛到扭曲大规模关系的次优解。本文提出多尺度几何自编码器(MAE),通过不对称架构实现双重结构保持:将全局距离约束应用于编码器,局部几何约束施加于解码器。理论分析表明,该设计天然契合编码器与解码器的不同角色。在合成流形与真实世界数据集上的全面实验表明,MAE 在多种评估指标上持续优于现有方法。
原文摘要 · Abstract (English)
Autoencoders have emerged as powerful models for visualization and dimensionality reduction based on the fundamental assumption that high-dimensional data is generated from a low-dimensional manifold. A critical challenge in autoencoder design is to preserve the geometric structure of data in the latent space, with existing approaches typically focusing on either global or local geometric properties separately. Global approaches often encounter errors in distance approximation that accumulate, while local methods frequently converge to suboptimal solutions that distort large-scale relationships. We propose Multi-Scale Geometric Autoencoder (MAE), which introduces an asymmetric architecture that simultaneously preserves both scales of the geometric structure by applying global distance constraints to the encoder and local geometric constraints to the decoder. Through theoretical analysis, we establish that this asymmetric design aligns naturally with the distinct roles of the encoder and decoder components. Our comprehensive experiments on both synthetic manifolds and real-world datasets demonstrate that MAE consistently outperforms existing methods across various evaluation metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。