arXiv:2410.07289cs.LGcs.AI2024-10被引 1

POLCA Net将PCA/LDA扩展到非线性场景,实现高保真降维与可解释表征。

Principal Orthogonal Latent Components Analysis (POLCA Net)

  • 基于自编码器与专用损失函数,联合优化降维与正交性
  • 支持方差排序特征、高保真重建及分类标签引导的可视化
  • 适合需要可解释低维表示的分类与可视化任务

表示学习是机器学习中的核心领域,致力于从原始数据中自动发现任务所需的特征。与依赖人工设计特征的传统方法不同,表示学习旨在学习更适用于分类、预测和聚类等任务的特征。本文提出主正交潜在成分分析网络(POLCA Net),旨在模拟并拓展主成分分析(PCA)与线性判别分析(LDA)在非线性领域的应用。POLCA Net结合自编码器框架与一组特定损失函数,实现有效的维度压缩、特征正交性、基于方差的特征排序、高保真重建,并在使用分类标签时,生成适合线性分类器且便于低维可视化类别分布的潜在表示。

原文摘要 · Abstract (English)

Representation learning is a pivotal area in the field of machine learning, focusing on the development of methods to automatically discover the representations or features needed for a given task from raw data. Unlike traditional feature engineering, which requires manual crafting of features, representation learning aims to learn features that are more useful and relevant for tasks such as classification, prediction, and clustering. We introduce Principal Orthogonal Latent Components Analysis Network (POLCA Net), an approach to mimic and extend PCA and LDA capabilities to non-linear domains. POLCA Net combines an autoencoder framework with a set of specialized loss functions to achieve effective dimensionality reduction, orthogonality, variance-based feature sorting, high-fidelity reconstructions, and additionally, when used with classification labels, a latent representation well suited for linear classifiers and low dimensional visualization of class distribution as well.

表示学习降维自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。