同时优化降维与聚类,用梯度流在流形上搜索最优解。
Joint Representation Learning and Clustering via Gradient-Based Manifold Optimization

- 通过梯度流在流形上联合优化降维参数与聚类结果。
- 在MNIST数据集上优于主流聚类算法,提升显著。
- 适合需要端到端降维聚类的无监督学习场景。
聚类与降维是机器学习和计算机视觉中的关键问题。高维数据聚类长期受维度灾难困扰,因此联合学习降维与聚类更具前景。本文提出一种流形学习框架,可同步学习降维参数(如线性投影或神经网络)与基于所得特征的聚类结构(如高斯混合模型)。该框架利用梯度流在流形上搜索降维参数与最优聚类配置。以高斯混合模型为例,其过程类似无监督线性判别分析。我们在模拟数据及基准图像数据集MNIST上进行了实验,结果表明,所提算法性能优于文献中主流聚类方法。
原文摘要 · Abstract (English)
Clustering and dimensionality reduction have been crucial topics in machine learning and computer vision. Clustering high-dimensional data has been challenging for a long time due to the curse of dimensionality. For that reason, a more promising direction is the joint learning of dimension reduction and clustering. In this work, we propose a Manifold Learning Framework that learns dimensionality reduction and clustering simultaneously. The proposed framework is able to jointly learn the parameters of a dimension reduction technique (e.g. linear projection or a neural network) and cluster the data based on the resulting features (e.g. under a Gaussian Mixture Model framework). The framework searches for the dimension reduction parameters and the optimal clusters by traversing a manifold,using Gradient Manifold Optimization. The obtained The proposed framework is exemplified with a Gaussian Mixture Model as one simple but efficient example, in a process that is somehow similar to unsupervised Linear Discriminant Analysis (LDA). We apply the proposed method to the unsupervised training of simulated data as well as a benchmark image dataset (i.e. MNIST). The experimental results indicate that our algorithm has better performance than popular clustering algorithms from the literature.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。