提出新方法联合学习多视图数据的稀疏自表示,提升聚类效果。
A Joint Sparse Self-Representation Learning Method for Multiview Clustering
- 用ℓ₀-范数约束提取每视角特有局部信息,替代传统图正则化
- 在6个标准数据集上优于8个主流算法,聚类准确率显著提升
- 设计可全局收敛的AQP算法,解决非凸不可导模型求解难题
多视图聚类(MC)旨在利用不同视图间一致且互补的信息对样本进行分组。子空间聚类作为MC的基础技术备受关注。本文提出一种新型联合稀疏自表示学习模型用于多视图聚类,其核心创新在于引入基数(即ℓ₀-范数)约束以提取视图特异性局部信息,取代传统的图拉普拉斯正则化。具体而言,在每个视图中,基数约束直接限制自表示阶段使用的样本数量,从而提取可靠局部与全局结构信息;低秩约束则在融合阶段揭示共识相似度矩阵中的全局一致性结构。然而,直接应用基于增广拉格朗日法(ALM)的交替优化算法无法保证该非凸、非光滑模型的收敛性,导致泛化能力差。为此,我们提出具有全局收敛性的交替二次惩罚(AQP)方法,通过闭式解迭代求解两个子问题。六组标准数据集上的实验证明,本模型与AQP方法相比八个先进算法均表现更优。
原文摘要 · Abstract (English)
Multiview clustering (MC) aims to group samples using consistent and complementary information across various views. The subspace clustering, as a fundamental technique of MC, has attracted significant attention. In this paper, we propose a novel joint sparse self-representation learning model for MC, where a featured difference is the extraction of view-specific local information by introducing cardinality (i.e., $\ell_0$-norm) constraints instead of Graph-Laplacian regularization. Specifically, under each view, cardinality constraints directly restrict the samples used in the self-representation stage to extract reliable local and global structure information, while the low-rank constraint aids in revealing a global coherent structure in the consensus affinity matrix during merging. The attendant challenge is that Augmented Lagrange Method (ALM)-based alternating minimization algorithms cannot guarantee convergence when applied directly to our nonconvex, nonsmooth model, thus resulting in poor generalization ability. To address it, we develop an alternating quadratic penalty (AQP) method with global convergence, where two subproblems are iteratively solved by closed-form solutions. Empirical results on six standard datasets demonstrate the superiority of our model and AQP method, compared to eight state-of-the-art algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。