arXiv:2410.20391cs.LG2024-10

提出稀疏连接的分层多核聚类算法,提升特征融合效果。

Hierarchical Multiple Kernel K-Means Algorithm Based on Sparse Connectivity

  • 通过稀疏率控制层间连接,实现局部特征融合。
  • 在多个数据集上优于全连接模型,聚类性能更优。
  • 适合需要高效特征融合的多层聚类任务。

多核学习(MKL)旨在寻找最优且一致的核函数。在分层多核聚类(HMKC)中,样本特征从高维空间逐层提取,以最大化有效信息保留。然而,层间信息交互常被忽略:当前模型仅相邻层对应节点交换信息,其余节点孤立;若采用全连接,最终一致性矩阵的多样性会下降。为此,本文提出基于稀疏连通性的分层多核K-Means(SCHMKKM)算法,通过设定稀疏率控制分配矩阵,实现稀疏连接,从而在层间局部融合提炼出的特征。实验在多个数据集上进行,与全连接分层多核K-Means(FCHMKKM)对比,结果表明更具有区分性的信息融合有助于学习更优的一致划分矩阵,且稀疏连接策略优于全连接策略。

原文摘要 · Abstract (English)

Multiple kernel learning (MKL) aims to find an optimal, consistent kernel function. In the hierarchical multiple kernel clustering (HMKC) algorithm, sample features are extracted layer by layer from a high-dimensional space to maximize the retention of effective information. However, information interaction between layers is often ignored. In this model, only corresponding nodes in adjacent layers exchange information; other nodes remain isolated, and if full connectivity is adopted, the diversity of the final consistency matrix is reduced. Therefore, this paper proposes a hierarchical multiple kernel K-Means (SCHMKKM) algorithm based on sparse connectivity, which controls the assignment matrix to achieve sparse connections through a sparsity rate, thereby locally fusing the features obtained by distilling information between layers. Finally, we conduct cluster analysis on multiple datasets and compare it with the fully connected hierarchical multiple kernel K-Means (FCHMKKM) algorithm in experiments. It is shown that more discriminative information fusion is beneficial for learning a better consistent partition matrix, and the fusion strategy based on sparse connection outperforms the full connection strategy.

聚类多核学习稀疏连接

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。