提出多粒度竞争学习算法,自动发现嵌套式类别聚类结构。
Robust Categorical Data Clustering Guided by Multi-Granular Competitive Learning
- 通过多粒度竞争惩罚机制动态调整聚类
- 在真实数据集上优于现有最先进方法
- 适合大规模类别型数据的高效聚类与分布式预分区
包含类别特征的数据集在大数据分析中极为常见。由于类别特征取值有限且为定性,其隐式离散距离空间普遍存在嵌套粒度聚类现象:数据对象常在空间或子空间重叠形成紧凑小簇,相似小簇又进一步构成大簇。然而,因类别值为定性,无法像欧氏空间一样明确定义距离,给聚类分析带来挑战。为此,我们设计了多粒度竞争惩罚学习(MGCPL)算法,使潜在聚类能分阶段自适应调整并收敛于不同数量的自然紧凑簇。为利用MGCPL,还提出基于编码的聚类聚合策略(CAME),先根据学习到的多粒度分布对数据对象进行编码,再对嵌入表示进行最终聚类。实验表明,所提出的MCDC方法能有效自动探索多粒度嵌套分布,对各类别数据集具有高度鲁棒性。得益于线性时间复杂度,该方法可扩展至大规模数据集,在数据集预分区或计算节点划分中具有应用前景。大量实验证据显示其在多个公开真实数据集上优于当前最优方法。
原文摘要 · Abstract (English)
Data set composed of categorical features is very common in big data analysis tasks. Since categorical features are usually with a limited number of qualitative possible values, the nested granular cluster effect is prevalent in the implicit discrete distance space of categorical data. That is, data objects frequently overlap in space or subspace to form small compact clusters, and similar small clusters often form larger clusters. However, the distance space cannot be well-defined like the Euclidean distance due to the qualitative categorical data values, which brings great challenges to the cluster analysis of categorical data. In view of this, we design a Multi-Granular Competitive Penalization Learning (MGCPL) algorithm to allow potential clusters to interactively tune themselves and converge in stages with different numbers of naturally compact clusters. To leverage MGCPL, we also propose a Cluster Aggregation strategy based on MGCPL Encoding (CAME) to first encode the data objects according to the learned multi-granular distributions, and then perform final clustering on the embeddings. It turns out that the proposed MGCPL-guided Categorical Data Clustering (MCDC) approach is competent in automatically exploring the nested distribution of multi-granular clusters and highly robust to categorical data sets from various domains. Benefiting from its linear time complexity, MCDC is scalable to large-scale data sets and promising in pre-partitioning data sets or compute nodes for boosting distributed computing. Extensive experiments with statistical evidence demonstrate its superiority compared to state-of-the-art counterparts on various real public data sets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。