基于分布核的分布式聚类,实现高效精准的任意形状聚类。
Distributed Clustering based on Distributional Kernel
- 用分布核衡量初始聚类间相似性,实现全局一致聚类。
- 各节点运行时间低于中心化模式,且能处理任意形状密度聚类。
- 适用于大规模数据,兼容多种聚类算法,适合隐私敏感场景。
本文提出一种新的分布式网络聚类框架——基于分布核的分布式聚类(KDC),其最终聚类结果基于初始聚类分布间的相似性,由分布核K度量。该框架是唯一同时满足三项性质的方案:第一,各站点联合聚类结果等同于所有数据集中式聚类结果;第二,任一节点在分布式模式下的最大运行时间小于集中式模式;第三,可发现任意形状、大小和密度的聚类。据我们所知,这是首个采用分布核的分布式聚类框架。基于分布的聚类显著优于现有方法。此外,我们引入一种新算法:核约束聚类核心(Kernel Bounded Cluster Cores),在现有算法中表现最佳。KDC为二次时间复杂度聚类算法提供了处理大规模数据的可能,具备通用性。
原文摘要 · Abstract (English)
This paper introduces a new framework for clustering in a distributed network called Distributed Clustering based on Distributional Kernel (K) or KDC that produces the final clusters based on the similarity with respect to the distributions of initial clusters, as measured by K. It is the only framework that satisfies all three of the following properties. First, KDC guarantees that the combined clustering outcome from all sites is equivalent to the clustering outcome of its centralized counterpart from the combined dataset from all sites. Second, the maximum runtime cost of any site in distributed mode is smaller than the runtime cost in centralized mode. Third, it is designed to discover clusters of arbitrary shapes, sizes and densities. To the best of our knowledge, this is the first distributed clustering framework that employs a distributional kernel. The distribution-based clustering leads directly to significantly better clustering outcomes than existing methods of distributed clustering. In addition, we introduce a new clustering algorithm called Kernel Bounded Cluster Cores, which is the best clustering algorithm applied to KDC among existing clustering algorithms. We also show that KDC is a generic framework that enables a quadratic time clustering algorithm to deal with large datasets that would otherwise be impossible.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。