自动确定最优聚类数,解决联邦聚类中集群数量未知与分布不均问题。
Federated Hierarchical Clustering with Automatic Selection of Optimal Cluster Numbers
- 基于层次聚类探索数据分布,客户端生成微子簇并上传原型
- 通过密度驱动的渐进合并自适应确定最优聚类数 $k^*$
- 适用于隐私保护下的分布式数据聚类,尤其适合集群数量未知场景
联邦聚类(FC)是一种在分布式且隐私保护的数据中无监督探索数据分布模式的新兴方案。现有方法隐含假设客户端具有已知数量且大小均匀的聚类,但真实场景中聚类数通常未知,且聚类大小天然不平衡。此外,联邦学习中的隐私保护传输约束不可避免地降低了可用信息量,使得开发鲁棒且准确的联邦聚类极具挑战。为此,我们提出一种新型联邦聚类框架 Fed-$k^*$-HC,可基于层次聚类探索的数据分布自动确定最优聚类数 $k^*$。为获取全局数据分布以确定 $k^*$,各客户端生成微子簇,其原型上传至服务器进行层次合并。基于密度的合并设计可探索不同大小和形状的聚类,渐进式合并过程可根据原型间的邻近关系自动终止,从而确定 $k^*$。在多种数据集上的大量实验表明,所提出的 Fed-$k^*$-HC 能准确探索出合适的聚类数,具备良好的联邦聚类能力。
原文摘要 · Abstract (English)
Federated Clustering (FC) is an emerging and promising solution in exploring data distribution patterns from distributed and privacy-protected data in an unsupervised manner. Existing FC methods implicitly rely on the assumption that clients are with a known number of uniformly sized clusters. However, the true number of clusters is typically unknown, and cluster sizes are naturally imbalanced in real scenarios. Furthermore, the privacy-preserving transmission constraints in federated learning inevitably reduce usable information, making the development of robust and accurate FC extremely challenging. Accordingly, we propose a novel FC framework named Fed-$k^*$-HC, which can automatically determine an optimal number of clusters $k^*$ based on the data distribution explored through hierarchical clustering. To obtain the global data distribution for $k^*$ determination, we let each client generate micro-subclusters. Their prototypes are then uploaded to the server for hierarchical merging. The density-based merging design allows exploring clusters of varying sizes and shapes, and the progressive merging process can self-terminate according to the neighboring relationships among the prototypes to determine $k^*$. Extensive experiments on diverse datasets demonstrate the FC capability of the proposed Fed-$k^*$-HC in accurately exploring a proper number of clusters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。