arXiv:2601.21160cs.LG2026-01中稿 · ICLR

联邦聚类未知簇数,通过不确定性集实现全局聚类融合

A Federated Generalized Expectation-Maximization Algorithm for Mixture Models with an Unknown Number of Components

  • 各客户端本地运行EM,构建每个簇的不确定性集
  • 服务器用不确定性集推断簇重叠,闭式计算确定全局簇数
  • 适用于数据异质且簇不完全一致的联邦学习场景

我们研究了联邦聚类中全局簇数未知、客户端数据存在异质且可能重叠簇集的问题。为此,提出FedGEM:一种用于未知成分数混合模型的联邦广义期望最大化算法。该算法要求各客户端在本地执行EM步骤,并为每个局部成分构造一个与最大化点相关的不确定性集。中央服务器利用这些不确定性集来学习客户端间的潜在簇重叠,并通过闭式计算推断全局簇数。本文对算法进行了全面的理论分析,在常见假设下给出了概率收敛保证。针对各向同性高斯混合模型(isotropic GMMs),进一步提供了客户端每轮迭代中可执行的可计算、低复杂度算法,同时严格验证了算法收敛所需的假设条件。大量数值实验表明,所提方法性能接近集中式EM,优于现有联邦聚类方法。

原文摘要 · Abstract (English)

We study the problem of federated clustering when the total number of clusters $K$ across clients is unknown, and the clients have heterogeneous but potentially overlapping cluster sets in their local data. To that end, we develop FedGEM: a federated generalized expectation-maximization algorithm for the training of mixture models with an unknown number of components. Our proposed algorithm relies on each of the clients performing EM steps locally, and constructing an uncertainty set around the maximizer associated with each local component. The central server utilizes the uncertainty sets to learn potential cluster overlaps between clients, and infer the global number of clusters via closed-form computations. We perform a thorough theoretical study of our algorithm, presenting probabilistic convergence guarantees under common assumptions. Subsequently, we study the specific setting of isotropic GMMs, providing tractable, low-complexity computations to be performed by each client during each iteration of the algorithm, as well as rigorously verifying assumptions required for algorithm convergence. We perform various numerical experiments, where we empirically demonstrate that our proposed method achieves comparable performance to centralized EM, and that it outperforms various existing federated clustering methods.

联邦学习聚类混合模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。