arXiv:2410.14693cs.CVeess.IV2024-10

解决联邦学习中数据分布不均导致的收敛难题,提升分割模型性能。

Deep Domain Isolation and Sample Clustered Federated Learning for Semantic Segmentation

  • 通过梯度空间分离图像领域,识别客户端混合数据源
  • 构建样本聚类联邦框架,实现多域独立训练与推理匹配
  • 适合异构数据场景,尤其适用于城市图像分割任务

实证研究显示,联邦学习在非独立同分布(Non-IID)设置下存在收敛问题。现有研究多关注标签分布偏移或概念漂移,本文首次探讨2D分割任务中参与方间协变量偏移的影响,发现其影响虽小于标签偏移但仍存在。当前个性化(PFL)和聚类联邦(CFL)方法隐含假设每个客户端数据同质且与未来测试样本一致。为此,本文提出更通用、更现实的框架:每个客户端拥有多个潜在特征域的混合分布。为诊断此类病态特征分布,提出深度领域隔离(DDI),在模型梯度空间直接分离图像领域。通过在客户端拟合联邦高斯混合模型,并在服务器端结合谱聚类,实现样本级领域的去中心化分离。进一步构建样本聚类联邦学习(SCFL)框架,对每个分离出的领域独立训练模型。最后训练一个分类器,将测试样本映射至对应领域簇,实现无需假设测试分布的模型集成。在合成分割数据集及Cityscapes+GTA5组合数据集上验证,使用EfficientVIT-B0模型,性能显著优于现有方法。

原文摘要 · Abstract (English)

Empirical studies show that federated learning exhibits convergence issues in Non Independent and Identically Distributed (IID) setups. However, these studies only focus on label distribution shifts, or concept shifts (e.g. ambiguous tasks). In this paper, we explore for the first time the effect of covariate shifts between participants' data in 2D segmentation tasks, showing an impact way less serious than label shifts but still present on convergence. Moreover, current Personalized (PFL) and Clustered (CFL) Federated Learning methods intrinsically assume the homogeneity of the dataset of each participant and its consistency with future test samples by operating at the client level. We introduce a more general and realistic framework where each participant owns a mixture of multiple underlying feature domain distributions. To diagnose such pathological feature distributions affecting a model being trained in a federated fashion, we develop Deep Domain Isolation (DDI) to isolate image domains directly in the gradient space of the model. A federated Gaussian Mixture Model is fit to the sample gradients of each class, while the results are combined with spectral clustering on the server side to isolate decentralized sample-level domains. We leverage this clustering algorithm through a Sample Clustered Federated Learning (SCFL) framework, performing standard federated learning of several independent models, one for each decentralized image domain. Finally, we train a classifier enabling to associate a test sample to its corresponding domain cluster at inference time, offering a final set of models that are agnostic to any assumptions on the test distribution of each participant. We validate our approach on a toy segmentation dataset as well as different partitionings of a combination of Cityscapes and GTA5 datasets using an EfficientVIT-B0 model, showing a significant performance gain compared to other approaches. Our code is available at https://github.com/MatthisManthe/DDI_SCFL .

联邦学习语义分割域分离聚类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。