arXiv:2503.06457cs.CVcs.AI2025-03CVPR被引 24

用几何形状引导生成数据,提升联邦学习在异构数据下的效果

Geometric Knowledge-Guided Localized Global Distribution Alignment for Federated Learning

  • 基于嵌入分布的几何形状生成新样本,模拟全局分布
  • 在标签偏移和领域偏移共存时,准确率提升5.3%以上
  • 适合处理数据异构严重的联邦学习场景

联邦学习中的数据异构性表现为本地与全局分布显著不匹配,导致局部优化方向发散,阻碍全局模型训练。现有方法多聚焦于优化本地更新或全局聚合,但在标签偏移与领域偏移共存的高异构场景下表现不稳定。为此,我们提出一种几何引导的数据生成方法,旨在本地模拟全局嵌入分布。首先定义嵌入分布的几何形状,并解决隐私约束下获取全局几何形状的难题;随后提出GGEUR,利用全局几何形状指导新样本生成,更接近理想全局分布。在单域场景中,基于全局几何形状增强样本以提升泛化能力;在多域场景中,进一步引入类别原型跨域模拟全局分布。大量实验表明,该方法显著提升现有方法在高度异构数据上的性能,包括标签偏移、领域偏移及其共存情形。代码已公开:https://github.com/WeiDai-David/2025CVPR_GGEUR

原文摘要 · Abstract (English)

Data heterogeneity in federated learning, characterized by a significant misalignment between local and global distributions, leads to divergent local optimization directions and hinders global model training. Existing studies mainly focus on optimizing local updates or global aggregation, but these indirect approaches demonstrate instability when handling highly heterogeneous data distributions, especially in scenarios where label skew and domain skew coexist. To address this, we propose a geometry-guided data generation method that centers on simulating the global embedding distribution locally. We first introduce the concept of the geometric shape of an embedding distribution and then address the challenge of obtaining global geometric shapes under privacy constraints. Subsequently, we propose GGEUR, which leverages global geometric shapes to guide the generation of new samples, enabling a closer approximation to the ideal global distribution. In single-domain scenarios, we augment samples based on global geometric shapes to enhance model generalization; in multi-domain scenarios, we further employ class prototypes to simulate the global distribution across domains. Extensive experimental results demonstrate that our method significantly enhances the performance of existing approaches in handling highly heterogeneous data, including scenarios with label skew, domain skew, and their coexistence. Code published at: https://github.com/WeiDai-David/2025CVPR_GGEUR

联邦学习数据异构几何引导分布对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。