arXiv:2504.06235cs.LGcs.AI2025-04

提出去中心化风格共享算法,让设备在无主节点情况下高效泛化到未知数据分布。

Decentralized Domain Generalization with Style Sharing: Formal Model and Convergence Analysis

  • 设备间共享数据风格信息,构建去中心化域泛化模型
  • 实验显示在多个目标域上准确率显著提升,通信开销极低
  • 首次给出风格共享训练的收敛性分析,理论严谨

联邦学习通常假设训练与测试数据分布一致,但实际中常存在分布偏移,推动域泛化(DG)研究。现有工作在两方面存在缺口:一是缺乏对DG目标的严格数学分析;二是联邦域泛化局限于星型拓扑。本文提出去中心化联邦域泛化风格共享算法(StyleDDG),使对等网络中的设备通过共享从本地数据中推断出的风格信息实现域泛化。我们首次系统地分析了去中心化网络中基于风格的DG训练,将已有集中式DG算法纳入统一框架,并用于建模StyleDDG。进一步推导出保证其收敛性的解析条件。在主流域泛化数据集上的实验表明,相较于基线去中心化梯度方法,StyleDDG在各目标域上显著提升准确率,且通信开销极小。

原文摘要 · Abstract (English)

Much of federated learning (FL) focuses on settings where local dataset statistics remain the same between training and testing. However, this assumption often does not hold in practice due to distribution shifts, motivating the development of domain generalization (DG) approaches that leverage source domain data to train models capable of generalizing to unseen target domains. In this paper, we are motivated by two major gaps in existing work on FL and DG: (1) the lack of formal mathematical analysis of DG objectives; and (2) DG research in FL being limited to the star-topology architecture. We develop Decentralized Federated Domain Generalization with Style Sharing ($\textit{StyleDDG}$), a decentralized DG algorithm which allows devices in a peer-to-peer network to achieve DG based on sharing style information inferred from their datasets. Additionally, we provide the first systematic approach to analyzing style-based DG training in decentralized networks. We cast existing centralized DG algorithms within our framework, and employ their formalisms to model $\textit{StyleDDG}$. We then obtain analytical conditions under which convergence of $\textit{StyleDDG}$ can be guaranteed. Through experiments on popular DG datasets, we demonstrate that $\textit{StyleDDG}$ can obtain significant improvements in accuracy across target domains with minimal communication overhead compared to baseline decentralized gradient methods.

联邦学习域泛化去中心化风格共享

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。