解决联邦学习中的领域偏移问题,提升模型一致性与性能
Federated Learning with Domain Shift Eraser
- 将神经网络层拆分为通用特征提取器与领域偏移消除器,分步去偏
- 通过正则化使本地输出统计趋近全局一致,增强模型共识
- 通用模块全局聚合,偏移模块个性化聚合,适配不同客户端数据
联邦学习(FL)作为一种无需移动本地数据即可协作学习的技术日益受到关注。然而,来自不同领域的客户端数据会因领域偏移导致模型性能下降,阻碍学习一致的表征空间。本文提出一种新型联邦学习框架——联邦领域偏移消除器(FDSE),通过差异化消除各客户端的领域偏移并增强其共识来提升模型表现。首先,将模型前向传播建模为迭代去偏过程,交替提取与去偏特征。这通过将每个原始层分解为领域无关特征提取器(DFE)和领域相关偏移消除器(DSE)高效实现。其次,引入正则化项,通过拉近DSE输出的局部统计与全局一致统计,保证去偏有效性。最后,对所有客户端公平聚合并广播DFE模块以最大化共识;同时,通过相似性感知聚合个性化每个客户端的DSE模块,以差异方式消除其领域偏移。在三个数据集上进行的全面实验验证了该方法在准确率、效率和泛化能力方面的优势。
原文摘要 · Abstract (English)
Federated learning (FL) is emerging as a promising technique for collaborative learning without local data leaving their devices. However, clients' data originating from diverse domains may degrade model performance due to domain shifts, preventing the model from learning consistent representation space. In this paper, we propose a novel FL framework, Federated Domain Shift Eraser (FDSE), to improve model performance by differently erasing each client's domain skew and enhancing their consensus. First, we formulate the model forward passing as an iterative deskewing process that extracts and then deskews features alternatively. This is efficiently achieved by decomposing each original layer in the neural network into a Domain-agnostic Feature Extractor (DFE) and a Domain-specific Skew Eraser (DSE). Then, a regularization term is applied to promise the effectiveness of feature deskewing by pulling local statistics of DSE's outputs close to the globally consistent ones. Finally, DFE modules are fairly aggregated and broadcast to all the clients to maximize their consensus, and DSE modules are personalized for each client via similarity-aware aggregation to erase their domain skew differently. Comprehensive experiments were conducted on three datasets to confirm the advantages of our method in terms of accuracy, efficiency, and generalizability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。