通过隐空间反演提升联邦域泛化隐私与性能
Federated Domain Generalization with Latent Space Inversion
- 用隐空间反演增强本地模型的域不变性,保护数据隐私
- 提出重要权重聚合策略,保留本地适应特征,提升泛化能力
- 在少通信开销下超越现有方法,适合隐私敏感场景
联邦域泛化(FedDG)在联邦学习框架下应对客户端间分布偏移问题。现有方法在提升全局模型泛化能力的同时,常因共享客户端数据统计信息而损害隐私。本文提出新方法,改进本地训练与模型聚合:引入一种新型技术——隐空间反演,增强本地模型的域不变性,提升隐私保护;针对非独立同分布(non-i.i.d)情况,设计重要权重聚合策略,在聚合过程中优先保留对本地预测影响显著的参数。大量实验表明,该方法在更少通信开销下优于当前最优方法。
原文摘要 · Abstract (English)
Federated domain generalization (FedDG) addresses distribution shifts among clients in a federated learning framework. FedDG methods aggregate the parameters of locally trained client models to form a global model that generalizes to unseen clients while preserving data privacy. While improving the generalization capability of the global model, many existing approaches in FedDG jeopardize privacy by sharing statistics of client data between themselves. Our solution addresses this problem by contributing new ways to perform local client training and model aggregation. To improve local client training, we enforce (domain) invariance across local models with the help of a novel technique, \textbf{latent space inversion}, which enables better client privacy. When clients are not \emph{i.i.d}, aggregating their local models may discard certain local adaptations. To overcome this, we propose an \textbf{important weight} aggregation strategy to prioritize parameters that significantly influence predictions of local models during aggregation. Our extensive experiments show that our approach achieves superior results over state-of-the-art methods with less communication overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。