针对数据异构与设备参与不全,提出本地自编码去噪器提升联邦学习效果
FedOAED: Federated On-Device Autoencoder Denoiser for Heterogeneous Data under Limited Client Availability
- 客户端部署自编码去噪器,减少异构数据带来的梯度噪声
- 在多个视觉数据集上,性能优于现有最优联邦学习方法
- 适合数据隐私强、设备参与不稳定的医疗或金融场景
近年来,机器学习与深度学习依赖大量高质量数据,在诸多应用中展现潜力。然而,如通用数据保护条例(GDPR)和健康保险可携性与责任法案(HIPAA)等严格的数据共享法规,阻碍了数据驱动应用的实现。联邦学习(FL)通过让原始数据保留在本地设备,为解决此问题提供了可能。尽管近年发展迅速,但联邦学习仍面临数据异构性问题,导致梯度噪声、客户端漂移及因部分客户端参与而产生的方差增加。本文提出FedOAED,一种新型联邦学习算法,旨在缓解多轮本地训练引发的客户端漂移以及部分客户端参与导致的方差。该方法在客户端部署本地自编码去噪器,以应对异构数据在有限客户端可用性下的影响。在多个视觉数据集的非独立同分布(Non-IID)设置下实验表明,FedOAED持续优于当前最先进的基线方法。
原文摘要 · Abstract (English)
Over the last few decades, machine learning (ML) and deep learning (DL) solutions have demonstrated their potential across many applications by leveraging large amounts of high-quality data. However, strict data-sharing regulations such as the General Data Protection Regulation (GDPR) and the Health Insurance Portability and Accountability Act (HIPAA) have prevented many data-driven applications from being realised. Federated Learning (FL), in which raw data never leaves local devices, has shown promise in overcoming these limitations. Although FL has grown rapidly in recent years, it still struggles with heterogeneity, which produces gradient noise, client-drift, and increased variance from partial client participation. In this paper, we propose FedOAED, a novel federated learning algorithm designed to mitigate client-drift arising from multiple local training updates and the variance induced by partial client participation. FedOAED incorporates an on-device autoencoder denoiser on the client side to mitigate client-drift and variance resulting from heterogeneous data under limited client availability. Experiments on multiple vision datasets under Non-IID settings demonstrate that FedOAED consistently outperforms state-of-the-art baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。