arXiv:2608.09221cs.LGcs.AI2026-08被引 2

FedTVD通过质量与数量双权重提升联邦学习鲁棒性

FedTVD: Balancing Data Quality and Quantity for Robust Federated Learning

论文配图:FedTVD: Balancing Data Quality and Quantity for Robust Federated Learning
图 1 · 摘自论文原文
  • 用总变差距离衡量标签分布偏移,动态调整客户端权重
  • 在CIFAR-10上比FedAvg高10.6%准确率,跨数据集表现稳定
  • 适合数据异构严重的实际场景,尤其关注模型公平性

联邦学习(FL)可在保护数据隐私的前提下实现分布式设备协同训练。然而,由于标签分布偏移和数据集大小差异,传统方法易导致模型偏差并影响收敛。本文提出FedTVD,一种结合数据质量和数量的新型联邦学习算法。该方法利用总变差距离(TVD)度量每个客户端本地标签分布与全局均匀分布的差异,对高度偏斜的客户端降低权重,避免不平衡数据主导全局模型。同时保留数据集规模作为权重因子,兼顾可扩展性与公平性。实验表明,FedTVD在所有数据集(FMNIST、CIFAR-10、CIFAR-100)及不同异构程度下均优于现有方法;在高度偏斜的CIFAR-10上,准确率较FedAvg最高提升10.6%,且在中等和独立同分布(IID)设置下仍保持领先性能。

原文摘要 · Abstract (English)

Federated Learning (FL) enables collaborative model training across distributed client devices while preserving data privacy. However, FL faces significant challenges due to data heterogeneity, particularly in terms of label distribution skewness and variations in dataset sizes, which can lead to biased model updates and hinder convergence. To address this, we propose FedTVD, a novel FL algorithm that weights client contributions during aggregation by considering both data quality and quantity. Unlike traditional FL approaches such as FedAvg, which rely solely on dataset size for client weighting, FedTVD integrates Total Variation Distance (TVD) to measure the divergence between each client's local label distribution and a uniform global distribution. Clients with highly skewed distributions receive lower weights, preventing unbalanced datasets with imbalances from disproportionately influencing the global model. At the same time, dataset size is incorporated to ensure scalability and fairness. This dual-weighting mechanism effectively mitigates the impact of data imbalance, leading to more stable and generalized global models. Experimental results show that FedTVD consistently outperforms state-of-the-art methods across all datasets (FMNIST, CIFAR-10, and CIFAR-100) and all levels of data heterogeneity. Notably, it achieves up to 10.6% improvement over FedAvg on CIFAR-10 under highly skewed data, while maintaining top performance even under moderate and IID settings.

联邦学习数据异构模型鲁棒性加权聚合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。