arXiv:2509.25560cs.LG2025-09

用轻量梯度计算提升联邦学习抗干扰能力,效率提升450倍。

Lightweight and Robust Federated Data Valuation

  • 基于梯度轨迹估算客户端贡献,避免重复训练
  • 在噪声数据下表现媲美甚至超越现有方法,计算开销降450倍
  • 适合真实场景中需高效稳健聚合的联邦学习应用

联邦学习(FL)因非独立同分布数据和恶意客户端行为面临持续的鲁棒性挑战。贡献评估是一种有前景的缓解策略,可通过量化各客户端对全局模型的贡献实现自适应聚合。然而,现有基于谢林值的方法因需反复重加权和推理,计算开销巨大,限制了其可扩展性。我们提出FedIF,一种新型联邦聚合框架,利用基于轨迹的影响力估计,高效计算客户端贡献。FedIF通过在客户端更新上进行轻量级梯度操作并结合公开验证集,计算归一化且平滑的影响得分,实现去中心化联邦学习。理论分析表明,在噪声条件下,FedIF能获得更紧的一步全局损失变化上界。在CIFAR-10和Fashion-MNIST上的大量实验显示,即使在标签噪声、梯度噪声和对抗样本存在的情况下,FedIF的鲁棒性仍可媲美或超过基于谢林值的方法,同时将聚合开销降低高达450倍。消融实验证实了局部权重归一化与影响平滑设计的有效性。结果表明,FedIF是真实部署中高效且稳健联邦学习的实用、理论坚实且可扩展的替代方案。

原文摘要 · Abstract (English)

Federated learning (FL) faces persistent robustness challenges due to non-IID data distributions and adversarial client behavior. A promising mitigation strategy is contribution evaluation, which enables adaptive aggregation by quantifying each client's utility to the global model. However, state-of-the-art Shapley-value-based approaches incur high computational overhead due to repeated model reweighting and inference, which limits their scalability. We propose FedIF, a novel FL aggregation framework that leverages trajectory-based influence estimation to efficiently compute client contributions. FedIF adapts decentralized FL by introducing normalized and smoothed influence scores computed from lightweight gradient operations on client updates and a public validation set. Theoretical analysis demonstrates that FedIF yields a tighter bound on one-step global loss change under noisy conditions. Extensive experiments on CIFAR-10 and Fashion-MNIST show that FedIF achieves robustness comparable to or exceeding SV-based methods in the presence of label noise, gradient noise, and adversarial samples, while reducing aggregation overhead by up to 450x. Ablation studies confirm the effectiveness of FedIF's design choices, including local weight normalization and influence smoothing. Our results establish FedIF as a practical, theoretically grounded, and scalable alternative to Shapley-value-based approaches for efficient and robust FL in real-world deployments.

联邦学习轻量计算鲁棒性贡献评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。