arXiv:2602.06838cs.AI2026-02中稿 · International Conf…被引 1

针对隐私保护下的联邦学习不稳定性问题,提出自适应优化框架。

An Adaptive Differentially Private Federated Learning Framework

  • 客户端用降维模块生成更结构化梯度,减少噪声放大。
  • 服务器动态调整裁剪阈值,避免过度裁剪和噪声主导。
  • 适合设备异构、数据非独立同分布的隐私敏感场景。

联邦学习在分布式客户端协作训练的同时保障数据隐私。但在实际部署中,设备异构和非独立同分布(Non-IID)数据常导致梯度不稳定且有偏。当引入差分隐私时,传统固定梯度裁剪和高斯噪声注入会进一步放大梯度扰动,引发训练震荡并降低模型性能。为此,本文提出一种自适应差分隐私联邦学习框架,旨在提升异构与隐私约束环境下的模型效率。客户端引入轻量级局部降维模块,学习低维中间表示,在反向传播中生成更结构化的梯度,从而缓解本地优化中的噪声放大。服务器端设计自适应梯度裁剪策略,根据历史更新统计动态调整裁剪阈值,避免过裁剪与噪声主导。此外,提出一种约束感知的鲁棒聚合机制,抑制不可靠或噪声主导的客户端更新,稳定全局优化。在CIFAR-10、SVHN和STL-10上的大量实验表明,该方法在差分隐私条件下持续提升收敛稳定性与分类性能。

原文摘要 · Abstract (English)

Federated learning enables collaborative model training across distributed clients while preserving data privacy. However, in practical deployments, device heterogeneity and non-independent and identically distributed (Non-IID) data often lead to unstable and biased gradient. When differential privacy is enforced, conventional fixed gradient clipping and Gaussian noise injection may further amplify gradient perturbations, resulting in training oscillation and degraded model performance. To address these challenges, we propose an adaptive differentially private federated learning framework that explicitly targets model efficiency under heterogeneous and privacy-constrained settings. On the client side, a lightweight local dimensionality reduction module is introduced to learn reduced-dimensional intermediate representations and produce more structured gradients during backpropagation, thereby mitigating noise amplification during local optimization. On the server side, an adaptive gradient clipping strategy dynamically adjusts clipping thresholds based on historical update statistics to avoid over-clipping and noise domination. Furthermore, a constraint-aware robust aggregation mechanism is designed to suppress unreliable or noise-dominated client updates and stabilize global optimization. Extensive experiments on CIFAR-10, SVHN, and STL-10 demonstrate that the proposed method consistently improves convergence stability and classification performance under differential privacy.

联邦学习差分隐私自适应优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。