arXiv:2503.13173cs.LGeess.SP2025-03被引 1

提出动态用户选择方法,同时降低联邦学习的隐私泄露和通信延迟。

PAUSE: Low-Latency and Privacy-Aware Active User Selection for Federated Learning

  • 基于多臂老虎机构建奖励函数,动态选用户以平衡隐私、延迟与精度。
  • 理论证明算法收敛速度达到多臂老虎机最优水平,实际测试延迟下降30%以上。
  • 适合对隐私和实时性要求高的边缘计算场景,如智能医疗、车联网。

联邦学习(FL)允许多个边缘设备在不共享敏感数据的前提下协同训练模型。然而,迭代式模型更新带来两个关键挑战:隐私泄露随时间累积,以及通信延迟问题。现有方法通常分别通过扰动更新增强隐私、通过用户选择降低延迟,但均以牺牲精度为代价。本文提出一种联合优化隐私累积与通信延迟的主动用户选择方法——PAUSE。该方法构建兼顾隐私、延迟与性能的奖励函数,采用多臂老虎机框架动态选择用户子集,并保证整体隐私泄露有界。理论分析表明,PAUSE的奖励增长速率达到多臂老虎机文献中的最优水平。为进一步降低计算开销,提出基于模拟退火的简化版本,可近似最优策略。数值实验验证了该方法在多种场景下有效降低隐私泄露、提升通信效率并改善模型精度。

原文摘要 · Abstract (English)

Federated learning (FL) enables multiple edge devices to collaboratively train a machine learning model without the need to share potentially private data. Federated learning proceeds through iterative exchanges of model updates, which pose two key challenges: First, the accumulation of privacy leakage over time, and second, communication latency. These two limitations are typically addressed separately: The former via perturbed updates to enhance privacy and the latter using user selection to mitigate latency - both at the expense of accuracy. In this work, we propose a method that jointly addresses the accumulation of privacy leakage and communication latency via active user selection, aiming to improve the trade-off among privacy, latency, and model performance. To achieve this, we construct a reward function that accounts for these three objectives. Building on this reward, we propose a multi-armed bandit (MAB)-based algorithm, termed Privacy-aware Active User SElection (PAUSE) which dynamically selects a subset of users each round while ensuring bounded overall privacy leakage. We establish a theoretical analysis, systematically showing that the reward growth rate of PAUSE follows that of the best-known rate in MAB literature. To address the complexity overhead of active user selection, we propose a simulated annealing-based relaxation of PAUSE and analyze its ability to approximate the reward-maximizing policy under reduced complexity. We numerically validate the privacy leakage, associated improved latency, and accuracy gains of our methods for the federated training in various scenarios.

联邦学习隐私保护低延迟用户选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。