arXiv:2509.10691cs.CRcs.AI2025-09被引 4

通过动态噪声会计实现去中心化联邦学习的隐私保护,显著提升模型精度与效率。

Privacy-Preserving Decentralized Federated Learning via Explainable Adaptive Differential Privacy

  • 基于超维计算与透明噪声会计,仅添加最小必要噪声
  • 噪声增长由超线性降至对数级,精度提升14%-62%
  • 适合医疗、可穿戴设备等敏感数据场景,低延迟低能耗

去中心化联邦学习虽无需中心服务器,但共享模型更新仍可能泄露敏感信息,面临反演、重构和成员推断攻击。差分隐私虽提供形式化保护,但现有方法缺乏对先前参与者已注入噪声的感知,导致每个客户端在每一步均添加全量最坏情况扰动,累积噪声远超隐私需求,严重损害模型准确率。本文提出PrivateDFL框架,结合超维计算与透明噪声会计机制,追踪共享模型中累积扰动,使每个客户端仅需添加满足自身隐私预算的最小增量噪声。理论证明每次传输模型均满足目标隐私保障,且在该会计机制下累积噪声仅随客户端数量与轮次呈对数增长,而非无会计时的超线性增长。实验表明,在图像、语音及可穿戴传感器基准上,无论数据是否同分布,PrivateDFL均超越中心训练的Transformer与深度神经网络基线:图像任务准确率提升16%,语音任务提升62%,可穿戴传感任务提升14%;推理延迟降低至119倍以内,能耗降低至143倍以内。该方案为医疗与人类活动监测等敏感数据协作学习提供了实用解决方案。

原文摘要 · Abstract (English)

Decentralized federated learning enables collaborative model training without a central server, but shared model updates can still leak sensitive information through inversion, reconstruction, and membership inference attacks. Differential privacy offers formal protection, yet existing decentralized methods operate without visibility into the noise already injected by previous participants. Each client therefore adds a full, worst-case perturbation at every step, and the accumulated noise degrades accuracy well below what the privacy requirement actually demands. We present PrivateDFL, a decentralized and privacy-preserving framework that pairs hyperdimensional computing with a transparent noise accountant. The accountant tracks the cumulative perturbation present in the shared model and lets each client add only the minimal incremental noise needed to satisfy its privacy budget. We prove that every transmitted model satisfies the target privacy guarantee, and that under this accounting the cumulative noise grows only logarithmically in the number of clients and rounds, rather than the far faster super-linear growth incurred without accounting. This yields a substantially tighter balance between privacy and accuracy than prior approaches. Across image, speech, and wearable-sensor benchmarks, and under both identically and non-identically distributed data, PrivateDFL surpasses centrally trained Transformer-based and deep neural network baselines, improving accuracy by 16 percent on images, 62 percent on speech, and 14 percent on wearable sensing over the strongest baseline in each case, while reducing inference latency by up to 119 times and energy consumption by up to 143 times. These properties make PrivateDFL a practical solution for privacy-preserving collaborative learning in settings where sensitive data cannot be centralized, such as healthcare and human-activity monitoring.

联邦学习差分隐私去中心化隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。