arXiv:2509.13987cs.CRcs.AI2025-09被引 8

用随机响应保护联邦学习中的模型隐私,平衡安全与精度。

Differential Privacy in Federated Learning: Mitigating Inference Attacks with Randomized Response

  • 在联邦聚合中引入随机响应实现差分隐私
  • ε值越小精度越低,出现分类不平衡
  • 适合关注隐私与性能权衡的研究者

分布式机器学习需大量数据以实现高精度,传统集中式存储引发安全隐私担忧。为此提出联邦学习架构:客户端本地训练模型,定期上传至服务器进行聚合,生成全局模型再下发。虽避免了数据外泄,但攻击者仍可通过模型推断训练数据。本文采用差分隐私技术,结合随机响应,在数据层面增强隐私保护。实验以duCBA为聚合算法,分析不同ε值下的安全与性能平衡。结果表明,随着ε减小,模型准确率下降,且出现类别预测偏差。说明高隐私强度未必带来实际可用性,需谨慎权衡安全与性能。

原文摘要 · Abstract (English)

Machine learning models used for distributed architectures consisting of servers and clients require large amounts of data to achieve high accuracy. Data obtained from clients are collected on a central server for model training. However, storing data on a central server raises concerns about security and privacy. To address this issue, a federated learning architecture has been proposed. In federated learning, each client trains a local model using its own data. The trained models are periodically transmitted to the central server. The server then combines the received models using federated aggregation algorithms to obtain a global model. This global model is distributed back to the clients, and the process continues in a cyclical manner. Although preventing data from leaving the clients enhances security, certain concerns still remain. Attackers can perform inference attacks on the obtained models to approximate the training dataset, potentially causing data leakage. In this study, differential privacy was applied to address the aforementioned security vulnerability, and a performance analysis was conducted. The Data-Unaware Classification Based on Association (duCBA) algorithm was used as the federated aggregation method. Differential privacy was implemented on the data using the Randomized Response technique, and the trade-off between security and performance was examined under different epsilon values. As the epsilon value decreased, the model accuracy declined, and class prediction imbalances were observed. This indicates that higher levels of privacy do not always lead to practical outcomes and that the balance between security and performance must be carefully considered.

联邦学习差分隐私随机响应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。