arXiv:2409.19417cs.CRcs.AI2024-09被引 5

提出新攻击方法,精准识别跨孤岛联邦学习中谁用了特定用户数据。

Subject Data Auditing via Source Inference Attack in Cross-Silo Federated Learning

  • 基于嵌入特征设计二分类器,检测客户端是否使用目标主体数据
  • 在三个数据集上最高准确率达88%,优于现有方法
  • 适用于隐私敏感场景,提醒需加强主体级差分隐私防护

在联邦学习中,源推理攻击(SIA)旨在识别哪个客户端使用了特定数据点进行本地模型训练,使中央服务器能够审计客户端的数据使用情况。在跨孤岛联邦学习中,一个客户端(孤岛)收集来自多个主体(如个人、作者或设备)的数据,存在主体信息泄露风险。为此,本文提出主体级源推理攻击(SLSIA),突破了以往攻击仅允许一个客户端使用目标数据点、且对使用主体的检测不精确等关键限制。攻击者位于服务器端,控制目标数据源,目标是检测所有使用该主体数据的客户端。方法利用从目标主体数据预训练的模型,构建二分类攻击器,判断本地模型在目标主体测试数据上的嵌入是否包含唯一模式。实验显示,SLSIA在三个数据集上平均最高准确率达0.88。分析表明,主体稀疏的数据集更易受攻击。最后,提出采用项目级与主体级差分隐私作为防御方案。

原文摘要 · Abstract (English)

Source Inference Attack (SIA) in Federated Learning (FL) aims to identify which client used a target data point for local model training. It allows the central server to audit clients' data usage. In cross-silo FL, a client (silo) collects data from multiple subjects (e.g., individuals, writers, or devices), posing a risk of subject information leakage. Subject Membership Inference Attack (SMIA) targets this scenario and attempts to infer whether any client utilizes data points from a target subject in cross-silo FL. However, existing results on SMIA are limited and based on strong assumptions on the attack scenario. Therefore, we propose a Subject-Level Source Inference Attack (SLSIA) by removing critical constraints that only one client can use a target data point in SIA and imprecise detection of clients utilizing target subject data in SMIA. The attacker, positioned on the server side, controls a target data source and aims to detect all clients using data points from the target subject. Our strategy leverages a binary attack classifier to predict whether the embeddings returned by a local model on test data from the target subject include unique patterns that indicate a client trains the model with data from that subject. To achieve this, the attacker locally pre-trains models using data derived from the target subject and then leverages them to build a training set for the binary attack classifier. Our SLSIA significantly outperforms previous methods on three datasets. Specifically, SLSIA achieves a maximum average accuracy of 0.88 over 50 target subjects. Analyzing embedding distribution and input feature distance shows that datasets with sparse subjects are more susceptible to our attack. Finally, we propose to defend our SLSIA using item-level and subject-level differential privacy mechanisms.

联邦学习隐私攻击数据审计差分隐私

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。