提出三种简单有效的方法,从联邦微调的LLM中提取跨客户端隐私数据。
Simple Yet Effective: Extracting Private Data Across Clients in Federated Fine-Tuning of Large Language Models
- 利用攻击者本地数据的上下文前缀,通过频率采样和微调放大记忆效应。
- 在中文法律数据集上,可恢复高达56.6%的专属个人隐私信息。
- 揭示联邦大模型隐私风险,适合关注隐私安全的研究者参考。
联邦大语言模型(FedLLMs)使机构间可在保护数据本地性的前提下协同训练,适用于法律、金融、医疗等敏感领域。然而,大模型的记忆行为可能导致隐私泄露风险,引发跨客户端数据暴露。本文研究了半诚实参与者从其他客户端数据中提取个人身份信息(PII)的威胁,提出三种简单有效的提取策略:基于频率的前缀采样与本地微调以放大记忆效果。为评估攻击效果,构建了一个带有细粒度PII标注的中文法律领域数据集,符合CPIS、GDPR和CCPA标准,并采用覆盖率与效率两个指标进行评测。实验表明,所提方法可恢复高达56.6%的受害者专属PII,其中姓名、地址和生日尤为脆弱。研究揭示了联邦微调中的实际隐私风险,建立了评估基准与框架,为未来隐私保护联邦学习研究提供支持。代码与数据见https://github.com/SMILELab-FL/FedPII。
原文摘要 · Abstract (English)
Federated large language models (FedLLMs) enable cross-silo collaborative training among institutions while preserving data locality, making them appealing for privacy-sensitive domains such as law, finance, and healthcare. However, the memorization behavior of LLMs can lead to privacy risks that may cause cross-client data leakage. In this work, we study the threat of cross-client data extraction, where a semi-honest participant attempts to recover personally identifiable information (PII) memorized from other clients' data. We propose three simple yet effective extraction strategies that leverage contextual prefixes from the attacker's local data, including frequency-based prefix sampling and local fine-tuning to amplify memorization. To evaluate these attacks, we construct a Chinese legal-domain dataset with fine-grained PII annotations consistent with CPIS, GDPR, and CCPA standards, and assess extraction performance using two metrics: coverage and efficiency. Experimental results show that our methods can recover up to 56.6% of victim-exclusive PII, where names, addresses, and birthdays are particularly vulnerable. These findings highlight concrete privacy risks in FedLLMs and establish a benchmark and evaluation framework for future research on privacy-preserving federated learning. Code and data are available at https://github.com/SMILELab-FL/FedPII.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。