恶意服务器通过后门攻击,可精准提取客户端训练数据。
Memory Backdoor Attacks on Neural Networks
- 用触发索引在训练时植入后门,实现数据精确回收
- 实验显示数千条敏感数据可被恢复,任务性能仅降3%
- 适合关注联邦学习隐私安全的研究者与开发者
神经网络常基于私有数据集训练,成为攻击目标。本文提出一种新型数据提取方法,利用训练阶段的后门攻击,使恶意联邦学习服务器能通过简单索引过程系统性、确定性地恢复客户端完整训练样本。与以往方法不同,该方法确保数据完全复原而非概率重构或幻觉生成,可精确控制记忆样本数量和内容,并具备高容量与鲁棒性。受感染模型在接收到基于模式的索引触发时输出原始数据,实现对客户端本地数据的有效片段提取,且不损害全局模型性能。针对模型输出尺寸小的问题,采用分块提取再重组策略。攻击只需微调训练代码,易规避客户端验证。评估覆盖分类器、分割模型和大语言模型,结果显示在极小性能损失下可恢复数千条敏感数据,经多轮联邦学习后甚至可窃取客户端全部数据集。例如,医疗分割数据集仅造成3%性能下降即可被完整提取。研究揭示了联邦学习系统的严重隐私漏洞,亟需加强分布式训练管道的完整性与透明性。
原文摘要 · Abstract (English)
Neural networks are often trained on proprietary datasets, making them attractive attack targets. We present a novel dataset extraction method leveraging an innovative training time backdoor attack, allowing a malicious federated learning server to systematically and deterministically extract complete client training samples through a simple indexing process. Unlike prior techniques, our approach guarantees exact data recovery rather than probabilistic reconstructions or hallucinations, provides precise control over which samples are memorized and how many, and shows high capacity and robustness. Infected models output data samples when they receive a patternbased index trigger, enabling systematic extraction of meaningful patches from each clients local data without disrupting global model utility. To address small model output sizes, we extract patches and then recombined them. The attack requires only a minor modification to the training code that can easily evade detection during client-side verification. Hence, this vulnerability represents a realistic FL supply-chain threat, where a malicious server can distribute modified training code to clients and later recover private data from their updates. Evaluations across classifiers, segmentation models, and large language models demonstrate that thousands of sensitive training samples can be recovered from client models with minimal impact on task performance, and a clients entire dataset can be stolen after multiple FL rounds. For instance, a medical segmentation dataset can be extracted with only a 3 percent utility drop. These findings expose a critical privacy vulnerability in FL systems, emphasizing the need for stronger integrity and transparency in distributed training pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。