攻击者通过污染代码在训练时泄露数据属性,不降模型性能且成功率100%
Code-Poisoning Property Inference Attacks

- 在代码层面嵌入隐私信息,利用模型查询反推训练数据属性
- 攻击准确率100%,模型精度不受影响,无需额外计算资源
- 适用于多种模型和防御机制,适合研究数据隐私的开发者
代码托管平台和编程助手使初学者能快速使用公开代码构建定制化机器学习模型。然而,模型训练数据(如临床记录、交易信息)常被视为私有财产,存在信息泄露风险。属性推理攻击(PIA)是一类重要的隐私攻击,旨在揭示训练数据的全局属性。本文提出首个代码级属性推理攻击——代码污染属性推理攻击(CPPIA),克服了现有方法在攻击效果、模型性能下降、计算开销及防御鲁棒性方面的四大局限。针对来自GitHub等平台或Codex等编码代理的恶意代码提供者,当数据持有者下载被污染的代码并用私有数据训练模型后,攻击者在训练阶段将属性信息嵌入秘密样本,并在后期通过查询模型来泄露隐私。实验在四个数据集、八种模型架构、十八种属性及三种防御机制下验证,结果表明CPPIA具有100%攻击准确率,不影响模型精度,计算开销极低,且无需影子模型,展现出广泛适用性和强大有效性。
原文摘要 · Abstract (English)
The flourishing code hosting platforms and coding agents enable even beginners with private data to build tailored Machine Learning (ML) models using available code quickly. The training data for ML models, often regarded as private property (e.g., clinical records, transaction information), is at significant risk of information leakage. Property Inference Attacks (PIAs), as a significant type of privacy attack, aim to expose global property information of the training set. In this paper, we present Code-Poisoning Property Inference Attack (CPPIA), the first code-level PIA, which overcomes four limitations of existing works: insufficient attack performance, severe degradation of model accuracy, high computational overhead, and failure under defenses. We consider malicious code providers from code hosting platforms (GitHub) and coding agents (Codex). Upon downloading the poisoned code, data holders train models with their private data without professional auditing, subsequently releasing label-only APIs to the public. The adversary embeds the properties into secret samples during training and queries the trained model on these samples later to leak privacy. CPPIA offers 100\% attack accuracy without degrading model accuracy. It is also computationally lightweight and requires no shadow models. We evaluate the attack performance across four datasets, eight model architectures, eighteen properties, and under three defense mechanisms, demonstrating the universality and effectiveness of CPPIA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。