用1%有毒数据就能操控大模型推荐,新攻击防御方法可检测漏洞
Exploring Backdoor Attack and Defense for LLM-empowered Recommendations
- 通过伪造用户行为污染数据,向推荐系统植入带触发词的后门
- 仅用1%恶意样本即可成功控制推荐结果,攻击隐蔽性强
- 利用大模型自动生成触发词,实现对中毒商品的通用检测
大型语言模型(LLMs)与推荐系统(RecSys)的融合显著提升了个性化推荐能力,但其安全性仍面临严峻挑战。本文首次提出:能否在物品标题中嵌入特定触发词,使大模型推荐系统在遇到该触发词时产生被操控的推荐结果?为探究这一风险,我们提出一种名为BadRec的新型后门攻击框架:通过在物品标题中注入触发词,并模拟虚假用户交互,有效污染训练数据并植入后门。大量实验表明,仅需1%的对抗性样本即可成功植入后门,实现对推荐结果的精准操控。为进一步应对该威胁,我们提出通用防御策略Poison Scanner(P-Scanner),利用大模型强大的语言理解能力构建毒物扫描器,并引入触发词增强代理生成多样化的合成触发词,帮助扫描器学习领域特定的中毒检测知识。在三个真实世界数据集上的实验验证了P-Scanner的有效性。
原文摘要 · Abstract (English)
The fusion of Large Language Models (LLMs) with recommender systems (RecSys) has dramatically advanced personalized recommendations and drawn extensive attention. Despite the impressive progress, the safety of LLM-based RecSys against backdoor attacks remains largely under-explored. In this paper, we raise a new problem: Can a backdoor with a specific trigger be injected into LLM-based Recsys, leading to the manipulation of the recommendation responses when the backdoor trigger is appended to an item's title? To investigate the vulnerabilities of LLM-based RecSys under backdoor attacks, we propose a new attack framework termed Backdoor Injection Poisoning for RecSys (BadRec). BadRec perturbs the items' titles with triggers and employs several fake users to interact with these items, effectively poisoning the training set and injecting backdoors into LLM-based RecSys. Comprehensive experiments reveal that poisoning just 1% of the training data with adversarial examples is sufficient to successfully implant backdoors, enabling manipulation of recommendations. To further mitigate such a security threat, we propose a universal defense strategy called Poison Scanner (P-Scanner). Specifically, we introduce an LLM-based poison scanner to detect the poisoned items by leveraging the powerful language understanding and rich knowledge of LLMs. A trigger augmentation agent is employed to generate diverse synthetic triggers to guide the poison scanner in learning domain-specific knowledge of the poisoned item detection task. Extensive experiments on three real-world datasets validate the effectiveness of the proposed P-Scanner.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。