用大模型当攻击者,精准扰动推荐系统。
CheatAgent: Attacking LLM-Empowered Recommender Systems via LLM Agent
- 用大模型生成有策略的对抗扰动
- 在三个真实数据集上攻击成功率超80%
- 适合研究推荐系统安全的学者
近期,基于大语言模型(LLM)的推荐系统在个性化体验方面取得显著进展,但其安全漏洞仍缺乏深入研究。针对黑盒推荐系统的攻击更具实际意义,即攻击者仅能观察输入输出。传统强化学习攻击方法因处理复杂文本输入、规划与推理能力有限,难以有效攻击LLM赋能的推荐系统。而大模型具备类人决策能力,可作为攻击代理。本文提出新型攻击框架CheatAgent,利用大模型能力生成对抗性扰动:首先定位影响最大的插入位置,再生成扰动并插入;通过提示调优技术,根据目标推荐系统反馈迭代优化攻击策略。在三个真实数据集上的实验表明,该方法有效,攻击成功率超过80%。
原文摘要 · Abstract (English)
Recently, Large Language Model (LLM)-empowered recommender systems (RecSys) have brought significant advances in personalized user experience and have attracted considerable attention. Despite the impressive progress, the research question regarding the safety vulnerability of LLM-empowered RecSys still remains largely under-investigated. Given the security and privacy concerns, it is more practical to focus on attacking the black-box RecSys, where attackers can only observe the system's inputs and outputs. However, traditional attack approaches employing reinforcement learning (RL) agents are not effective for attacking LLM-empowered RecSys due to the limited capabilities in processing complex textual inputs, planning, and reasoning. On the other hand, LLMs provide unprecedented opportunities to serve as attack agents to attack RecSys because of their impressive capability in simulating human-like decision-making processes. Therefore, in this paper, we propose a novel attack framework called CheatAgent by harnessing the human-like capabilities of LLMs, where an LLM-based agent is developed to attack LLM-Empowered RecSys. Specifically, our method first identifies the insertion position for maximum impact with minimal input modification. After that, the LLM agent is designed to generate adversarial perturbations to insert at target positions. To further improve the quality of generated perturbations, we utilize the prompt tuning technique to improve attacking strategies via feedback from the victim RecSys iteratively. Extensive experiments across three real-world datasets demonstrate the effectiveness of our proposed attacking method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。