arXiv:2503.23804cs.CRcs.CL2025-03被引 10

首次揭示LLM推荐代理的记忆漏洞,可隐蔽操纵推荐结果。

DrunkAgent: Stealthy Memory Corruption in LLM-Powered Recommender Agents

  • 设计黑盒攻击框架DrunkAgent,通过伪造文本触发记忆污染。
  • 在多种推荐系统中实现高成功率的隐蔽攻击,效果可迁移。
  • 适合安全研究者和推荐系统开发者关注防御机制。

大型语言模型(LLM)驱动的智能体在推荐系统中日益普及,其记忆机制对个性化行为建模至关重要。然而,该机制作为上下文存储库,易受恶意操纵。现有工作受限于语义不匹配或静态嵌入,难以应对动态记忆状态。针对商业推荐系统的黑盒特性,本文首次系统研究基于记忆的漏洞,提出名为DrunkAgent的新型黑盒攻击框架。该框架生成语义合理的对抗性文本触发器,用于目标商品推广,并通过优化策略最大化触发效果,实现对记忆更新过程的污染。所有策略在替代模型上优化,确保攻击的可迁移性和隐蔽性。在多个真实数据集上的实验表明,DrunkAgent在协同过滤、检索增强与序列推荐等多样系统中均具备良好的泛化性、可迁移性与隐蔽性。

原文摘要 · Abstract (English)

Large language model (LLM)-powered agents are increasingly used in recommender systems (RSs) to achieve personalized behavior modeling, where the memory mechanism plays a pivotal role in enabling the agents to autonomously explore, learn and self-evolve from real-world interactions. However, this very mechanism, serving as a contextual repository, inherently exposes an attack surface for potential adversarial manipulations. Despite its central role, the robustness of agentic RSs in the face of such threats remains largely underexplored. Previous works suffer from semantic mismatches or rely on static embeddings or pre-defined prompts, all of which are not designed for dynamic systems, especially for dynamic memory states of LLM agents. This challenge is exacerbated by the black-box nature of commercial recommenders. To tackle the above problems, in this paper, we present the first systematic investigation of memory-based vulnerabilities in LLM-powered recommender agents, revealing their security limitations and guiding efforts to strengthen system resilience and trustworthiness. Specifically, we propose a novel black-box attack framework named DrunkAgent. DrunkAgent crafts semantically meaningful adversarial textual triggers for target item promotions and introduces a series of strategies to maximize the trigger effect by corrupting the memory updates during the interactions. The triggers and strategies are optimized on a surrogate model, enabling DrunkAgent transferable and stealthy. Extensive experiments on real-world datasets across diverse agentic RSs, including collaborative filtering, retrieval augmentation and sequential recommendations, demonstrate the generalizability, transferability and stealthiness of DrunkAgent.

安全攻击推荐系统记忆污染LLM智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。