arXiv:2504.02458cs.IRcs.AI2025-04被引 12

用外部协同信息净化被攻击的用户画像,提升大模型推荐系统鲁棒性。

Retrieval-Augmented Purifier for Robust LLM-Empowered Recommendation

  • 通过检索协同物品图中的外部知识定位用户历史序列中的恶意扰动。
  • 采用删除或替换策略清除扰动,使推荐结果在攻击下仍保持稳定。
  • 无需改造原有系统,可即插即用,适合高安全要求的推荐场景。

近期,基于大语言模型(LLM)的推荐系统革新了个性化推荐框架并引发广泛关注。然而,现有系统对微小扰动极为敏感。为缓解此问题,本文提出一种新框架RETURN,通过检索外部协同信号来净化受攻击者植入恶意协同知识的用户历史行为。利用检索增强生成(RAG)技术,从协同物品图中引入外部知识,定位用户序列中的潜在扰动,并通过删除或替换策略进行净化。随后采用鲁棒集成推荐策略生成最终预测。在三个真实数据集上的大量实验表明,该方法显著提升了系统在对抗攻击下的鲁棒性,且支持即插即用部署。

原文摘要 · Abstract (English)

Recently, Large Language Model (LLM)-empowered recommender systems have revolutionized personalized recommendation frameworks and attracted extensive attention. Despite the remarkable success, existing LLM-empowered RecSys have been demonstrated to be highly vulnerable to minor perturbations. To mitigate the negative impact of such vulnerabilities, one potential solution is to employ collaborative signals based on item-item co-occurrence to purify the malicious collaborative knowledge from the user's historical interactions inserted by attackers. On the other hand, due to the capabilities to expand insufficient internal knowledge of LLMs, Retrieval-Augmented Generation (RAG) techniques provide unprecedented opportunities to enhance the robustness of LLM-empowered recommender systems by introducing external collaborative knowledge. Therefore, in this paper, we propose a novel framework (RETURN) by retrieving external collaborative signals to purify the poisoned user profiles and enhance the robustness of LLM-empowered RecSys in a plug-and-play manner. Specifically, retrieval-augmented perturbation positioning is proposed to identify potential perturbations within the users' historical sequences by retrieving external knowledge from collaborative item graphs. After that, we further retrieve the collaborative knowledge to cleanse the perturbations by using either deletion or replacement strategies and introduce a robust ensemble recommendation strategy to generate final robust predictions. Extensive experiments on three real-world datasets demonstrate the effectiveness of the proposed RETURN.

推荐系统大模型鲁棒性RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。