arXiv:2504.05731cs.IRcs.CL2025-04中稿 · SIGIR 2025被引 35

用用户相似性增强个性化文本生成,提升内容匹配度。

Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generation

  • 通过对比学习构建用户嵌入,挖掘潜在相似用户信息
  • 设计个性化检索器与重排序模块,精准获取偏好相关文档
  • 适合需要个性化生成的场景,如智能客服、内容创作

近期,将大语言模型(LLM)个性化以生成符合个体用户偏好的内容受到广泛关注。个性化检索增强生成(RAG)通过从用户历史中检索相关文档来反映其偏好,从而增强生成效果。然而,现有方法未考虑相似用户的经历也可辅助当前用户的个性化生成,即用户间的协作信息可提升生成质量。受推荐系统中协同过滤的启发,本文提出CFRAG方法,将协同过滤引入RAG实现个性化文本生成。面临两大挑战:(1) 如何在无显式用户相似标签情况下融入协作信息?(2) 如何检索支持个性化生成的文档?针对挑战(1),采用对比学习训练用户嵌入以检索相似用户并引入协作信息;针对挑战(2),设计个性化检索器与重排序模块,从这些用户的记录中检索前k个文档,并在检索与重排序中考虑用户偏好。随后利用LLM反馈微调检索器与重排序模块,使其能检索满足个性化生成需求的文档。在LaMP基准上的实验验证了CFRAG的有效性,进一步分析表明引入协作信息至关重要。

原文摘要 · Abstract (English)

Recently, the personalization of Large Language Models (LLMs) to generate content that aligns with individual user preferences has garnered widespread attention. Personalized Retrieval-Augmented Generation (RAG), which retrieves relevant documents from the user's history to reflect their preferences and enhance LLM generation, is one commonly used approach for personalization. However, existing personalized RAG methods do not consider that the histories of similar users can also assist in personalized generation for the current user, meaning that collaborative information between users can also benefit personalized generation. Inspired by the application of collaborative filtering in recommender systems, we propose a method called CFRAG, which adapts Collaborative Filtering to RAG for personalized text generation. However, this presents two challenges: (1)~how to incorporate collaborative information without explicit user similarity labels? (2)~how to retrieve documents that support personalized LLM generation? For Challenge 1, we use contrastive learning to train user embeddings to retrieve similar users and introduce collaborative information. For Challenge 2, we design a personalized retriever and reranker to retrieve the top-$k$ documents from these users' histories. We take into account the user's preference during retrieval and reranking. Then we leverage feedback from the LLM to fine-tune the personalized retriever and reranker, enabling them to retrieve documents that meet the personalized generation needs of the LLM. Experimental results on the Language Model Personalization (LaMP) benchmark validate the effectiveness of CFRAG. Further analysis confirms the importance of incorporating collaborative information.

个性化生成协同过滤检索增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。