用记忆增强的LLM实现更精准的个性化推荐
Memory Assisted LLM for Personalized Recommendation System
- 为用户构建历史偏好记忆,按相似性提取相关记忆注入提示
- 在单域和跨域场景下均优于直接拼接历史的LLM推荐器
- 适合处理持续更新的用户需求,尤其在历史数据增多时优势明显
大语言模型(LLMs)在推荐任务中展现出巨大潜力。现有研究通过提示工程和微调实现个性化,但普遍存在成本高、难以捕捉多样偏好或无法及时更新用户历史的问题。为此,我们提出记忆增强型个性化LLM(MAP)。通过用户交互构建每位用户的偏好历史档案,包括历史物品评分等信息。推荐时,基于相似性提取相关记忆,并将其融入提示以提升个性化效果。实验设计新任务,在单域(记忆与任务同类别)和跨域(如电影记忆用于书籍推荐)两种场景下测试不同记忆规模。结果表明,MAP在两种场景下均显著优于直接将用户历史嵌入提示的基线方法;随着用户历史增长,其性能优势进一步扩大,更适用于连续个性化请求场景。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated significant potential in solving recommendation tasks. With proven capabilities in understanding user preferences, LLM personalization has emerged as a critical area for providing tailored responses to individuals. Current studies explore personalization through prompt design and fine-tuning, paving the way for further research in personalized LLMs. However, existing approaches are either costly and inefficient in capturing diverse user preferences or fail to account for timely updates to user history. To address these gaps, we propose the Memory-Assisted Personalized LLM (MAP). Through user interactions, we first create a history profile for each user, capturing their preferences, such as ratings for historical items. During recommendation, we extract relevant memory based on similarity, which is then incorporated into the prompts to enhance personalized recommendations. In our experiments, we define a new task that enables testing with varying memory size under two scenarios: single domain where memory and tasks are from the same category and cross-domain (e.g. memory from movies and recommendation tasks in books). The results show that MAP outperforms regular LLM-based recommenders that integrate user history directly through prompt design. Moreover, as user history grows, MAP's advantage increases in both scenarios, making it more suitable for addressing successive personalized user requests.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。