arXiv:2412.05543cs.IR2024-12被引 8

让大模型更懂用户个性,提升推荐精准度

ULMRec: User-centric Large Language Model for Sequential Recommendation

  • 用物品标题替代编号,让模型理解真实语义
  • 通过用户索引和对齐调优,捕捉个性化偏好
  • 在两个数据集上表现优于现有方法,适合个性化推荐场景

大语言模型在序列推荐任务中展现出良好性能,但现有方法多聚焦于物品共现模式,忽视用户个性化偏好。由于行为相似的用户可能有根本不同的兴趣,这导致推荐偏差。为此,本文提出ULMRec框架,将用户个性化偏好有效融入大语言模型。针对物品ID与语言模型间的语义鸿沟,用物品标题替换原始ID以捕获语义信息。设计两个核心组件:(1) 用户索引:基于用户评论和用户ID的向量量化生成独特用户表征;(2) 对齐调优:通过全面的偏好对齐任务增强模型捕捉个性化信息的能力。该设计实现了语言语义与用户偏好的深度融合,显著提升推荐效果。在两个公开数据集上的大量实验表明,ULMRec显著优于现有方法,验证了其有效性。

原文摘要 · Abstract (English)

Recent advances in Large Language Models (LLMs) have demonstrated promising performance in sequential recommendation tasks, leveraging their superior language understanding capabilities. However, existing LLM-based recommendation approaches predominantly focus on modeling item-level co-occurrence patterns while failing to adequately capture user-level personalized preferences. This is problematic since even users who display similar behavioral patterns (e.g., clicking or purchasing similar items) may have fundamentally different underlying interests. To alleviate this problem, in this paper, we propose ULMRec, a framework that effectively integrates user personalized preferences into LLMs for sequential recommendation. Considering there has the semantic gap between item IDs and LLMs, we replace item IDs with their corresponding titles in user historical behaviors, enabling the model to capture the item semantics. For integrating the user personalized preference, we design two key components: (1) user indexing: a personalized user indexing mechanism that leverages vector quantization on user reviews and user IDs to generate meaningful and unique user representations, and (2) alignment tuning: an alignment-based tuning stage that employs comprehensive preference alignment tasks to enhance the model's capability in capturing personalized information. Through this design, ULMRec achieves deep integration of language semantics with user personalized preferences, facilitating effective adaptation to recommendation. Extensive experiments on two public datasets demonstrate that ULMRec significantly outperforms existing methods, validating the effectiveness of our approach.

序列推荐大模型个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。