arXiv:2409.11699cs.IRcs.CL2024-09被引 7

用语言模型融合协同过滤,提升推荐系统性能与可交互性。

FLARE: Fusing Language Models and Collaborative Architectures for Recommender Enhancement

  • 提出Flare模型,通过Perceiver网络融合语言模型与协同过滤
  • 在大规模数据集上表现超越基线,部分任务接近顶尖模型
  • 支持用户反馈改进建议,可用于评估模型语义理解能力

当前推荐系统常使用大语言模型表示物品文本描述,相比仅用物品ID的模型(如Bert4Rec)在标准基准上表现更优。本文重新评估了Bert4Rec基线,发现经进一步调优后其性能显著提升,在某些数据集上已具备与顶尖模型竞争的能力。基于修正后的基线,本文提出了融合物品ID与文本描述的新型混合序列推荐架构Flare(Fusing Language models and collaborative Architectures for Recommender Enhancement)。Flare通过Perceiver网络将语言模型与协同过滤模型融合。以往研究多在小规模语料数据集上评估,但实际应用中推荐系统需处理更大词汇量。本文在更具现实意义的大规模数据集上评估Flare,引入新基线。此外,论文展示了Flare具备支持用户评述(critiquing)的能力,可让用户反馈并优化推荐结果,并以此作为评估模型语言理解与迁移能力的新方法。

原文摘要 · Abstract (English)

Recent proposals in recommender systems represent items with their textual description, using a large language model. They show better results on standard benchmarks compared to an item ID-only model, such as Bert4Rec. In this work, we revisit the often-used Bert4Rec baseline and show that with further tuning, Bert4Rec significantly outperforms previously reported numbers, and in some datasets, is competitive with state-of-the-art models. With revised baselines for item ID-only models, this paper also establishes new competitive results for architectures that combine IDs and textual descriptions. We demonstrate this with Flare (Fusing Language models and collaborative Architectures for Recommender Enhancement). Flare is a novel hybrid sequence recommender that integrates a language model with a collaborative filtering model using a Perceiver network. Prior studies focus evaluation on datasets with limited-corpus size, but many commercially-applicable recommender systems common on the web must handle larger corpora. We evaluate Flare on a more realistic dataset with a significantly larger item vocabulary, introducing new baselines for this setting. This paper also showcases Flare's inherent ability to support critiquing, enabling users to provide feedback and refine recommendations. We leverage critiquing as an evaluation method to assess the model's language understanding and its transferability to the recommendation task.

推荐系统语言模型协同过滤交互式推荐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。