用大模型生成更精准的物品嵌入,解决推荐系统冷门商品推荐难题。
LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendation
- 用监督对比微调让大模型理解推荐场景,生成更具语义的嵌入。
- 在三个真实数据集上,显著提升多个推荐模型对冷门商品的预测效果。
- 方法可通用接入现有推荐系统,适合做冷启动和长尾推荐的研究者。
序列推荐系统(SRS)通过建模用户交互历史来预测下一个感兴趣物品,广泛应用于各类场景。然而,现有SRS普遍面临低流行度物品推荐困难的长尾问题,导致用户发现新奇内容的机会减少,商家收益受损。大语言模型(LLM)具备捕捉物品间语义关系的能力,且不受流行度影响,是解决该问题的潜在方案。本文提出LLMEmb,一种利用LLM生成物品嵌入以增强SRS性能的新方法。为弥合通用大模型与推荐领域之间的差距,我们设计了属性级数据增强与定制对比损失的监督对比微调(SCFT)策略。同时,提出推荐适配训练(RAT),融合协同信号进一步优化嵌入。由LLMEmb生成的嵌入可无缝集成至任意SRS模型中。在三个真实数据集上的实验表明,其在多个SRS模型上均显著优于现有方法。代码已公开于https://github.com/Applied-Machine-Learning-Lab/LLMEmb。
原文摘要 · Abstract (English)
Sequential Recommender Systems (SRS), which model a user's interaction history to predict the next item of interest, are widely used in various applications. However, existing SRS often struggle with low-popularity items, a challenge known as the long-tail problem. This issue leads to reduced serendipity for users and diminished profits for sellers, ultimately harming the overall system. Large Language Model (LLM) has the ability to capture semantic relationships between items, independent of their popularity, making it a promising solution to this problem. In this paper, we introduce LLMEmb, a novel method leveraging LLM to generate item embeddings that enhance SRS performance. To bridge the gap between general-purpose LLM and the recommendation domain, we propose a Supervised Contrastive Fine-Tuning (SCFT) approach. This approach includes attribute-level data augmentation and a tailored contrastive loss to make LLM more recommendation-friendly. Additionally, we emphasize the importance of integrating collaborative signals into LLM-generated embeddings, for which we propose Recommendation Adaptation Training (RAT). This further refines the embeddings for optimal use in SRS. The LLMEmb-derived embeddings can be seamlessly integrated with any SRS models, underscoring the practical value. Comprehensive experiments conducted on three real-world datasets demonstrate that LLMEmb significantly outperforms existing methods across multiple SRS models. The code for our method is released online https://github.com/Applied-Machine-Learning-Lab/LLMEmb.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。