用大模型生成语义嵌入,自动构建更优的推荐对比样本
Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendation
- 借助大模型理解用户偏好与物品特征,生成高质量语义嵌入
- 通过语义检索构建跨用户与同用户对比对,提升推荐效果
- 可无缝接入现有模型,适合需要改进对比学习的推荐系统
对比学习在序列推荐中表现优异,但现有方法在生成高质量对比对方面仍面临挑战:要么依赖随机扰动破坏用户偏好模式,要么依赖稀疏协同数据生成不可靠的对比对。此外,多数方法需预设选择规则,引入强假设,限制了模型自主学习最优对比对的能力。为此,我们提出一种新方法——语义检索增强的对比学习(SRA-CL)。SRA-CL利用大语言模型的语义理解与推理能力,生成能捕捉用户偏好与物品特性的表达嵌入。这些语义嵌入支持基于语义检索构建跨用户与同用户对比学习的候选池。为进一步提升对比样本质量,我们设计了一个可学习的样本合成器,在训练过程中优化对比样本生成过程。SRA-CL采用即插即用设计,可无缝集成至现有序列推荐架构。在四个公开数据集上的大量实验验证了该方法的有效性与模型无关性。
原文摘要 · Abstract (English)
Contrastive learning has shown effectiveness in improving sequential recommendation models. However, existing methods still face challenges in generating high-quality contrastive pairs: they either rely on random perturbations that corrupt user preference patterns or depend on sparse collaborative data that generates unreliable contrastive pairs. Furthermore, existing approaches typically require predefined selection rules that impose strong assumptions, limiting the model's ability to autonomously learn optimal contrastive pairs. To address these limitations, we propose a novel approach named Semantic Retrieval Augmented Contrastive Learning (SRA-CL). SRA-CL leverages the semantic understanding and reasoning capabilities of LLMs to generate expressive embeddings that capture both user preferences and item characteristics. These semantic embeddings enable the construction of candidate pools for inter-user and intra-user contrastive learning through semantic-based retrieval. To further enhance the quality of the contrastive samples, we introduce a learnable sample synthesizer that optimizes the contrastive sample generation process during model training. SRA-CL adopts a plug-and-play design, enabling seamless integration with existing sequential recommendation architectures. Extensive experiments on four public datasets demonstrate the effectiveness and model-agnostic nature of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。