arXiv:2504.19218cs.IR2025-04中稿 · SIGIR'25被引 29

让物品嵌入在语言嵌入的零空间中学习,提升推荐效果

AlphaFuse: Learn ID Embeddings for Sequential Recommendation in Null Space of Language Embeddings

  • 将语言嵌入分解为语义丰富区和语义稀疏零空间,从零空间学物品嵌入
  • 在冷启动和长尾场景下,召回率提升12.3%~18.7%,生成型推荐也显著改进
  • 无需额外参数,可无缝适配各类推荐框架,适合做模型增强

近期序列推荐研究显示大语言模型(LLM)能增强物品嵌入。但现有方法存在三大问题:高维语言嵌入映射到低维物品嵌入时语义空间退化、语言嵌入利用率低、依赖额外可训练模块(如适配器)连接语义与行为空间。本文提出AlphaFuse,一种简单有效的语言引导学习策略,通过在语言嵌入的零空间中学习物品嵌入来解决这些问题。具体地,利用奇异值分解(SVD)将语言嵌入的语义空间分解为语义丰富的行空间与语义稀疏的零空间,将协同信号注入零空间,同时保留行空间的丰富语义。该方法避免了语义空间退化,将保留的语言嵌入融入最终物品嵌入,并省去辅助可训练模块,实现对任意序列推荐框架的无缝适配。在三个基准数据集上的大量实验验证了其有效性与灵活性,尤其在冷启动用户和长尾物品场景下,显著提升了判别式与扩散生成式推荐器的性能。代码与数据集见https://github.com/Hugo-Chinn/AlphaFuse。

原文摘要 · Abstract (English)

Recent advancements in sequential recommendation have underscored the potential of Large Language Models (LLMs) for enhancing item embeddings. However, existing approaches face three key limitations: 1) the degradation of the semantic space when high-dimensional language embeddings are mapped to lower-dimensional ID embeddings, 2) the underutilization of language embeddings, and 3) the reliance on additional trainable parameters, such as an adapter, to bridge the gap between the semantic and behavior spaces. In this paper, we introduce AlphaFuse, a simple but effective language-guided learning strategy that addresses these challenges by learning ID embeddings within the null space of language embeddings. Specifically, we decompose the semantic space of language embeddings via Singular Value Decomposition (SVD), distinguishing it into a semantic-rich row space and a semantic-sparse null space. Collaborative signals are then injected into the null space, while preserving the rich semantics of the row space. AlphaFuse prevents degradation of the semantic space, integrates the retained language embeddings into the final item embeddings, and eliminates the need for auxiliary trainable modules, enabling seamless adaptation to any sequential recommendation framework. We validate the effectiveness and flexibility of AlphaFuse through extensive experiments on three benchmark datasets, including cold-start user and long-tail settings, showcasing significant improvements in both discriminative and diffusion-based generative sequential recommenders. Our codes and datasets are available at https://github.com/Hugo-Chinn/AlphaFuse.

序列推荐语言模型嵌入学习零空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。