arXiv:2604.03688cs.IRcs.AI2026-04

用大模型提升长尾商品推荐效果,解决语义与行为信息融合难题。

Fusion and Alignment Enhancement with Large Language Models for Tail-item Sequential Recommendation

  • 设计自适应门控机制,动态融合物品ID与大模型语义嵌入。
  • 提出双层级对齐方法,改善嵌入空间结构不一致问题。
  • 适合做长尾物品推荐、想融合语义知识的系统开发者。

序列推荐(SR)通过用户历史交互序列学习偏好并提供个性化建议。现实场景中多数物品交互稀疏,即长尾问题,限制了模型对物品转移模式的准确捕捉。大语言模型(LLMs)可利用物品间语义关系缓解此问题。然而现有方法仍存在:1)难以有效融合协同信号与语义知识,导致嵌入质量不佳;2)忽略ID嵌入空间与LLM嵌入空间的结构不一致,引发冲突信号,降低推荐精度。本文提出FAERec框架,通过生成一致融合且结构对齐的嵌入来提升物品表示。针对信息融合,设计自适应门控机制动态融合ID与LLM嵌入;针对结构不一致,提出双层级对齐:物品级对齐通过对比学习建立同物品两种嵌入的对应关系,特征级对齐约束两空间对应维度的相关性模式。同时采用课程学习调度器调整对齐权重,避免复杂特征级目标过早优化。在三个主流数据集上使用多个代表性SR骨干模型的大量实验验证了该框架的有效性与通用性。

原文摘要 · Abstract (English)

Sequential Recommendation (SR) learns user preferences from their historical interaction sequences and provides personalized suggestions. In real-world scenarios, most items exhibit sparse interactions, known as the tail-item problem. This issue limits the model's ability to accurately capture item transition patterns. To tackle this, large language models (LLMs) offer a promising solution by capturing semantic relationships between items. Despite previous efforts to leverage LLM-derived embeddings for enriching tail items, they still face the following limitations: 1) They struggle to effectively fuse collaborative signals with semantic knowledge, leading to suboptimal item embedding quality. 2) Existing methods overlook the structural inconsistency between the ID and LLM embedding spaces, causing conflicting signals that degrade recommendation accuracy. In this work, we propose a Fusion and Alignment Enhancement framework with LLMs for Tail-item Sequential Recommendation (FAERec), which improves item representations by generating coherently-fused and structurally consistent embeddings. For the information fusion challenge, we design an adaptive gating mechanism that dynamically fuses ID and LLM embeddings. Then, we propose a dual-level alignment approach to mitigate structural inconsistency. The item-level alignment establishes correspondences between ID and LLM embeddings of the same item through contrastive learning, while the feature-level alignment constrains the correlation patterns between corresponding dimensions across the two embedding spaces. Furthermore, the weights of the two alignments are adjusted by a curriculum learning scheduler to avoid premature optimization of the complex feature-level objective. Extensive experiments across three widely used datasets with multiple representative SR backbones demonstrate the effectiveness and generalizability of our framework.

序列推荐长尾问题大模型融合嵌入对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。