arXiv:2502.14735cs.IRcs.AI2025-02被引 37

用外部行为与语义融合提升大模型推荐效果

EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integration

  • 双源知识索引整合用户行为与语义信息
  • 多尺度对齐重建任务提升协同与语义理解
  • 自适应调节器平衡推荐精度与理解能力

大语言模型(LLM)正被广泛用于构建先进推荐系统,凭借其丰富知识和推理能力带来显著提升。然而现有基于LLM的推荐系统面临预训练语言语义与推荐所需的协同语义之间存在显著差异的问题:模型虽具备语言理解能力,但需从头学习协同信号,导致协同学习效率低、结果相关性弱、传统推荐特征难以融合。为此,我们提出EAGER-LLM——一种基于解码器的生成式推荐框架,通过非侵入方式整合内生与外生行为及语义信息。具体包括:1)双源知识丰富的物品索引,融合外部信号的编码序列,支持高效全局处理;2)非侵入式多尺度对齐重建任务,引导模型深入理解协同与语义信号;3)退火适配器,精细调控推荐性能与理解能力之间的平衡。在三个公开基准数据集上的严格测试验证了EAGER-LLM的有效性。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly leveraged as foundational backbones in the development of advanced recommender systems, offering enhanced capabilities through their extensive knowledge and reasoning. Existing llm-based recommender systems (RSs) often face challenges due to the significant differences between the linguistic semantics of pre-trained LLMs and the collaborative semantics essential for RSs. These systems use pre-trained linguistic semantics but learn collaborative semantics from scratch via the llm-Backbone. However, LLMs are not designed for recommendations, leading to inefficient collaborative learning, weak result correlations, and poor integration of traditional RS features. To address these challenges, we propose EAGER-LLM, a decoder-only llm-based generative recommendation framework that integrates endogenous and exogenous behavioral and semantic information in a non-intrusive manner. Specifically, we propose 1)dual-source knowledge-rich item indices that integrates indexing sequences for exogenous signals, enabling efficient link-wide processing; 2)non-invasive multiscale alignment reconstruction tasks guide the model toward a deeper understanding of both collaborative and semantic signals; 3)an annealing adapter designed to finely balance the model's recommendation performance with its comprehension capabilities. We demonstrate EAGER-LLM's effectiveness through rigorous testing on three public benchmarks.

推荐系统大模型语义融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。