用动态语义索引让大模型更好推荐,效果提升超20%
Unleash LLMs Potential for Recommendation by Coordinating Twin-Tower Dynamic Semantic Token Generator
- 构建双塔动态语义生成器,为用户和物品生成可学习的语义索引
- 在三个数据集上平均提升19.41%命中率和20.84%NDCG
- 适合想用大模型做生成式推荐的研究者和开发者
由于预训练大语言模型在语义理解与逻辑推理方面的卓越能力,其在下一代推荐系统中展现出巨大潜力。然而,现有方法采用静态索引范式,严重限制了大模型在推荐中的能力发挥,导致语义知识与协同知识对齐不足,并忽视高阶用户-物品交互模式。本文提出首个采用动态语义索引范式的生成式推荐系统——双塔动态语义推荐器(TTDS),旨在同时解决上述问题。我们首次设计了一个动态知识融合框架,将双塔语义标记生成器融入基于大模型的推荐系统中,分层生成用户与物品的有意义语义索引,并预测目标物品的语义索引。此外,提出一种双模态变分自编码器,促进语义与协同知识在多粒度上的对齐。最后,设计了一系列专门用于捕捉高阶用户-物品交互模式的新颖调优任务,以充分利用用户历史行为。在三个公开数据集上的大量实验表明,所提方法在构建基于大模型的生成式推荐系统方面具有显著优势。相比领先基线方法,TTDS在命中率上平均提升19.41%,在NDCG指标上提升20.84%。
原文摘要 · Abstract (English)
Owing to the unprecedented capability in semantic understanding and logical reasoning, the pre-trained large language models (LLMs) have shown fantastic potential in developing the next-generation recommender systems (RSs). However, the static index paradigm adopted by current methods greatly restricts the utilization of LLMs capacity for recommendation, leading to not only the insufficient alignment between semantic and collaborative knowledge, but also the neglect of high-order user-item interaction patterns. In this paper, we propose Twin-Tower Dynamic Semantic Recommender (TTDS), the first generative RS which adopts dynamic semantic index paradigm, targeting at resolving the above problems simultaneously. To be more specific, we for the first time contrive a dynamic knowledge fusion framework which integrates a twin-tower semantic token generator into the LLM-based recommender, hierarchically allocating meaningful semantic index for items and users, and accordingly predicting the semantic index of target item. Furthermore, a dual-modality variational auto-encoder is proposed to facilitate multi-grained alignment between semantic and collaborative knowledge. Eventually, a series of novel tuning tasks specially customized for capturing high-order user-item interaction patterns are proposed to take advantages of user historical behavior. Extensive experiments across three public datasets demonstrate the superiority of the proposed methodology in developing LLM-based generative RSs. The proposed TTDS recommender achieves an average improvement of 19.41% in Hit-Rate and 20.84% in NDCG metric, compared with the leading baseline methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。