用语义对齐让大模型更好理解用户行为,提升推荐效果。
Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenization
- 将物品ID转为语义对齐的文本序列,打通推荐与大模型的桥梁。
- 在多个任务上显著提升召回率,且支持高效在线推理。
- 适合想融合大模型能力做推荐的工程师和研究者。
大型语言模型(LLMs)具备强大的推理能力,能从用户历史行为中挖掘深层兴趣,为推荐系统发展提供新路径。然而,推荐系统中通常存在稀疏的协同语义,而大模型使用密集的词元表示,两者存在显著差异。本文提出一种新框架,将传统推荐模型与大模型能力无缝融合。首先通过提出的对齐分词模块,将物品ID转化为与大模型语义空间对齐的序列;其次设计一系列专门的监督学习任务,使协同信号与自然语言语义保持一致。为保障实际应用效率,采用预缓存每位用户的前K项推荐结果,有效降低延迟并提升性能。大量实验证明,该模型显著提升了召回率,并展现出优异的可扩展性。
原文摘要 · Abstract (English)
Large language models (LLMs), endowed with exceptional reasoning capabilities, are adept at discerning profound user interests from historical behaviors, thereby presenting a promising avenue for the advancement of recommendation systems. However, a notable discrepancy persists between the sparse collaborative semantics typically found in recommendation systems and the dense token representations within LLMs. In our study, we propose a novel framework that harmoniously merges traditional recommendation models with the prowess of LLMs. We initiate this integration by transforming ItemIDs into sequences that align semantically with the LLMs space, through the proposed Alignment Tokenization module. Additionally, we design a series of specialized supervised learning tasks aimed at aligning collaborative signals with the subtleties of natural language semantics. To ensure practical applicability, we optimize online inference by pre-caching the top-K results for each user, reducing latency and improving effciency. Extensive experimental evidence indicates that our model markedly improves recall metrics and displays remarkable scalability of recommendation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。