用大模型推理增强推荐系统,让推荐更懂用户真实兴趣
ReaSeq: Unleashing World Knowledge via Reasoning for Sequential Modeling
- 通过多智能体协作进行显式思维链推理,注入产品语义知识
- 利用扩散语言模型隐式推断用户跨域行为,提升数据稀疏场景表现
- 在淘宝大规模应用中显著提升点击率、订单量和成交额
工业级推荐系统在日志驱动范式下存在两大根本局限:(1) 基于ID的物品表征缺乏知识,导致数据稀疏时兴趣建模脆弱;(2) 对平台外用户兴趣系统性盲视,限制模型在平台边界内的表现。根源在于过度依赖浅层交互统计与闭环反馈,忽视了大语言模型从海量语料中学习到的产品语义及跨领域行为模式等世界知识。为此,我们提出ReaSeq,一种增强推理能力的框架,通过显式与隐式推理双重机制融合世界知识以解决上述问题。具体而言,ReaSeq采用多智能体协作的显式思维链推理,将结构化产品知识提炼为语义丰富的物品表征;同时借助扩散语言模型实现隐式推理,推断合理的平台外行为。在服务数亿用户的淘宝排序系统中部署后,ReaSeq取得显著效果:IPV与CTR提升超6.0%,订单量提升超2.9%,GMV提升超2.5%,验证了融合世界知识的推理优于纯日志驱动方法。
原文摘要 · Abstract (English)
Industrial recommender systems face two fundamental limitations under the log-driven paradigm: (1) knowledge poverty in ID-based item representations that causes brittle interest modeling under data sparsity, and (2) systemic blindness to beyond-log user interests that constrains model performance within platform boundaries. These limitations stem from an over-reliance on shallow interaction statistics and close-looped feedback while neglecting the rich world knowledge about product semantics and cross-domain behavioral patterns that Large Language Models have learned from vast corpora. To address these challenges, we introduce ReaSeq, a reasoning-enhanced framework that leverages world knowledge in Large Language Models to address both limitations through explicit and implicit reasoning. Specifically, ReaSeq employs explicit Chain-of-Thought reasoning via multi-agent collaboration to distill structured product knowledge into semantically enriched item representations, and latent reasoning via Diffusion Large Language Models to infer plausible beyond-log behaviors. Deployed on Taobao's ranking system serving hundreds of millions of users, ReaSeq achieves substantial gains: >6.0% in IPV and CTR, >2.9% in Orders, and >2.5% in GMV, validating the effectiveness of world-knowledge-enhanced reasoning over purely log-driven approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。