通过分步语义引导推理,提升生成式推荐的精准度与可解释性。
S$^2$GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendation
- 引入分步思维标记,逐层生成语义线索,增强推荐逻辑连贯性。
- 在真实工业平台测试中,推荐效果显著优于现有方法。
- 适合关注推荐系统可解释性与生成质量的研究者与工程师。
生成式推荐(GR)因其端到端生成优势成为新范式。然而,现有方法主要聚焦于从交互序列直接生成语义标识(SID),未能激活类大语言模型的深层推理能力,限制性能潜力。我们发现当前增强推理的GR方法存在两大问题:(1) 推理与生成步骤严格分离,导致层级化SID代码计算资源分配失衡,降低代码质量;(2) 生成的推理向量缺乏可解释语义,推理路径亦无可靠监督。本文提出潜空间中的分步语义引导推理框架(S²GR)。首先,通过码本优化建立稳健语义基础,整合物品共现关系捕捉行为模式,并引入负载均衡与均匀性目标,最大化码本利用率并强化粗粒度到细粒度的语义层次。核心创新在于在每个SID生成步骤前插入思维标记,每个标记显式代表粗粒度语义,通过对比学习对齐真实码本聚类分布,确保推理路径物理合理且各层级代码计算均衡。大量实验验证了S²GR的优越性,线上A/B测试在大规模工业短视频平台确认其有效性。
原文摘要 · Abstract (English)
Generative Recommendation (GR) has emerged as a transformative paradigm with its end-to-end generation advantages. However, existing GR methods primarily focus on direct Semantic ID (SID) generation from interaction sequences, failing to activate deeper reasoning capabilities analogous to those in large language models and thus limiting performance potential. We identify two critical limitations in current reasoning-enhanced GR approaches: (1) Strict sequential separation between reasoning and generation steps creates imbalanced computational focus across hierarchical SID codes, degrading quality for SID codes; (2) Generated reasoning vectors lack interpretable semantics, while reasoning paths suffer from unverifiable supervision. In this paper, we propose stepwise semantic-guided reasoning in latent space (S$^2$GR), a novel reasoning enhanced GR framework. First, we establish a robust semantic foundation via codebook optimization, integrating item co-occurrence relationship to capture behavioral patterns, and load balancing and uniformity objectives that maximize codebook utilization while reinforcing coarse-to-fine semantic hierarchies. Our core innovation introduces the stepwise reasoning mechanism inserting thinking tokens before each SID generation step, where each token explicitly represents coarse-grained semantics supervised via contrastive learning against ground-truth codebook cluster distributions ensuring physically grounded reasoning paths and balanced computational focus across all SID codes. Extensive experiments demonstrate the superiority of S$^2$GR, and online A/B test confirms efficacy on large-scale industrial short video platform.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。