arXiv:2601.19711cs.IR2026-01中稿 · SIGIR2026被引 24

让推荐系统的语义编码可微,提升推荐精度。

Differentiable Semantic ID for Generative Recommendation

  • 用高斯噪声鼓励早期代码探索,防止编码器坍塌。
  • 通过渐进式降低噪声,平衡探索与收敛。
  • 在多个数据集上显著提升推荐效果,适合做生成式推荐研究者。

生成式推荐将每个物品表示为从丰富内容中学习的离散语义ID(SID)。现有方法通常将SID视为预定义索引,独立训练推荐模型,导致索引优化目标(内容重建)与推荐目标不一致。由于分词器独立训练,推荐损失无法反向更新索引。为此,本文提出DIGER,首次实现生成式推荐中可微的语义ID。通过引入Gumbel噪声,促进早期代码空间探索,缓解编码器坍塌问题。进一步设计两种不确定性衰减策略,逐步减少噪声,实现从探索到利用的平稳过渡。在多个公开数据集上的实验表明,可微语义ID带来持续性能提升,验证了对齐索引与推荐目标的有效性,凸显可微语义索引的潜力。代码已开源。

原文摘要 · Abstract (English)

Generative recommendation provides a novel paradigm in which each item is represented by a discrete semantic ID (SID) learned from rich content. Most existing methods treat SIDs as predefined and train recommenders under static indexing. In practice, SIDs are typically optimized only for content reconstruction rather than recommendation accuracy. This leads to an objective mismatch: the system optimizes an indexing loss to learn the SID and a recommendation loss for interaction prediction, but because the tokenizer is trained independently, the recommendation loss cannot update it. A natural approach is to make semantic indexing differentiable so that recommendation gradients can directly influence SID learning, but this often causes codebook collapse, where only a few codes are used. We attribute this issue to early deterministic assignments that limit codebook exploration, resulting in imbalance and unstable optimization. In this paper, we propose DIGER (Differentiable Semantic ID for Generative Recommendation), a first step toward effective differentiable semantic IDs for generative recommendation. DIGER introduces Gumbel noise to explicitly encourage early-stage exploration over codes, mitigating codebook collapse and improving code utilization. To balance exploration and convergence, we further design two uncertainty decay strategies that gradually reduce the Gumbel noise, enabling a smooth transition from early exploration to exploitation of learned SIDs. Extensive experiments on multiple public datasets demonstrate consistent improvements from differentiable semantic IDs. These results confirm the effectiveness of aligning indexing and recommendation objectives through differentiable SIDs and highlight differentiable semantic indexing as a promising research direction. Our code is released under https://github.com/junchen-fu/DIGER.

生成式推荐可微编码语义索引

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。