arXiv:2604.03949cs.IR2026-04中稿 · the Industry Track…被引 6

用语义标识符提升推荐系统精准度,降低数据稀疏性问题。

Semantic IDs for Recommender Systems at Snapchat: Use Cases, Technical Challenges, and Design Choices

  • 将物品编码为有序语义代码序列,替代传统原子ID。
  • 在多个生产模型中实现离线与在线指标双提升。
  • 适合大规模推荐场景中需高效建模的工程团队。

有效的物品标识符是推荐系统中的关键组件,广泛应用于检索与排序任务。传统原子ID难以捕捉用户行为中的协同信号,而语义标识符(Semantic IDs, SIDs)通过残差量化等方法从基础模型或协同信号中提取的语义表示生成有序代码序列,显著降低标识符基数,并在标识符空间中引入语义聚类。在Snapchat,SIDs被用作排序模型的辅助特征,并探索其作为多种机器学习应用的额外检索源。本文讨论了实际部署中遇到的技术挑战、开展的实验及迭代的设计选择。基于内部数据和学术基准的离线结果以及在线A/B测试均显示积极效果,不同变体的SIDs已在多个生产模型中上线并带来正向指标改善。

原文摘要 · Abstract (English)

Effective item identifiers (IDs) are an important component for recommender systems (RecSys) in practice, and are commonly adopted in many use cases such as retrieval and ranking. IDs can encode collaborative filtering signals within training data, such that RecSys models can extrapolate during the inference and personalize the prediction based on users' behavioral histories. Recently, Semantic IDs (SIDs) have become a trending paradigm for RecSys. In comparison to the conventional atomic ID, an SID is an ordered list of codes, derived from tokenizers such as residual quantization, applied to semantic representations commonly extracted from foundation models or collaborative signals. SIDs have drastically smaller cardinality than the atomic counterpart, and induce semantic clustering in the ID space. At Snapchat, we apply SIDs as auxiliary features for ranking models, and also explore SIDs as additional retrieval sources in different ML applications. In this paper, we discuss practical technical challenges we encountered while applying SIDs, experiments we have conducted, and design choices we have iterated to mitigate these challenges. Backed by promising offline results on both internal data and academic benchmarks as well as online A/B studies, SID variants have been launched in multiple production models with positive metrics impact.

推荐系统语义编码标识符设计工业实践

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。