为推荐系统设计可变长度语义标识,更高效地表示热门与长尾商品。
Variable-Length Semantic IDs for Recommender Systems
- 用概率框架学习自适应长度的语义标识,避免固定长度限制。
- 在真实数据集上,相比固定长度方法提升推荐准确率1.8%~3.2%。
- 适合处理高基数商品库的推荐场景,尤其对长尾物品更有效。
生成模型在推荐系统中日益重要,既用于建模用户行为序列,也用于整合大语言模型。然而,商品空间基数极高,导致生成模型训练困难,并造成自然语言与商品标识之间的词汇鸿沟。语义标识(semantic IDs)通过将商品表示为低基数词元序列,成为有效解决方案。但现有方法生成固定长度的标识,未能根据商品热度动态调整描述长度。本工作受涌现通信研究启发,提出可变长度语义标识,采用带有Gumbel-Softmax重参数化的离散变分自编码器,在合理概率框架下学习自适应长度的项目表示,避免REINFORCE训练的不稳定性及固定长度的局限性,显著提升推荐性能。实验表明,在真实数据集上相较固定长度方法,平均提升1.8%~3.2%的推荐准确率。
原文摘要 · Abstract (English)
Generative models are increasingly used in recommender systems, both for modeling user behavior as event sequences and for integrating large language models into recommendation pipelines. A key challenge in this setting is the extremely large cardinality of item spaces, which makes training generative models difficult and introduces a vocabulary gap between natural language and item identifiers. Semantic identifiers (semantic IDs), which represent items as sequences of low-cardinality tokens, have recently emerged as an effective solution to this problem. However, existing approaches generate semantic identifiers of fixed length, assigning the same description length to all items. This is inefficient, misaligned with natural language, and ignores the highly skewed frequency structure of real-world catalogs, where popular items and rare long-tail items exhibit fundamentally different information requirements. In parallel, the emergent communication literature studies how agents develop discrete communication protocols, often producing variable-length messages in which frequent concepts receive shorter descriptions. Despite the conceptual similarity, these ideas have not been systematically adopted in recommender systems. In this work, we bridge recommender systems and emergent communication by introducing variable-length semantic identifiers for recommendation. We propose a discrete variational autoencoder with Gumbel-Softmax reparameterization that learns item representations of adaptive length under a principled probabilistic framework, avoiding the instability of REINFORCE-based training and the fixed-length constraints of prior semantic ID methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。