发现语义ID在推荐中丢失细节,提出轻量级方法提升生成精度
Understanding Semantic IDs: From Item Representation to Item Selection in Generative Recommendation

- 通过分析语义ID构建过程,揭示其保留粗粒度组织但丢失细粒度结构
- 生成阶段末期仅29.9%目标项仍为合理推荐,表明现有机制严重失效
- 提出ISD方法,在不增加参数情况下提升推荐效果,最大增益31.2%
语义ID(SIDs)已成为生成式推荐的核心组件。当前系统对同一标记序列赋予三项功能:共享前缀用于组织相关商品,完整SID标识具体商品,生成过程中每个标记逐步缩小候选范围。我们系统研究了从商品编码、SID构建到自回归生成与最终推荐的全过程。在三个亚马逊领域和八种构建方式下,SID邻域平均仅恢复编码器最近邻的32.2%。尽管替代描述在99.57%控制案例中仍能召回对应商品,但改变了38.4%的精确SID。结果表明,SID保留宏观组织结构,却丢失编码器的精细局部特征,且其具体标记并非仅由商品语义决定。这种损失在生成阶段产生显著影响:在最终语义标记后,TIGER模型仅保留29.9%原本可推荐的目标项。基于此,我们提出用户特定商品排序支持的解码方法(ISD),在束搜索前利用用户偏好排序支持相应SID前缀,并以此排序生成商品。ISD无需额外参数或重训练,实验显示其在所有测试场景中均优于原版SID模型,相对提升达31.2%。结果表明,SID提供有效粗粒度组织,但生成时不应仅依赖其精细边界筛选商品。
原文摘要 · Abstract (English)
Semantic IDs (SIDs) are now a central component of generative recommendation. Current SID-based systems assign three roles to the same token sequence. Shared prefixes are intended to organize related items, the complete SID identifies an individual item, and each generated token narrows the items that can still be returned. We systematically investigate SIDs from item encoding and SID construction to autoregressive generation and final recommendation. We examine how SID construction changes item representations and how those changes affect generation. Across three Amazon domains and eight SID constructions, SID neighborhoods recover only 32.2% of the encoder's ten nearest neighbors on average. Alternative item descriptions still retrieve the corresponding item first in 99.57% of controlled cases, yet change 38.4% of exact SIDs. These results show that SIDs retain broad organization but lose much of the encoder's fine local structure, while their exact tokens are not determined by item meaning alone. This loss becomes consequential during generation. After the final semantic token, TIGER retains only 29.9% of held-out targets that were plausible recommendations before SID filtering. Motivated by these findings, we propose Item-Supported Decoding (ISD), a lightweight inference-time method that allows a user-specific item ranking to support corresponding SID prefixes before beam search discards them. The same ranking then orders the generated items. ISD requires no additional parameters or retraining of the SID constructor or decoder. We empirically show that ISD improves NDCG@10 over the corresponding SID backbone in every evaluated setting, with relative gains of up to 31.2%. Our results show that SIDs provide useful coarse item organization, but their fine boundaries should not alone determine which items remain available during generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。