arXiv:2605.05096cs.IR2026-05被引 5

用软路由动态生成可变长度语义ID,提升生成式推荐效果与效率

CapsID: Soft-Routed Variable-Length Semantic IDs for Generative Recommendation

论文配图:CapsID: Soft-Routed Variable-Length Semantic IDs for Generative Recommendation
图 1 · 摘自论文原文
  • 引入胶囊路由替代硬量化,实现语义信息的软分配与渐进更新
  • 在多个数据集上召回率提升9.6%,推理延迟仅为传统方法的51%
  • 特别适合长尾商品推荐,能更好捕捉边界处的复杂语义

生成式推荐将每个物品映射为一系列语义ID(SID),并将检索任务转化为自回归标记生成。该范式的主要瓶颈在于分词器而非Transformer:每层采用硬最近邻分配的残差向量量化会破坏多维度物品语义,在聚类边界处造成信息损失,并将早期错误传播至后续SID位置。常见方案是为SID附加稠密向量或属性前缀,但这种双表示设计增加推理开销,牺牲了生成接口的简洁性。本文针对分词器本身提出改进:CAPSID用胶囊路由替代硬量化,物品在每层以概率方式路由至多个语义胶囊,残差通过路由重构更新,而非单一胜出代码;当活跃胶囊置信度足够高时,序列即终止。在此基础上,SEMANTICBPE通过结合共现频率与嵌入兼容性,将相邻的SID标记合并为可复用子词。在Amazon Beauty、Sports、Toys及一个包含3500万商品的工业级私有数据集上,CAPSID+SEMANTICBPE相较最强单表示基线ReSID平均提升召回率9.6%(Recall@10),并在所有公开基准上达到或超过COBRA风格稀疏-稠密系统的表现,同时推理延迟仅为后者的51%。消融实验表明,软路由、迭代共识和置信度驱动长度各自独立贡献,且在长尾物品上收益最大。

原文摘要 · Abstract (English)

Generative recommendation maps each item to a sequence of Semantic IDs (SIDs) and recasts retrieval as autoregressive token generation. In this paradigm the main bottleneck is the tokenizer rather than the Transformer: residual vector quantization with a hard nearest-neighbor assignment at every layer collapses multi-faceted item semantics at cluster boundaries and propagates early errors to later SID positions. A common workaround is to append a dense vector or attribute prefix to the SID, but this dual-representation design inflates inference cost and gives up the simplicity of a generative interface. We address the bottleneck at the tokenizer itself. CAPSID replaces hard residual quantization with capsule routing: at each layer an item probabilistically routes to several semantic capsules, the residual is updated by the routed reconstruction rather than by a single winning code, and the SID terminates once the active capsule's confidence is high enough. On top of CAPSID, SEMANTICBPE composes adjacent SID tokens into reusable subwords by combining their co-occurrence with their embedding compatibility. On Amazon Beauty, Sports, Toys, and a 35M-item proprietary industrial catalog, CAPSID+SEMANTICBPE improves Recall at 10 by 9.6% on average over ReSID, the strongest single-representation baseline, and matches or exceeds a COBRA-style sparse-dense system on every public benchmark while running at 51% of its inference latency. Ablations show that soft routing, iterative agreement, and confidence-driven length each contribute independently, and the gains are largest on tail items where boundary semantics dominate.

生成式推荐语义ID胶囊路由可变长度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。