arXiv:2605.06331cs.IR2026-05被引 4

自回归推荐生成存在表达瓶颈,新方法通过引入隐变量提升推荐多样性。

Expressiveness Limits of Autoregressive Semantic ID Generation in Generative Recommendation

论文配图:Expressiveness Limits of Autoregressive Semantic ID Generation in Generative Recommendation
图 1 · 摘自论文原文
  • 在语义ID序列中注入隐变量,将单棵树解码结构变为多棵条件树
  • 理论证明原方法难以建模简单协同过滤模式,改进后NDCG@10提升3.45%
  • 适合关注生成式推荐模型设计与表达能力的读者

生成式推荐(GR)模型通过自回归生成离散标记序列来索引目标项目,但该过程形成结构化解码空间,其对模型表达能力的影响尚未充分探索。我们发现,项目概率与由语义ID标记诱导的解码树结构强相关:树中距离相近的项目对任意用户都获得相似概率,难以依据用户偏好区分。理论上,这种结构相关性阻碍了GR模型表示简单协同过滤模式的能力。为此,我们提出Latte,通过在每个语义ID前注入一个潜在标记,将解码空间从单一树重构为多个以潜在标记为条件的子树。该设计增加了项目间的路径多样性,缓解了树结构带来的概率耦合,使NDCG@10平均相对提升3.45%。代码已公开于https://github.com/hyp1231/Latte。

原文摘要 · Abstract (English)

Generative recommendation (GR) models generate items by autoregressively producing a sequence of discrete tokens that jointly index the target item. However, this autoregressive generation process also induces a structured decoding space whose impact on model expressiveness remains underexplored. Specifically, token-by-token generation can be viewed as traversing a decoding tree induced by semantic ID tokens, where leaf nodes correspond to candidate items. We observe that the item probabilities produced by GR models are strongly correlated with this tree structure: items that are close in the tree tend to receive similar probabilities for any given user, making it difficult to distinguish among them based on user-specific preferences. We further show theoretically that such structural correlations prevent GR models from representing even simple patterns that can be well captured by conventional collaborative filtering models. To mitigate this issue, we propose Latte, a simple modification that injects a latent token before each semantic ID, reshaping the decoding space from a single tree into multiple latent-token-conditioned trees. This design creates multiple paths with varying tree distances between items, relaxing tree-induced probability coupling and yielding an average of 3.45% relative improvement on NDCG@10. Our code is available at https://github.com/hyp1231/Latte.

生成推荐自回归表达能力扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。