arXiv:2607.16633cs.IR2026-07

优化推荐系统中文本生成的解码树结构,提升生成质量

Beyond Fixed Depths and Widths: Optimizing Textual Decoding Tries in LLM-based Generative Recommendation

  • 设计可变长度词元与受限分支的解码树结构
  • 在多个数据集上实现最高21.6%的推荐性能提升
  • 适合关注生成式推荐中解码效率与质量的研究者

生成式推荐(GR)正成为推荐系统主流范式,其常用方法以大语言模型(LLM)作为自回归骨干,预测下一个物品的词元ID(如标题或关键词)。自回归生成的成功依赖于对解码树的束搜索约束,以确保生成结果对应有效物品。然而,现有研究主要关注生成更全面的词元,而忽视这些词元构成的解码树结构设计。这可能导致解码树不适应束搜索,从而降低性能。为此,本文从解码树优化角度分析词元的有效性,通过实证与理论分析发现两个关键性质:(1)自适应可变词元长度,使语义丰富度不同的物品使用适当长度的词元表示;(2)浅层分支因子受控,显著提升约束束搜索成功率。基于此,提出BONSAI框架——一种联合设计词元与解码树结构的方法。BONSAI从物品元数据中提取推荐相关词汇,采用最小集合覆盖公式递归构建满足上述性质的解码树。实验表明,BONSAI相比当前最优基线提升最高达21.6%。进一步分析验证了所提性质的关键作用,并证明其可泛化应用于其他词元生成方法以提升性能。

原文摘要 · Abstract (English)

Generative recommendation (GR) is an increasingly popular paradigm in recommender systems, with a prominent line of work using LLMs as autoregressive backbones to predict the next item's term IDs (e.g., titles or keywords). The success of autoregressive generation hinges on constrained beam search over a decoding trie to ensure that generated outputs correspond to valid items. However, current research predominantly focuses on generating more comprehensive term IDs to describe items, while largely neglecting the structural design of the decoding trie formed by these terms. This can lead to a trie that is poorly suited to beam search, which degrades performance. To address this, we examine the effectiveness of term IDs from the perspective of decoding trie optimization. Through empirical and theoretical analyses, we identify two desirable properties for a highly performant trie: (1) adaptive and variable ID length, enabling items with varying semantic richness to be represented by IDs of appropriate lengths, and (2) constrained branching factors, especially at shallow levels, which drastically improves the success rate of constrained beam search. Motivated by these properties, we introduce BONSAI: Branching-Optimized Node Structure for Adaptive Identifiers, a novel framework that co-designs textual term IDs and their underlying decoding trie. BONSAI extracts recommendation-informative words from item metadata and employs a minimum set cover formulation to recursively build a trie that satisfies the above properties. Experiments reveal that BONSAI achieves up to a 21.6% relative improvement over state-of-the-art baselines. Further analyses confirm the crucial role of our proposed properties, and demonstrate their generalizability to be applied to enhance the performance of other term ID methods.

生成推荐解码树词元优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。