arXiv:2601.17787cs.IR2026-01

让推荐模型更懂哪些词对选品关键,提升生成准确性

Beyond Uniform Token Training: A Multi-Target Framework for Learning Token-Weighted Objectives in Generative Recommenders

  • 按前缀重要性加权,突出影响品类判断的关键词
  • 对低频词重点训练,缓解热门商品垄断问题
  • 分阶段动态调整权重,适配不同训练阶段

近期生成式推荐模型将下一个物品预测转化为语义标识符序列的生成。尽管该范式使自回归模型可直接生成物品ID,但常用的逐标记似然目标无法区分在物品识别中起不同作用的标记。这一局限在语义ID表示中尤为明显,其中前缀标记通常决定粗粒度物品类别,而后续标记提供细粒度区分。为更好对齐训练信号与语义ID结构,我们从两个互补视角研究标记级学习信号:首先提出前缀感知加权方案“前部优先加权”(Front-Greater Weighting),依据标记减少候选物品间语义模糊性的贡献程度进行加权;其次引入频率加权,增强对低频标记的学习关注,以应对推荐数据中常见的长尾分布和流行度偏差。进一步提出多目标优化框架结合课程学习,融合两种加权目标与标准似然目标,实现训练阶段自适应的稳定优化。多个基准数据集实验表明,该方法持续优于强基线及以往加权方法。额外分析显示,该方法在不同语义ID构造和主干模型规模下均表现稳健,并提升热门与长尾物品的推荐质量。代码已开源。

原文摘要 · Abstract (English)

Recent generative recommendation models recast next-item prediction as the generation of a semantic identifier sequence. While this formulation enables autoregressive models to produce item IDs directly, the commonly used token-level likelihood objective does not distinguish between tokens that play different roles in item identification. This limitation is especially pronounced for semantic-ID representations, where prefix tokens often determine coarse item groups and later tokens provide finer-grained disambiguation. To better align training with the structure of semantic IDs, we study token-level learning signals from two complementary perspectives. First, we introduce a prefix-aware weighting scheme, Front-Greater Weighting, which emphasizes tokens according to their contribution to reducing semantic ambiguity among candidate items. Second, frequency weighting increases the learning emphasis on infrequent tokens, addressing the long-tailed distributions and popularity bias commonly observed in recommendation data. We further introduce a multi-target optimization framework with curriculum learning, which integrates the two token-weighted objectives with the standard likelihood and enables stable optimization with adaptive emphasis across training stages. Experiments on multiple benchmark datasets demonstrate that the proposed approach consistently improves generative recommendation performance over strong baselines and prior token-weighting methods. Additional analyses show that the method is robust across different semantic-ID constructions and backbone scales, and that it improves recommendation quality for both popular and long-tail items. Code is available at github repository.

生成推荐语义标识加权训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。