统一生成推荐框架,让物品标识符可端到端优化。
UniGRec: Unified Generative Recommendation with Soft Identifiers for End-to-End Optimization
- 用可微软标识符统一训练分词与推荐模块。
- 在多个真实数据集上优于现有最先进方法。
- 适合做生成式推荐系统研究与开发的从业者。
生成式推荐作为新兴范式,直接生成目标物品,超越传统级联方法。其通常包含分词器(学习物品标识符)和推荐器(基于标识符训练)。现有方法常将分词与推荐解耦或依赖异步交替优化,限制了端到端对齐。为此,本文提出统一生成推荐框架UniGRec,通过可微软物品标识符将分词器与推荐器统一于最终推荐目标下,实现联合端到端训练。但该设计引入三大挑战:软-硬匹配导致的训练-推理不一致、码字使用不平衡引发的标识符坍缩,以及过度强调细粒度标记语义导致的协同信号不足。为解决这些问题,UniGRec从三方面入手:分词阶段采用退火推理对齐以平滑软训练与硬推理差异;引入码字均匀性正则化防止标识符坍缩并促进码本多样性;设计双协同蒸馏机制,从轻量级教师模型中蒸馏协同先验,联合指导分词器与推荐器。在多个真实世界数据集上的实验表明,UniGRec持续优于当前最先进基线方法。代码已开源。
原文摘要 · Abstract (English)
Generative recommendation has recently emerged as a transformative paradigm that directly generates target items, surpassing traditional cascaded approaches. It typically involves two components: a tokenizer that learns item identifiers and a recommender trained on them. Existing methods often decouple tokenization from recommendation or rely on asynchronous alternating optimization, limiting full end-to-end alignment. To address this, we unify the tokenizer and recommender under the ultimate recommendation objective via differentiable soft item identifiers, enabling joint end-to-end training. However, this introduces three challenges: training-inference discrepancy due to soft-to-hard mismatch, item identifier collapse from codeword usage imbalance, and collaborative signal deficiency due to an overemphasis on fine-grained token-level semantics. To tackle these challenges, we propose UniGRec, a unified generative recommendation framework that addresses them from three perspectives. UniGRec employs Annealed Inference Alignment during tokenization to smoothly bridge soft training and hard inference, a Codeword Uniformity Regularization to prevent identifier collapse and encourage codebook diversity, and a Dual Collaborative Distillation mechanism that distills collaborative priors from a lightweight teacher model to jointly guide both the tokenizer and the recommender. Extensive experiments on real-world datasets demonstrate that UniGRec consistently outperforms state-of-the-art baseline methods. Our codes are available at https://github.com/Jialei-03/UniGRec.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。