arXiv:2510.21242cs.IR2025-10中稿 · SIGIR'26被引 12

让推荐生成的分词与推荐模型协同优化,提升推荐准确性。

Bi-Level Optimization for Generative Recommendation: Bridging Tokenization and Generation

  • 用双层优化统一训练分词器和推荐模型,解决两者脱节问题。
  • 在多个真实数据集上表现优于现有方法,且计算开销几乎不变。
  • 适合关注生成式推荐系统设计与优化的研究者和工程师。

生成式推荐通过直接生成推荐项而非匹配来革新推荐范式。构建此类系统通常包含两个关键组件:(1) 优化分词器以获得合适的物品标识符;(2) 基于这些标识符训练推荐模型。现有方法常将二者分开处理——或顺序、或交替进行——忽视了它们之间的相互依赖性。这种分离可能导致分词器未受推荐目标直接指导,生成次优标识符,进而降低推荐性能。为此,我们提出BLOGER(Bi-Level Optimization for GEnerative Recommendation),通过统一优化过程显式建模分词器与推荐器间的依赖关系。下层利用分词序列训练推荐器,上层基于分词损失和推荐损失联合优化分词器。采用元学习高效求解双层优化,并引入梯度手术缓解上层更新中的梯度冲突,确保物品标识符既具信息量又与推荐目标对齐。在多个真实世界数据集上的大量实验表明,BLOGER持续优于当前最优生成式推荐方法,且保持实际效率,无显著额外计算开销,有效弥合了物品分词与自回归生成之间的鸿沟。代码已开源:https://github.com/Ten-Mao/BLOGER。

原文摘要 · Abstract (English)

Generative recommendation is emerging as a transformative paradigm by directly generating recommended items, rather than relying on matching. Building such a system typically involves two key components: (1) optimizing the tokenizer to derive suitable item identifiers, and (2) training the recommender based on those identifiers. Existing approaches often treat these components separately--either sequentially or in alternation--overlooking their interdependence. This separation can lead to misalignment: the tokenizer is trained without direct guidance from the recommendation objective, potentially yielding suboptimal identifiers that degrade recommendation performance. To address this, we propose BLOGER, a Bi-Level Optimization for GEnerative Recommendation framework, which explicitly models the interdependence between the tokenizer and the recommender in a unified optimization process. The lower level trains the recommender using tokenized sequences, while the upper level optimizes the tokenizer based on both the tokenization loss and recommendation loss. We adopt a meta-learning approach to solve this bi-level optimization efficiently, and introduce gradient surgery to mitigate gradient conflicts in the upper-level updates, thereby ensuring that item identifiers are both informative and recommendation-aligned. Extensive experiments on multiple real-world datasets demonstrate that BLOGER consistently outperforms state-of-the-art generative recommendation methods while maintaining practical efficiency with no significant additional computational overhead, effectively bridging the gap between item tokenization and autoregressive generation. We release our code at https://github.com/Ten-Mao/BLOGER.

生成式推荐双层优化分词器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。