arXiv:2603.29705cs.IR2026-03被引 4

解决推荐系统中新物品带来的编码冲突与行为漂移问题。

Drift-Aware Continual Tokenization for Generative Recommendation

  • 引入漂移识别模块,区分变化与稳定的物品进行差异化优化
  • 通过分层编码重分配策略,减少对旧物品编码的干扰
  • 适合需要持续更新的在线推荐场景,兼顾新旧知识

生成式推荐通常采用两阶段流程:可学习的分词器将物品映射为离散标记序列,自回归生成推荐模型(GRM)基于这些标记进行预测。近期分词器引入协同信号,使行为模式相似的物品获得相似编码,显著提升推荐质量。然而现实环境持续演化:新物品引发标识符冲突和偏移,新交互导致已有物品的协同关系发生漂移(如共现模式与流行度变化)。完全重新训练分词器和GRM成本过高,而直接微调分词器会改变大多数现有物品的编码,破坏GRM已学习的标记-嵌入对齐。为此,我们提出DACT框架,包含两个阶段:(i) 分词器微调,结合联合训练的协同漂移识别模块(CDIM),输出物品级漂移置信度,实现对漂移与稳定物品的差异化优化;(ii) 采用松弛到严格的分层编码重分配策略,在更新标记序列的同时限制不必要的变更。在三个真实数据集上使用两种代表性GRM的实验表明,DACT始终优于基线方法,有效适应协同演化,同时最小化对先验知识的破坏。代码已开源,便于复现。

原文摘要 · Abstract (English)

Generative recommendation commonly adopts a two-stage pipeline in which a learnable tokenizer maps items to discrete token sequences (i.e. identifiers) and an autoregressive generative recommender model (GRM) performs prediction based on these identifiers. Recent tokenizers further incorporate collaborative signals so that items with similar user-behavior patterns receive similar codes, substantially improving recommendation quality. However, real-world environments evolve continuously: new items cause identifier collision and shifts, while new interactions induce collaborative drift in existing items (e.g., changing co-occurrence patterns and popularity). Fully retraining both tokenizer and GRM is often prohibitively expensive, yet naively fine-tuning the tokenizer can alter token sequences for the majority of existing items, undermining the GRM's learned token-embedding alignment. To balance plasticity and stability for collaborative tokenizers, we propose DACT, a Drift-Aware Continual Tokenization framework with two stages: (i) tokenizer fine-tuning, augmented with a jointly trained Collaborative Drift Identification Module (CDIM) that outputs item-level drift confidence and enables differentiated optimization for drifting and stationary items; and (ii) hierarchical code reassignment using a relaxed-to-strict strategy to update token sequences while limiting unnecessary changes. Experiments on three real-world datasets with two representative GRMs show that DACT consistently achieves better performance than baselines, demonstrating effective adaptation to collaborative evolution with reduced disruption to prior knowledge. Our implementation is publicly available at https://github.com/HomesAmaranta/DACT for reproducibility.

推荐系统持续学习生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。