arXiv:2602.02338cs.IRcs.AI2026-02被引 7

提出ReSID框架,让推荐系统更懂用户行为序列

Rethinking Generative Recommender Tokenizer: Recsys-Native Encoding and Semantic Quantization Beyond LLMs

  • 用领域感知的自编码器学习可预测的物品表征
  • 通过联合优化减少语义模糊与序列不确定性,提升生成效果
  • 不依赖大模型,推理成本降低122倍,适合工业级推荐

基于语义ID(SID)的推荐是扩展序列推荐系统的一种有前景范式,但现有方法多采用以语义为中心的流程:从基础模型中学习物品嵌入,并使用通用量化方案进行离散化。这一设计与生成式推荐目标不匹配:语义嵌入与协同预测弱耦合,通用量化在减少自回归建模的序列不确定性方面效率低下。为此,我们提出ReSID——一种推荐原生、原理驱动的SID框架,从信息保留与序列可预测性角度重新思考表示学习与量化,无需依赖大语言模型。ReSID包含两个组件:(i) 领域感知掩码自编码器(FAMAE),从结构化特征中学习具备预测充分性的物品表征;(ii) 全局对齐正交量化(GAOQ),通过联合降低语义歧义和前缀条件不确定性,生成紧凑且可预测的SID序列。理论分析与跨十大数据集的大量实验表明,ReSID在平均性能上优于强基线超过10%,同时将分词成本降低至最多122倍。代码已公开于https://github.com/FuCongResearchSquad/ReSID。

原文摘要 · Abstract (English)

Semantic ID (SID)-based recommendation is a promising paradigm for scaling sequential recommender systems, but existing methods largely follow a semantic-centric pipeline: item embeddings are learned from foundation models and discretized using generic quantization schemes. This design is misaligned with generative recommendation objectives: semantic embeddings are weakly coupled with collaborative prediction, and generic quantization is inefficient at reducing sequential uncertainty for autoregressive modeling. To address these, we propose ReSID, a recommendation-native, principled SID framework that rethinks representation learning and quantization from the perspective of information preservation and sequential predictability, without relying on LLMs. ReSID consists of two components: (i) Field-Aware Masked Auto-Encoding (FAMAE), which learns predictive-sufficient item representations from structured features, and (ii) Globally Aligned Orthogonal Quantization (GAOQ), which produces compact and predictable SID sequences by jointly reducing semantic ambiguity and prefix-conditional uncertainty. Theoretical analysis and extensive experiments across ten datasets show the effectiveness of ReSID. ReSID consistently outperforms strong sequential and SID-based generative baselines by an average of over 10%, while reducing tokenization cost by up to 122x. Code is available at https://github.com/FuCongResearchSquad/ReSID.

推荐系统生成式推荐序列建模量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。