RecGPT让推荐系统跨领域零样本推理,新物品无需重训即可推荐。
RecGPT: A Foundation Model for Sequential Recommendation
- 用文本特征生成物品表示,摆脱传统ID依赖。
- 跨6个数据集表现优于现有方法,支持零样本冷启动。
- 适合需要快速适配新领域或新商品的推荐场景。
本文解决推荐系统跨领域泛化能力差的核心瓶颈:传统基于ID的方法在冷启动和跨域场景中完全失效。受基础模型跨领域成功启发,我们提出RecGPT——一种面向序列推荐的基础模型,实现真正的零样本泛化。该方法摒弃传统ID编码,仅通过文本特征构建物品表示,可直接嵌入任意新物品而无需重新训练。引入统一的有限标量量化项化机制,将异构文本描述转化为标准化离散标记,消除领域壁垒。框架采用混合双向-因果注意力,同时捕捉项内标记连贯性与项间序列依赖。高效的目录感知束搜索解码器实现实时标记到物品映射。相较于局限于训练领域的传统方法,RecGPT通过领域无关的标记机制自然连接多样推荐场景。在六个数据集及工业场景中的全面评估显示其持续性能优势。
原文摘要 · Abstract (English)
This work addresses a fundamental barrier in recommender systems: the inability to generalize across domains without extensive retraining. Traditional ID-based approaches fail entirely in cold-start and cross-domain scenarios where new users or items lack sufficient interaction history. Inspired by foundation models' cross-domain success, we develop a foundation model for sequential recommendation that achieves genuine zero-shot generalization capabilities. Our approach fundamentally departs from existing ID-based methods by deriving item representations exclusively from textual features. This enables immediate embedding of any new item without model retraining. We introduce unified item tokenization with Finite Scalar Quantization that transforms heterogeneous textual descriptions into standardized discrete tokens. This eliminates domain barriers that plague existing systems. Additionally, the framework features hybrid bidirectional-causal attention that captures both intra-item token coherence and inter-item sequential dependencies. An efficient catalog-aware beam search decoder enables real-time token-to-item mapping. Unlike conventional approaches confined to their training domains, RecGPT naturally bridges diverse recommendation contexts through its domain-invariant tokenization mechanism. Comprehensive evaluations across six datasets and industrial scenarios demonstrate consistent performance advantages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。