让推荐系统像用户一样从大类到细节逐步理解偏好。
CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendation
- 分层分解商品信息,从类别到描述逐级生成
- 在多个数据集上超越现有方法,尤其在长序列推荐中提升明显
- 适合研究生成式推荐与用户意图建模的学者
在网页环境中,用户偏好通常随浏览过程从宽泛类别逐步细化到具体商品。然而,现有生成式推荐模型忽略了这一自然演进过程。生成式推荐将下一物品预测建模为对用户历史的自回归生成,其中每个物品被表示为离散标记序列。先前模型通常将ID、类别、标题、描述等异构属性融合成单一嵌入后再进行量化,这削弱了物品的固有语义层级,无法捕捉用户交互中意图的渐进演化。为此,我们提出CoFiRec,一种新型生成式推荐框架,将物品语义的粗粒度到细粒度特性显式融入分词过程。CoFiRec不将所有属性压缩至单一潜在空间,而是将物品信息分解为多个语义层次,包括高层类别、详细描述及协同过滤信号。基于此设计,我们引入CoFiRec分词器,独立分词各层次并保留结构顺序。在自回归解码时,语言模型被引导从粗到细生成物品标记,逐步建模用户从泛化兴趣到具体物品兴趣的演变。在多个公开基准和骨干模型上的实验表明,CoFiRec显著优于现有方法,为生成式推荐提供了新视角。理论上,我们证明结构化分词可降低生成结果与真实项之间的差异性,支持其有效性。代码已开源:https://github.com/YennNing/CoFiRec。
原文摘要 · Abstract (English)
In web environments, user preferences are often refined progressively as users move from browsing broad categories to exploring specific items. However, existing generative recommenders overlook this natural refinement process. Generative recommendation formulates next-item prediction as autoregressive generation over tokenized user histories, where each item is represented as a sequence of discrete tokens. Prior models typically fuse heterogeneous attributes such as ID, category, title, and description into a single embedding before quantization, which flattens the inherent semantic hierarchy of items and fails to capture the gradual evolution of user intent during web interactions. To address this limitation, we propose CoFiRec, a novel generative recommendation framework that explicitly incorporates the Coarse-to-Fine nature of item semantics into the tokenization process. Instead of compressing all attributes into a single latent space, CoFiRec decomposes item information into multiple semantic levels, ranging from high-level categories to detailed descriptions and collaborative filtering signals. Based on this design, we introduce the CoFiRec Tokenizer, which tokenizes each level independently while preserving structural order. During autoregressive decoding, the language model is instructed to generate item tokens from coarse to fine, progressively modeling user intent from general interests to specific item-level interests. Experiments across multiple public benchmarks and backbones demonstrate that CoFiRec outperforms existing methods, offering a new perspective for generative recommendation. Theoretically, we prove that structured tokenization leads to lower dissimilarity between generated and ground truth items, supporting its effectiveness in generative recommendation. Our code is available at https://github.com/YennNing/CoFiRec.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。