解决推荐生成中物品分词导致关系扭曲的问题
Topology-Aware Tokenization for Generative Recommendation

- 设计多层级蒸馏机制,逐步恢复物品间语义关系
- 在三个数据集上提升召回率最高达9.42%
- 适合做生成式推荐系统优化的研究者参考
生成式推荐将序列推荐重构为自回归生成任务,但该范式中一个关键问题被忽视:物品分词过程中的拓扑失真。我们发现,预训练语义嵌入空间中物品的固有邻接关系在量化后显著破坏,导致模型对物品相似性的误判,最终限制生成推荐的准确率。为此,提出拓扑感知分词(TopoTok)框架,通过多层级蒸馏方案,在量化层次中持续保留物品间关系结构:1)组间蒸馏捕捉全局聚类关系;2)组内蒸馏细化语义簇内的局部结构;3)个体间蒸馏实现细粒度对齐。在三个基准数据集上的大量实验表明,TopoTok有效缓解拓扑失真,显著优于现有最优分词器,Recall@5 最高提升达9.42%。
原文摘要 · Abstract (English)
Generative recommendation reformulates sequential recommendation as an autoregressive generation task, yet a critical issue in this paradigm remains overlooked: topology distortion in item tokenization. In particular, we observe that the intrinsic adjacency relationships of items in the pretrained semantic embedding space are significantly disrupted after quantization. This topology distortion misleads the model's perception of item similarity, ultimately bottlenecking the accuracy of generative recommendations. To address this issue, we propose Topology-Aware Tokenization (TopoTok), an item tokenization framework that preserves item relational structure throughout the quantization hierarchy. Different from the prior monolithic supervision in tokenization, TopoTok introduces a multi-level distillation scheme to progressively recover the topology from coarse to fine granularity: 1) Inter-Group Distillation to capture global cluster-wise relations; 2) Intra-Group Distillation to refine local structures within semantic clusters; and 3) Inter-Item Distillation to enforce fine-grained alignment at the individual item level. Extensive experiments on three benchmark datasets demonstrate that TopoTok effectively alleviates topology distortion and consistently outperforms state-of-the-art tokenizers, achieving significant performance gains of up to 9.42% in Recall@5.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。