用对比学习统一多模态信息,实现生成推荐的轻量化物品编码
A Simple Contrastive Framework Of Item Tokenization For Generative Recommendation
- 基于对比学习设计可学习残差量化模块,融合多模态信号
- 在多个公开及工业数据集上提升生成推荐效果
- 适合需要高效低维表示的生成式推荐系统
生成式检索推荐作为新兴范式,直接生成目标候选标识符。但在大规模推荐系统中,因标记空间冗余和规模庞大而变得繁琐。现有方法使用语义标记替代ID标记,依赖重建型量化如RQ-VAE来压缩嵌入尺寸。然而,重建型量化强调独立精确还原每个物品嵌入,与生成式检索更关注区分不同物品的目标相悖。此外,物品的多模态信息(如文本、图像、地理位置)能显著提升推荐效果,但如何有效融入现有生成推荐框架仍具挑战。为此,本文提出一种纯对比学习的无监督深度量化框架SimCIT,通过可学习残差量化模块对齐多模态信号,在对比学习框架中联合实现多模态对齐与语义标记化。在多个公共数据集及跨领域的大型工业数据集上的实验表明,SimCIT在基于大语言模型的生成推荐中具有显著有效性。
原文摘要 · Abstract (English)
Generative retrieval-based recommendation has emerged as a promising paradigm aiming at directly generating the identifiers of the target candidates. However, in large-scale recommendation systems, this approach becomes increasingly cumbersome due to the redundancy and sheer scale of the token space. To overcome these limitations, recent research has explored the use of semantic tokens as an alternative to ID tokens, which typically leveraged reconstruction-based strategies, like RQ-VAE, to quantize content embeddings and significantly reduce the embedding size. However, reconstructive quantization aims for the precise reconstruction of each item embedding independently, which conflicts with the goal of generative retrieval tasks focusing more on differentiating among items. Moreover, multi-modal side information of items, such as descriptive text and images, geographical knowledge in location-based recommendation services, has been shown to be effective in improving recommendations by providing richer contexts for interactions. Nevertheless, effectively integrating such complementary knowledge into existing generative recommendation frameworks remains challenging. To overcome these challenges, we propose a novel unsupervised deep quantization exclusively based on contrastive learning, named SimCIT (a Simple Contrastive Item Tokenization framework). Specifically, different from existing reconstruction-based strategies, SimCIT propose to use a learnable residual quantization module to align with the signals from different modalities of the items, which combines multi-modal knowledge alignment and semantic tokenization in a mutually beneficial contrastive learning framework. Extensive experiments across public datasets and a large-scale industrial dataset from various domains demonstrate SimCIT's effectiveness in LLM-based generative recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。