arXiv:2409.07276cs.IR2024-09KDD被引 8

用多维度语义色板替代传统物品编码,提升推荐模型泛化能力

Learning Multi-Aspect Item Palette: A Semantic Tokenization Framework for Generative Recommendation

  • 构建物品语义色板,通过多独立嵌入捕捉物品多方面特征
  • 在多个数据集上显著提升推荐准确率,尤其改善长尾与冷启动场景
  • 支持可复现研究,适用于需要内容理解的生成式推荐任务

传统推荐模型依赖唯一物品标识符(ID)区分物品,难以有效利用物品内容信息,且在长尾或冷启动物品上泛化能力差。近期提出的语义分词方法将物品语义表示转化为离散令牌序列,成为生成式推荐模型的基础。然而现有方法普遍依赖残差向量量化(RQ-VAE),存在嵌入提取困难、层级粗到细量化挑战及训练不稳等问题。为此,本文提出LAMIA,一种新型多方面语义分词方法。不同于RQ-VAE的单一嵌入,LAMIA学习一个“物品色板”——一组独立且语义对齐的嵌入,以捕捉物品的多重特征。同时,通过文本重建任务进行领域特定调优,增强语义编码器,获得更具代表性的物品色板嵌入。我们在多种推荐任务和数据集上进行了广泛实验,结果表明LAMIA在推荐精度上显著优于现有方法。为促进可复现研究,我们将公开源代码、数据与配置。

原文摘要 · Abstract (English)

Traditional recommendation models often rely on unique item identifiers (IDs) to distinguish between items, which can hinder their ability to effectively leverage item content information and generalize to long-tailed or cold-start items. Recently, semantic tokenization has been proposed as a promising solution that aims to tokenize each item's semantic representation into a sequence of discrete tokens. These semantic tokens have become fundamental in training generative recommendation models. However, existing methods typically rely on RQ-VAE, a residual vector quantizer, for semantic tokenization. This reliance introduces several key limitations, including challenges in embedding extraction, hierarchical coarse-to-fine quantization, and training stability. To address these issues, we introduce LAMIA, a novel approach for multi-aspect semantic tokenization. Unlike RQ-VAE, which uses a single embedding, LAMIA learns an ``item palette''--a collection of independent and semantically parallel embeddings that capture multiple aspects of items. Additionally, LAMIA enhances the semantic encoders through domain-specific tuning using text-based reconstruction tasks, resulting in more representative item palette embeddings. We have conducted extensive experiments to validate the effectiveness of the LAMIA framework across various recommendation tasks and datasets. Our results demonstrate significant improvements in recommendation accuracy over existing methods. To facilitate reproducible research, we will release the source code, data, and configurations.

生成式推荐语义分词多视角建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。