用语义量化提升多模态推荐效果,让物品ID有含义、更可解释。
Q-BERT4Rec: Quantized Semantic-ID Representation Learning for Multimodal Recommendation
- 将物品的文本图像特征融合后,用向量量化生成有意义的语义令牌
- 在亚马逊数据集上,相比现有方法点击率提升5.2%,收藏率提升4.8%
- 适合做电商/内容平台个性化推荐,尤其关注可解释性与跨模态理解
序列推荐在电商、广告和内容流媒体等现代在线平台中至关重要,准确预测用户下一次交互行为是实现个性化服务的关键。尽管基于Transformer的BERT4Rec等方法表现出强大建模能力,但仍依赖缺乏语义的离散物品ID,忽略丰富的多模态信息(如文本和图像),导致泛化能力弱、可解释性差。为此,我们提出Q-Bert4Rec,一个统一语义表示与量化建模的多模态序列推荐框架。该框架包含三个阶段:(1) 跨模态语义注入,通过动态Transformer融合文本、视觉和结构特征,丰富随机初始化的物品ID嵌入;(2) 语义量化,利用残差向量量化将融合表示离散化为有意义的语义令牌;(3) 多掩码预训练与微调,采用跨度、尾部和多区域等多种掩码策略提升序列理解能力。我们在公开的Amazon基准数据集上验证模型,结果表明Q-Bert4Rec显著优于多种现有强基线方法,证实了语义令牌化在多模态序列推荐中的有效性。代码将在发表后开源于GitHub。
原文摘要 · Abstract (English)
Sequential recommendation plays a critical role in modern online platforms such as e-commerce, advertising, and content streaming, where accurately predicting users' next interactions is essential for personalization. Recent Transformer-based methods like BERT4Rec have shown strong modeling capability, yet they still rely on discrete item IDs that lack semantic meaning and ignore rich multimodal information (e.g., text and image). This leads to weak generalization and limited interpretability. To address these challenges, we propose Q-Bert4Rec, a multimodal sequential recommendation framework that unifies semantic representation and quantized modeling. Specifically, Q-Bert4Rec consists of three stages: (1) cross-modal semantic injection, which enriches randomly initialized ID embeddings through a dynamic transformer that fuses textual, visual, and structural features; (2) semantic quantization, which discretizes fused representations into meaningful tokens via residual vector quantization; and (3) multi-mask pretraining and fine-tuning, which leverage diverse masking strategies -- span, tail, and multi-region -- to improve sequential understanding. We validate our model on public Amazon benchmarks and demonstrate that Q-Bert4Rec significantly outperforms many strong existing methods, confirming the effectiveness of semantic tokenization for multimodal sequential recommendation. Our source code will be publicly available on GitHub after publishing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。