用量化语言统一多模态推荐信息,提升生成式推荐效果
Multimodal Quantitative Language for Generative Recommendation
- 将文本图像等多模态内容转为统一量化语言,共享词汇表
- 在三个数据集上相比基线提升11.18%~14.82% NDCG
- 适合做多模态生成推荐的工程师与研究者参考
生成式推荐通过直接生成目标候选标识符展现潜力。现有方法多依赖预训练语言模型(PLM)中的通用语言知识,但难以适配推荐系统的特定需求,且忽略多模态信息间的互补性。为此,我们提出多模态量化语言生成推荐框架(MQL4GRec)。核心思想是将不同领域和模态的物品转化为统一的量化语言,作为知识迁移桥梁。具体地,先使用量化转换器将跨域文本与图像内容转化为简洁一致的量化语言;再设计一系列量化语言生成任务,注入语义信息与先验知识;最后通过预训练与微调实现跨领域、跨模态推荐知识的有效迁移。大量实验表明,MQL4GRec在三个数据集上分别取得11.18%、14.82%和7.95%的NDCG提升。
原文摘要 · Abstract (English)
Generative recommendation has emerged as a promising paradigm aiming at directly generating the identifiers of the target candidates. Most existing methods attempt to leverage prior knowledge embedded in Pre-trained Language Models (PLMs) to improve the recommendation performance. However, they often fail to accommodate the differences between the general linguistic knowledge of PLMs and the specific needs of recommendation systems. Moreover, they rarely consider the complementary knowledge between the multimodal information of items, which represents the multi-faceted preferences of users. To facilitate efficient recommendation knowledge transfer, we propose a novel approach called Multimodal Quantitative Language for Generative Recommendation (MQL4GRec). Our key idea is to transform items from different domains and modalities into a unified language, which can serve as a bridge for transferring recommendation knowledge. Specifically, we first introduce quantitative translators to convert the text and image content of items from various domains into a new and concise language, known as quantitative language, with all items sharing the same vocabulary. Then, we design a series of quantitative language generation tasks to enrich quantitative language with semantic information and prior knowledge. Finally, we achieve the transfer of recommendation knowledge from different domains and modalities to the recommendation task through pre-training and fine-tuning. We evaluate the effectiveness of MQL4GRec through extensive experiments and comparisons with existing methods, achieving improvements over the baseline by 11.18\%, 14.82\%, and 7.95\% on the NDCG metric across three different datasets, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。