用统一网络融合多种信息,冷启动推荐更准。
A Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarios
- 共享单分支结构同时处理用户行为与多模态内容。
- 在冷启动和缺模态场景下,准确率显著优于传统方法。
- 能将不同模态映射到同一嵌入空间,缩小模态差距。
主流推荐系统依赖协同过滤(CF),基于历史交互数据进行推荐。当交互数据极少或缺失时,即冷启动场景,其性能急剧下降。此前方法通过结合协同数据与用户/物品的侧信息来缓解此问题,类似多模态学习,旨在将协同与内容表示融合至共享嵌入空间。本文提出一种新型多模态推荐方法——单分支嵌入网络(SiBraR),采用权重共享机制,利用同一单分支嵌入网络对不同模态的交互数据与多模态侧信息进行编码。该设计使模型在缺失模态(包括冷启动)场景下仍具高效性。在音乐、电影和电商三个领域的大规模数据集上,结合音频、文本、图像、标签及交互信息的实验表明,SiBraR 在冷启动场景下显著优于协同过滤及现有内容基推荐系统,在热启动场景下也具有竞争力。结果证明,该模型在缺失模态下仍可生成准确推荐,并能将不同模态映射至共享嵌入空间的相近区域,有效降低模态差异。
原文摘要 · Abstract (English)
Most recommender systems adopt collaborative filtering (CF) and provide recommendations based on past collective interactions. Therefore, the performance of CF algorithms degrades when few or no interactions are available, a scenario referred to as cold-start. To address this issue, previous work relies on models leveraging both collaborative data and side information on the users or items. Similar to multimodal learning, these models aim at combining collaborative and content representations in a shared embedding space. In this work we propose a novel technique for multimodal recommendation, relying on a multimodal Single-Branch embedding network for Recommendation (SiBraR). Leveraging weight-sharing, SiBraR encodes interaction data as well as multimodal side information using the same single-branch embedding network on different modalities. This makes SiBraR effective in scenarios of missing modality, including cold start. Our extensive experiments on large-scale recommendation datasets from three different recommendation domains (music, movie, and e-commerce) and providing multimodal content information (audio, text, image, labels, and interactions) show that SiBraR significantly outperforms CF as well as state-of-the-art content-based RSs in cold-start scenarios, and is competitive in warm scenarios. We show that SiBraR's recommendations are accurate in missing modality scenarios, and that the model is able to map different modalities to the same region of the shared embedding space, hence reducing the modality gap.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。