arXiv:2409.16627cs.IR2024-09EMNLP被引 11

一次训练,多端部署,实现高效多模态推荐

Train Once, Deploy Anywhere: Matryoshka Representation Learning for Multimodal Recommendation

  • 构建分层表示学习框架,捕捉物品多粒度特征
  • 仅需一次训练即可生成适配不同场景的多个推荐模型
  • 显著降低内存消耗,适合大规模推荐系统落地

尽管语言与视觉建模取得进展,将丰富多模态知识融入推荐系统仍面临挑战,主要源于对高效推荐的需求,要求模型具备自适应和交互能力。本文聚焦序列推荐,提出轻量级框架全尺度俄罗斯套娃表示学习(fMRLRec),通过捕获物品在不同粒度下的特征,学习可用于多维度高效推荐的表征。为融合多模态物品特征,fMRLRec采用简单映射将异构特征投影至统一空间,并设计一种高效的线性变换,将小特征嵌入大特征中,大幅减少大规模推荐数据训练时的内存开销。结合改进的状态空间建模技术,fMRLRec可灵活扩展至不同维度,仅需一次训练即可生成适配多种粒度的多个模型。在多个基准数据集上的实验表明,fMRLRec持续优于现有最优基线方法。代码与数据已公开于 https://github.com/yueqirex/fMRLRec。

原文摘要 · Abstract (English)

Despite recent advancements in language and vision modeling, integrating rich multimodal knowledge into recommender systems continues to pose significant challenges. This is primarily due to the need for efficient recommendation, which requires adaptive and interactive responses. In this study, we focus on sequential recommendation and introduce a lightweight framework called full-scale Matryoshka representation learning for multimodal recommendation (fMRLRec). Our fMRLRec captures item features at different granularities, learning informative representations for efficient recommendation across multiple dimensions. To integrate item features from diverse modalities, fMRLRec employs a simple mapping to project multimodal item features into an aligned feature space. Additionally, we design an efficient linear transformation that embeds smaller features into larger ones, substantially reducing memory requirements for large-scale training on recommendation data. Combined with improved state space modeling techniques, fMRLRec scales to different dimensions and only requires one-time training to produce multiple models tailored to various granularities. We demonstrate the effectiveness and efficiency of fMRLRec on multiple benchmark datasets, which consistently achieves superior performance over state-of-the-art baseline methods. We make our code and data publicly available at https://github.com/yueqirex/fMRLRec.

多模态推荐表示学习轻量化序列推荐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。