arXiv:2508.08042cs.IRcs.AI2025-08被引 3

动态融合多模态信息,提升冷启动推荐效果

Multi-modal Adaptive Mixture of Experts for Cold-start Recommendation

  • 设计可学习门控机制,按内容特征自适应加权各模态
  • 在多个基准数据集上冷启动推荐准确率超越现有方法
  • 适合新商品/新内容推荐场景,尤其当部分模态缺失时仍有效

推荐系统在冷启动场景下面临严峻挑战,即新物品因交互历史有限难以被有效推荐。尽管多模态数据(如图像、文本、音频等)蕴含丰富信息,但现有方法常采用简单的拼接、平均池化或固定加权策略,无法捕捉模态间的复杂关系。本文提出一种新型多模态混合专家框架MAMEX,通过模态专用专家网络与可学习门控机制,动态利用各模态的潜在表示。该机制根据内容特征自适应调整各模态贡献权重,使模型在不同情况下聚焦最有效的模态,同时对缺失或无关模态保持鲁棒性。在多个基准数据集上的实验表明,MAMEX在冷启动场景下显著优于现有先进方法,兼具更高精度与更强适应性。代码已开源至GitHub:https://github.com/L2R-UET/MAMEX。

原文摘要 · Abstract (English)

Recommendation systems have faced significant challenges in cold-start scenarios, where new items with a limited history of interaction need to be effectively recommended to users. Though multimodal data (e.g., images, text, audio, etc.) offer rich information to address this issue, existing approaches often employ simplistic integration methods such as concatenation, average pooling, or fixed weighting schemes, which fail to capture the complex relationships between modalities. Our study proposes a novel Mixture of Experts (MoE) framework for multimodal cold-start recommendation, named MAMEX, which dynamically leverages latent representation from different modalities. MAMEX utilizes modality-specific expert networks and introduces a learnable gating mechanism that adaptively weights the contribution of each modality based on its content characteristics. This approach enables MAMEX to emphasize the most informative modalities for each item while maintaining robustness when certain modalities are less relevant or missing. Extensive experiments on benchmark datasets show that MAMEX outperforms state-of-the-art methods in cold-start scenarios, with superior accuracy and adaptability. For reproducibility, the code has been made available on Github https://github.com/L2R-UET/MAMEX.

冷启动推荐多模态MoE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。