arXiv:2508.05993cs.IR2025-08中稿 · CIKM 2025被引 7

用可扩展专家模块实现高效多模态推荐,兼顾冷启动与偏好漂移。

Efficient Multimodal Streaming Recommendation via Expandable Side Mixture-of-Experts

  • 在冻结预训练编码器旁加轻量级可扩展专家网络,动态适应新反馈。
  • 实验显示在三个数据集上推荐效果优于现有方法,且计算开销更低。
  • 适合处理用户偏好随时间变化的实时推荐场景,尤其对资源受限系统友好。

流式推荐系统广泛应用于实际场景,用户兴趣随时间演变,新物品不断涌现。由于反映最新兴趣的交互数据有限,且新物品缺乏足够反馈,精准捕捉用户最新偏好面临挑战。常见做法是使用多模态编码器(如 BERT、ViT)增强物品表示,提取视觉和文本特征。然而,这些编码器基于通用任务预训练,未针对用户偏好建模优化,且忽略了用户对特定模态特征(如视觉风格、文本语调)的偏好也可能随时间漂移。这带来两个关键问题:微调大型多模态编码器成本高;持续更新模型易遗忘长期偏好。为此,本文提出可扩展侧边专家混合(XSMoE),一种内存高效的多模态流式推荐框架。XSMoE 在冻结的预训练编码器旁添加轻量级侧向微调模块,包含可扩展专家网络,并根据演化中的用户反馈增量扩展。门控路由动态融合专家与主干输出,利用度剪枝策略保持模型紧凑。通过可扩展专家学习新模式而不覆盖已有知识,有效捕捉多模态特征中的冷启动与偏好漂移。在三个真实世界数据集上的实验表明,XSMoE 在推荐质量与计算效率方面均优于现有最佳基线。

原文摘要 · Abstract (English)

Streaming recommender systems (SRSs) are widely deployed in real-world applications, where user interests shift and new items arrive over time. As a result, effectively capturing users' latest preferences is challenging, as interactions reflecting recent interests are limited and new items often lack sufficient feedback. A common solution is to enrich item representations using multimodal encoders (e.g., BERT or ViT) to extract visual and textual features. However, these encoders are pretrained on general-purpose tasks: they are not tailored to user preference modeling, and they overlook the fact that user tastes toward modality-specific features such as visual styles and textual tones can also drift over time. This presents two key challenges in streaming scenarios: the high cost of fine-tuning large multimodal encoders, and the risk of forgetting long-term user preferences due to continuous model updates. To tackle these challenges, we propose Expandable Side Mixture-of-Experts (XSMoE), a memory-efficient framework for multimodal streaming recommendation. XSMoE attaches lightweight side-tuning modules consisting of expandable expert networks to frozen pretrained encoders and incrementally expands them in response to evolving user feedback. A gating router dynamically combines expert and backbone outputs, while a utilization-based pruning strategy maintains model compactness. By learning new patterns through expandable experts without overwriting previously acquired knowledge, XSMoE effectively captures both cold start and shifting preferences in multimodal features. Experiments on three real-world datasets demonstrate that XSMoE outperforms state-of-the-art baselines in both recommendation quality and computational efficiency.

推荐系统多模态流式学习专家混合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。