arXiv:2512.07216cs.IRcs.LG2025-12被引 12

用简单高效的多模态搜索框架,实现超长用户行为建模与推荐性能提升

MUSE: A Simple Yet Effective Multimodal Search-Based Framework for Lifelong User Interest Modeling

  • 在检索阶段用轻量余弦相似度,建模阶段融合多模态序列信息
  • 支持10万级行为序列建模,线上指标显著提升且延迟几乎无增加
  • 开源首个含高质量多模态嵌入的超长行为序列数据集,适合推荐系统研究者

长期用户兴趣建模对工业推荐系统至关重要,但现有方法主要依赖ID特征,对长尾物品泛化能力差,语义表达力有限。尽管近期工作探索在通用搜索单元(GSU)中使用多模态表示进行行为检索,却常忽略细粒度建模阶段(精确搜索单元,ESU)中的多模态融合。本文系统分析如何有效利用两阶段框架中的多模态信号。关键洞察是:GSU只需简单设计——高质量多模态嵌入配合轻量余弦相似度,优于复杂检索机制;而ESU需更强的多模态序列建模与ID-多模态融合能力以释放潜力。基于此,我们提出MUSE框架,在淘宝展示广告系统中部署,支持10万长度用户行为序列建模,显著提升核心指标,且在线延迟可忽略。为促进社区研究,我们公开工业部署实践及首个包含超长行为序列与高质量多模态嵌入的大规模数据集。代码与数据见https://taobao-mm.github.io。

原文摘要 · Abstract (English)

Lifelong user interest modeling is crucial for industrial recommender systems, yet existing approaches rely predominantly on ID-based features, suffering from poor generalization on long-tail items and limited semantic expressiveness. While recent work explores multimodal representations for behavior retrieval in the General Search Unit (GSU), they often neglect multimodal integration in the fine-grained modeling stage -- the Exact Search Unit (ESU). In this work, we present a systematic analysis of how to effectively leverage multimodal signals across both stages of the two-stage lifelong modeling framework. Our key insight is that simplicity suffices in the GSU: lightweight cosine similarity with high-quality multimodal embeddings outperforms complex retrieval mechanisms. In contrast, the ESU demands richer multimodal sequence modeling and effective ID-multimodal fusion to unlock its full potential. Guided by these principles, we propose MUSE, a simple yet effective multimodal search-based framework. MUSE has been deployed in Taobao display advertising system, enabling 100K-length user behavior sequence modeling and delivering significant gains in top-line metrics with negligible online latency overhead. To foster community research, we share industrial deployment practices and open-source the first large-scale dataset featuring ultra-long behavior sequences paired with high-quality multimodal embeddings. Our code and data is available at https://taobao-mm.github.io.

推荐系统多模态用户建模长尾偏好

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。