arXiv:2502.00321cs.IRcs.AI2025-02被引 4

用多模态信息建模用户真实兴趣,提升推荐系统点击率

MIM: Multi-modal Content Interest Modeling Paradigm for User Behavior Modeling

  • 通过预训练+行为引导微调+统一建模三阶段,融合图文等多模态信息
  • 在淘宝平台实现点击率提升14.14%,每千次展示收益增4.12%
  • 适合解决冷启动和长尾内容推荐问题,工业部署效果显著

点击率(CTR)预测是推荐系统、在线搜索和广告平台中的关键任务,准确捕捉用户对内容的真实兴趣对性能至关重要。然而,现有方法过度依赖ID嵌入,难以反映用户对图像、标题等内容的真正偏好。这一局限在冷启动和长尾场景下尤为明显。为此,我们提出一种新的多模态内容兴趣建模范式(MIM),包含三个关键阶段:预训练、内容-兴趣感知的监督微调(C-SFT)和内容-兴趣感知的统一行为建模(CiUBM)。预训练阶段将基础模型适配到领域数据,提取高质量多模态嵌入;C-SFT阶段利用用户行为信号引导嵌入与用户偏好对齐,弥合语义鸿沟;CiUBM阶段将多模态嵌入与基于ID的协同过滤信号统一建模。在淘宝(全球最大的电商平台之一)上开展的离线实验和在线A/B测试验证了MIM的有效性与高效性。该方法已成功上线,使CTR提升14.14%,RPM提升4.12%,展现出显著的工业应用价值。为促进研究,代码与数据集已公开于https://pan.quark.cn/s/8fc8ec3e74f3。

原文摘要 · Abstract (English)

Click-Through Rate (CTR) prediction is a crucial task in recommendation systems, online searches, and advertising platforms, where accurately capturing users' real interests in content is essential for performance. However, existing methods heavily rely on ID embeddings, which fail to reflect users' true preferences for content such as images and titles. This limitation becomes particularly evident in cold-start and long-tail scenarios, where traditional approaches struggle to deliver effective results. To address these challenges, we propose a novel Multi-modal Content Interest Modeling paradigm (MIM), which consists of three key stages: Pre-training, Content-Interest-Aware Supervised Fine-Tuning (C-SFT), and Content-Interest-Aware UBM (CiUBM). The pre-training stage adapts foundational models to domain-specific data, enabling the extraction of high-quality multi-modal embeddings. The C-SFT stage bridges the semantic gap between content and user interests by leveraging user behavior signals to guide the alignment of embeddings with user preferences. Finally, the CiUBM stage integrates multi-modal embeddings and ID-based collaborative filtering signals into a unified framework. Comprehensive offline experiments and online A/B tests conducted on the Taobao, one of the world's largest e-commerce platforms, demonstrated the effectiveness and efficiency of MIM method. The method has been successfully deployed online, achieving a significant increase of +14.14% in CTR and +4.12% in RPM, showcasing its industrial applicability and substantial impact on platform performance. To promote further research, we have publicly released the code and dataset at https://pan.quark.cn/s/8fc8ec3e74f3.

推荐系统多模态兴趣建模工业落地

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。