SIREN统一建模多模态与行为序列,提升推荐系统长期用户兴趣捕捉能力。
SIREN: Unified Multi-Granularity Semantic Interaction for Multi-Modal Lifelong User Interest Modeling

- 设计双阶段检索机制,融合语义与硬编码索引实现多粒度交互
- 在离线数据上达成最优GAUC,线上测试带来最高3.87%的GMV增长
- 适用于需要长期用户兴趣建模的工业级推荐场景
工业推荐系统越来越依赖用户的长期行为历史和丰富的多模态内容来捕捉不断变化的兴趣。然而,由于多模态空间与协同过滤空间之间存在固有错位,如何有效整合多模态特征仍具挑战。现有方法通常对多模态序列和行为序列分别建模后进行后期融合,导致多模态表征粗粒度且整合有限。本文提出SIREN,一种面向多模态长期用户兴趣建模的统一多粒度语义交互框架。在通用搜索单元阶段,引入两种检索策略:基于多模态相似性的软检索以提升召回效果,基于语义ID(SemID)的硬检索以支持工业部署效率。在精确搜索单元阶段,通过粗粒度相似性桶和细粒度前缀编码的SemID显式引入目标感知相关性,实现在目标条件化Transformer架构中与协同ID特征的统一交互。大量离线实验表明,SIREN达到领先水平的GAUC;在线A/B测试进一步验证其在多个生产场景中的稳定收益,包括微信朋友圈+2.28%、公众号+3.87%、频道+1.61%的GMV提升。自2025年7月起,SIREN已在腾讯广告平台全面上线全流量服务。
原文摘要 · Abstract (English)
Industrial recommender systems increasingly leverage lifelong user behavior histories and rich multi-modal content to capture evolving user preferences. However, effectively integrating multi-modal features into lifelong interest modeling remains challenging due to the inherent misalignment between multi-modal and collaborative spaces. Existing paradigms typically rely on separate modeling of multi-modal sequence and behavior sequence, and late fusion to alleviate the modality gap, which results in coarse-grained multi-modal representation and limited integration. In this paper, we propose SIREN, a unified multi-granularity semantic interaction framework for multi-modal lifelong user interest modeling. In the General Search Unit stage, we introduce two alternative retrieval strategies: multi-modal similarity-based soft retrieval for retrieval effectiveness, and Semantic ID (SemID)-based hard retrieval for efficient industrial serving. For the Exact Search Unit stage, we explicitly incorporate target-aware relevance via coarse similarity buckets and fine-grained prefix-encoded SemIDs, enabling unified interaction with collaborative ID features within the target-conditioned transformer architecture. Extensive experiments on the offline dataset demonstrate that SIREN achieves a state-of-the-art GAUC. Online A/B tests further demonstrate consistent GMV gains across multiple production scenarios, including +2.28% in Weixin Moments, +3.87% in Weixin Official Accounts, and +1.61% in Weixin Channels. From July 2025, SIREN has been fully launched for full-traffic serving in Tencent's advertising platform.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。