用多模态对齐增强冷用户行为数据,提升点击率预测效果
MARS: Modality-Aligned Retrieval for Sequence Augmented CTR Prediction
- 通过斯坦因核对齐图文特征,构建统一语义空间的用户嵌入
- 从高活跃用户中检索相似行为序列,增强低活跃用户数据
- 在快手大规模线上测试中显著提升核心指标,已投入主流量水
点击率(CTR)预测是推荐系统的核心。尽管当前基于用户行为建模的CTR模型表现优异,但在低活跃用户场景下仍受交互稀疏性严重制约。数据增强是应对该问题的可行方向,但现有方法过度依赖协同信号,忽视了物品的丰富多模态特征,导致对低活跃用户的建模不足。为此,我们提出新颖框架MARS(Modality-Aligned Retrieval for Sequence Augmented CTR Prediction)。MARS采用基于斯坦因核的方法,将文本与图像特征对齐至统一且无偏的语义空间,构建多模态用户嵌入。随后,利用该嵌入从高活跃用户中检索、过滤并聚焦最相似的行为序列,以增强低活跃用户的行为序列。经大量离线实验与在线A/B测试验证,MARS持续优于当前最优基线,在快手平台上实现核心业务指标显著提升。因此,MARS已被成功部署,服务于数亿用户的主要流量。为保障可复现性,我们提供匿名代码访问(https://github.com/wangshukuan/MARS)。
原文摘要 · Abstract (English)
Click-through rate (CTR) prediction serves as a cornerstone of recommender systems. Despite the strong performance of current CTR models based on user behavior modeling, they are still severely limited by interaction sparsity, especially in low-active user scenarios. To address this issue, data augmentation of user behavior is a promising research direction. However, existing data augmentation methods heavily rely on collaborative signals while overlooking the rich multimodal features of items, leading to insufficient modeling of low-active users. To alleviate this problem, we propose a novel framework \textbf{MARS} (\textbf{M}odality-\textbf{A}ligned \textbf{R}etrieval for \textbf{S}equence Augmented CTR Prediction). MARS utilizes a Stein kernel-based approach to align text and image features into a unified and unbiased semantic space to construct multimodal user embeddings. Subsequently, each low-active user's behavior sequence is augmented by retrieving, filtering, and concentrating the most similar behavior sequence of high-active users via multimodal user embeddings. Validated by extensive offline experiments and online A/B tests, our framework MARS consistently outperforms state-of-the-art baselines and achieves substantial growth on core business metrics within Kuaishou~\footnote{https://www.kuaishou.com/}. Consequently, MARS has been successfully deployed, serving the main traffic for hundreds of millions of users. To ensure reproducibility, we provide anonymous access to the implementation code~\footnote{https://github.com/wangshukuan/MARS}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。