用扩散模型挖掘用户长期兴趣,提升点击率预测效果
Modeling Long-term User Behaviors with Diffusion-driven Multi-interest Network for CTR Prediction
- 通过正交分解目标行为,提取多兴趣通道并建模其关系
- 引入上下文引导的扩散模块,生成与用户兴趣空间对齐的新兴趣
- 结合对比学习确保生成兴趣真实可信,适合推荐系统优化
点击率(CTR)预测对推荐系统和在线广告至关重要,已有研究证实建模用户长期行为有助于提升性能。然而,行为数量庞大且噪声干扰复杂,影响预测效率与效果。现有两阶段模型常过滤重要信息,难以捕捉多样兴趣或构建完整的用户兴趣潜空间。受多兴趣与生成建模启发,本文提出DiffuMIN(扩散驱动的多兴趣网络),以全面探索用户长期行为。首先设计目标导向的多兴趣提取方法,通过正交分解目标获得兴趣通道,并建模通道与用户行为的关系,实现兴趣解耦与提取;随后引入由上下文兴趣和兴趣通道引导的扩散模块,锚定个性化、目标导向的兴趣类型,生成符合用户兴趣潜空间的增强兴趣,进一步拓展受限的兴趣空间;最后利用对比学习确保生成兴趣与用户真实偏好一致。在两个公开数据集和一个工业数据集上进行大量离线实验,结果表明DiffuMIN表现更优;在线A/B测试中,CTR提升1.52%,CPM提升1.10%。代码已开源。
原文摘要 · Abstract (English)
CTR (Click-Through Rate) prediction, crucial for recommender systems and online advertising, etc., has been confirmed to benefit from modeling long-term user behaviors. Nonetheless, the vast number of behaviors and complexity of noise interference pose challenges to prediction efficiency and effectiveness. Recent solutions have evolved from single-stage models to two-stage models. However, current two-stage models often filter out significant information, resulting in an inability to capture diverse user interests and build the complete latent space of user interests. Inspired by multi-interest and generative modeling, we propose DiffuMIN (Diffusion-driven Multi-Interest Network) to model long-term user behaviors and thoroughly explore the user interest space. Specifically, we propose a target-oriented multi-interest extraction method that begins by orthogonally decomposing the target to obtain interest channels. This is followed by modeling the relationships between interest channels and user behaviors to disentangle and extract multiple user interests. We then adopt a diffusion module guided by contextual interests and interest channels, which anchor users' personalized and target-oriented interest types, enabling the generation of augmented interests that align with the latent spaces of user interests, thereby further exploring restricted interest space. Finally, we leverage contrastive learning to ensure that the generated augmented interests align with users' genuine preferences. Extensive offline experiments are conducted on two public datasets and one industrial dataset, yielding results that demonstrate the superiority of DiffuMIN. Moreover, DiffuMIN increased CTR by 1.52% and CPM by 1.10% in online A/B testing. Our source code is available at https://github.com/laiweijiang/DiffuMIN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。