通过内容与行为联合建模,提升跨域点击率预测效果
GIST: Cross-Domain Click-Through Rate Prediction via Guided Content-Behavior Distillation
- 分离源域与目标域训练流程,引入内容-行为联合模块增强表征稳定性
- 在小红书平台上线后,点击率显著提升,服务超亿级日活用户
- 适合需要持续更新、冷启动严重的在线广告系统使用
跨域点击率预测旨在通过将知识从源域迁移到目标域,缓解在线广告系统中的数据稀疏和冷启动问题。现有方法通常依赖重叠用户,采用联合训练或预训练微调策略连接源域与目标域,但在实际工业场景中,联合训练难以学习分布差异下的最优表示,而预训练微调也不适合持续集成新数据。为此,我们提出GIST,一种解耦源域与目标域训练过程的跨域终身序列模型。不同于以往仅使用内容或行为信号及其简单组合搜索终身序列的方法,我们创新性地引入内容-行为联合训练模块(CBJT),对齐内容与行为分布,并结合引导信息实现更稳定的表示。此外,我们设计了非对称相似度融合策略(ASI),通过相似度计算增强知识迁移。大量实验表明,GIST在离线评估中优于当前最佳方法,并在在线A/B测试中表现优异。部署于小红书(RedNote)平台后,有效提升了大规模在线广告系统的性能,服务每日数亿活跃用户。
原文摘要 · Abstract (English)
Cross-domain Click-Through Rate prediction aims to tackle the data sparsity and the cold start problems in online advertising systems by transferring knowledge from source domains to a target domain. Most existing methods rely on overlapping users to facilitate this transfer, often focusing on joint training or pre-training with fine-tuning approach to connect the source and target domains. However, in real-world industrial settings, joint training struggles to learn optimal representations with different distributions, and pre-training with fine-tuning is not well-suited for continuously integrating new data. To address these issues, we propose GIST, a cross-domain lifelong sequence model that decouples the training processes of the source and target domains. Unlike previous methods that search lifelong sequences in the source domains using only content or behavior signals or their simple combinations, we innovatively introduce a Content-Behavior Joint Training Module (CBJT), which aligns content-behavior distributions and combines them with guided information to facilitate a more stable representation. Furthermore, we develop an Asymmetric Similarity Integration strategy (ASI) to augment knowledge transfer through similarity computation. Extensive experiments demonstrate the effectiveness of GIST, surpassing SOTA methods on offline evaluations and an online A/B test. Deployed on the Xiaohongshu (RedNote) platform, GIST effectively enhances online ads system performance at scale, serving hundreds of millions of daily active users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。