arXiv:2502.12634cs.IR2025-02

通过上下文感知网络提升在线点击率预测准确率

Context-Aware Lifelong Sequential Modeling for Online Click-Through Rate Prediction

  • 用TCN捕捉用户序列中相邻行为的上下文信息
  • 在WeChat平台数据上,点击率预测效果优于现有方法
  • 支持个性化滤波器生成,适配不同用户兴趣特征

长期序列建模(LSM)在社交媒体推荐系统中对预测用户点击率(CTR)日益重要。传统注意力机制仅关注单个物品与目标物品的相关性,而上下文感知的LSM还需考虑用户行为序列中邻近物品的影响。本文提出上下文感知兴趣网络(CAIN),利用时间卷积网络(TCN)为整个生命周期序列中的每个物品生成上下文感知表示,并将其用于注意力机制以提取上下文感知的兴趣表示。在此基础上,提出多尺度兴趣聚合模块(MSIA),通过多层TCN及其对应注意力模块捕获不同上下文范围的兴趣表示。此外,引入个性化提取器生成模块(PEG),根据用户基础属性生成个性化卷积滤波器,替代全局滤波器以生成更用户特定的表示。我们在公开数据集和微信频道平台的工业数据集上进行了大量实验,结果表明CAIN在预测精度和在线性能指标上均优于现有方法。

原文摘要 · Abstract (English)

Lifelong sequential modeling (LSM) is becoming increasingly critical in social media recommendation systems for predicting the click-through rate (CTR) of items presented to users. Central to this process is the attention mechanism, which extracts interest representations with respect to candidate items from the user sequence. Typically, attention mechanisms operate in a point-wise manner, focusing solely on the relevance of individual items in the sequence to the candidate item. In contrast, context-aware LSM aims to also consider adjacent items in the user behavior sequence to better assess the importance of each item. In this paper, we propose the Context-Aware Interest Network (CAIN), which utilizes the Temporal Convolutional Network (TCN) to create context-aware representations for each item throughout the lifelong sequence. These enhanced representations are then used in the attention mechanism instead of the original item representations to derive context-aware interest representations. Building upon this TCN framework, we propose the Multi-Scope Interest Aggregator (MSIA) module, which incorporates multiple TCN layers and their corresponding attention modules to capture interest representations across varying context scopes. Furthermore, we introduce the Personalized Extractor Generation (PEG) module, which generates convolution filters based on users' basic profile features. These personalized filters are then used in the TCN layers instead of the original global filters to generate more user-specific representations. We conducted extensive experiments on both a public dataset and an industrial dataset from the WeChat Channels platform. The results demonstrate that CAIN outperforms existing methods in terms of prediction accuracy and online performance metrics.

点击率预测序列建模上下文感知TCN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。