用生成模型捕捉用户兴趣变化,提升点击率预测准确性
GenCI: Generative Modeling of User Interest Shift via Cohort-based Intent Learning for CTR Prediction
- 通过生成式建模构建用户即时兴趣群体,避免历史偏好过拟合
- 在三个数据集上显著优于基线,最高提升6.2%的AUC
- 适合需要动态理解用户意图的推荐系统场景
点击率(CTR)预测在在线广告与推荐系统中至关重要。尽管在基于历史行为建模用户偏好方面取得进展,仍面临两大挑战:现有判别范式侧重将候选项匹配到用户历史,易过拟合于主导特征,难以适应快速的兴趣变化;同时,点对点排序范式导致信息缺失,忽略召回集合的整体上下文信号,使长期偏好压倒用户的即时演变意图。为此,我们提出GenCI,一种基于语义兴趣群体的生成式用户意图框架,用于CTR预测。该框架首先采用以下一项目预测(NTP)为目标训练的生成模型,主动生成候选兴趣群体,作为用户即时意图的显式、候选无关表示。随后,分层候选感知网络通过交叉注意力机制将此丰富上下文信号注入排序阶段,使其同时与用户历史和目标项目对齐。整个模型端到端训练,形成更一致有效的CTR预测流程。在三个常用数据集上的大量实验验证了方法的有效性。
原文摘要 · Abstract (English)
Click-through rate (CTR) prediction plays a pivotal role in online advertising and recommender systems. Despite notable progress in modeling user preferences from historical behaviors, two key challenges persist. First, exsiting discriminative paradigms focus on matching candidates to user history, often overfitting to historically dominant features and failing to adapt to rapid interest shifts. Second, a critical information chasm emerges from the point-wise ranking paradigm. By scoring each candidate in isolation, CTR models discard the rich contextual signal implied by the recalled set as a whole, leading to a misalignment where long-term preferences often override the user's immediate, evolving intent. To address these issues, we propose GenCI, a generative user intent framework that leverages semantic interest cohorts to model dynamic user preferences for CTR prediction. The framework first employs a generative model, trained with a next-item prediction (NTP) objective, to proactively produce candidate interest cohorts. These cohorts serve as explicit, candidate-agnostic representations of a user's immediate intent. A hierarchical candidate-aware network then injects this rich contextual signal into the ranking stage, refining them with cross-attention to align with both user history and the target item. The entire model is trained end-to-end, creating a more aligned and effective CTR prediction pipeline. Extensive experiments on three widely used datasets demonstrate the effectiveness of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。