用点击和忽略行为混合建模,提升推荐系统点击率预测效果
Beyond Positive Signals: Unlocking Implicit Negative Behaviors for Enhanced Sequential User Modeling

- 将点击与忽略等负向行为混合编入序列,突破仅用正向行为的局限
- 在多个模型上实现1.9%至9.6%的相对AUC提升,效果稳定显著
- 适合做推荐系统用户行为建模的研究者与工程实践者参考
用户行为序列建模已成为现代点击率(CTR)预测的核心。近年来,研究聚焦于序列编码方式的优化,如目标感知注意力、兴趣演化网络及统一架构,但一个更基础的问题仍被忽视:行为序列应包含什么?当前做法仅使用正向交互(点击、购买、完成),而大量隐式负向行为(跳过、低参与、滑过)未被充分利用。随着正向序列长度增长带来的收益趋于饱和,本文重新审视这一被低估的数据源。实验表明,在固定长度预算下,将正负行为按时间顺序混合的序列,相比纯正向序列,在多种模型架构中均表现更优,且计算开销几乎不变。我们进一步发现,简单的极性嵌入存在语义混淆问题,提出目标感知极性融合(TAPF)机制,通过目标相关门控增强行为区分能力,带来额外增益。值得注意的是,即使仅使用极性偏置基线,也能获得大部分性能提升,说明核心贡献在于混合极性数据范式本身。在三个公开基准上的实验验证了该方法的普适价值,相对AUC提升达1.9%至9.6%。
原文摘要 · Abstract (English)
User behavior sequence modeling has become a central component in modern click-through rate (CTR) prediction. Over the past years, the community has invested substantial effort into improving how sequences are encoded, from target-aware attention and interest evolution networks to unified architectures that jointly process sequential and non-sequential features. However, a more fundamental question remains under-explored: what should constitute the behavior sequence? Current practice constructs sequences exclusively from positive interactions (clicks, purchases, completions), while the far more abundant implicit negative behaviors (skips, low engagement, scroll-past) are largely underutilized. As gains from longer positive sequences approach diminishing returns, we revisit this underutilized data source within the sequential modeling framework. In this paper, we demonstrate that mixed-polarity behavior sequences, which chronologically interleave positive and negative tokens within a fixed length budget, consistently outperform positive-only sequences across diverse model architectures with negligible additional computational overhead. We further identify a semantic indistinguishability problem inherent to naive polarity embeddings and propose Target-Aware Polarity Fusion (TAPF), a lightweight target-conditioned gating mechanism that provides additional gains by differentiating behavioral evidence. Notably, even the simpler polarity bias baseline captures the majority of improvement, underscoring that the primary contribution is the mixed-polarity data paradigm itself. Experiments on three public benchmarks demonstrate consistent improvements of +1.9% to +9.6% relative AUC across five architectures, which validate the practical value of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。