通过三重门控机制,提升点击率预测对用户意图漂移和噪声的鲁棒性。
GAP-Net: Calibrating User Intent via Gated Adaptive Progressive Learning for CTR Prediction
- 用动态门控抑制行为序列中的噪声干扰
- 在工业数据集上显著优于现有模型,抗噪声能力强
- 适合高噪声场景下的推荐系统优化
序列用户行为建模对点击率(CTR)预测至关重要,但面临三大瓶颈:(1)注意力陷阱——标准Softmax强制模型将概率分配给嘈杂行为;(2)静态查询假设——忽略实时上下文引发的用户意图动态变化;(3)固定视图聚合——无法根据决策上下文自适应加权异构时序信号。为此,提出GAP-Net(门控自适应渐进网络),构建“三重门控”架构,从微观特征到宏观视图逐步精炼信息。其核心机制包括:(1)自适应稀疏门控注意力(ASGA)在微观层面引入门控,实现稀疏化,有效抑制大量噪声激活;(2)门控级联查询校准(GCQC)通过中层级联通道,动态对齐实时触发与长期记忆,实现用户意图的动态校准;(3)上下文门控去噪融合(CGDF)在宏观层面进行调制,协调多视图序列的聚合。在工业数据集上的大量实验表明,GAP-Net相比先进基线取得显著提升,在交互噪声和意图漂移下表现更稳健。
原文摘要 · Abstract (English)
Sequential user behavior modeling is pivotal for Click-Through Rate (CTR) prediction yet is hindered by three intrinsic bottlenecks: (1) the "Attention Sink" phenomenon, where standard Softmax compels the model to allocate probability mass to noisy behaviors; (2) the Static Query Assumption, which overlooks dynamic shifts in user intent driven by real-time contexts; and (3) Rigid View Aggregation, which fails to adaptively weight heterogeneous temporal signals according to the decision context. To bridge these gaps, we propose GAP-Net (Gated Adaptive Progressive Network), a unified framework establishing a "Triple Gating" architecture to progressively refine information from micro-level features to macro-level views. GAP-Net operates through three integrated mechanisms: (1) Adaptive Sparse-Gated Attention (ASGA) employs micro-level gating to enforce sparsity, effectively suppressing massive noise activations; (2) Gated Cascading Query Calibration (GCQC) dynamically aligns user intent by bridging real-time triggers and long-term memories via a meso-level cascading channel; and (3) Context-Gated Denoising Fusion (CGDF) performs macro-level modulation to orchestrate the aggregation of multi-view sequences. Extensive experiments on industrial datasets demonstrate that GAP-Net achieves substantial improvements over state-of-the-art baselines, exhibiting superior robustness against interaction noise and intent drift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。