提出LENS框架,精准控制用户行为序列中目标与物品的交互粒度。
LENS: A Staged Design for Interaction Granularity in Sequential CTR Prediction

- 设计目标条件查询门与位置偏置模块,提升稀疏场景下的交互精度
- 在4个数据集上12个组合中均实现正向增益,最高提升0.035 AUC
- 发现低密度时需融合序列信息以优化条件输入,指导模型选型
在序列点击率预测中,目标与用户行为序列的交互粒度设计是核心问题。现有模型主要分两类:原始物品架构(如DIN)直接对序列中每个物品打分,依赖高质量物品嵌入,在稀疏物品上表现脆弱;潜在查询架构(如HyFormer、MixFormer、OneTrans)通过融合目标与其他信息构建查询表示,对物品密度变化更鲁棒但削弱了目标特异性控制。本文提出LENS,在保持粗粒度瓶颈的同时恢复目标特异性控制。LENS包含两个模块:目标条件查询门(TCQG)用于查询激活,目标条件位置偏置(TCPB)用于历史检索。此外引入查询特定位置偏置(QueryPos),为潜在查询骨干提供简单的静态位置感知参考。在三个代表性潜在查询骨干和四个数据集上,联合使用QueryPos+LENS在全部十二个组合中均取得正向总增益(点估计)。还发现密度依赖性调节规则:随着物品密度降低,最优条件来源从仅物品转向物品加序列。
原文摘要 · Abstract (English)
In sequential CTR prediction, a central design question is at what granularity the target should interact with the user behaviour sequence. Existing models mainly follow two routes. Raw-item architectures such as DIN let the target score each item in the sequence directly. This relies on well-trained item embeddings and becomes brittle for sparse items. Latent-query architectures such as HyFormer, MixFormer, and OneTrans build query representations by combining the target with other information. This is more robust across item-density regimes but blunter: target-specific control is diluted. We propose LENS to restore target-specific control within these coarser bottlenecks. LENS has two modules: a Target-Conditioned Query Gate (TCQG) for query activation and a Target-Conditioned Position Bias (TCPB) for history retrieval. We further introduce Query-Specific Position Bias (QueryPos), a simple static position-aware reference for latent-query backbones. Across three representative latent-query backbones and four datasets, the combined QueryPos+LENS design achieves positive total-gain point estimates in all twelve evaluated backbone--dataset cells. We also identify a density-dependent conditioning rule: as item density decreases, the optimal condition source shifts from item-only to item-plus-sequence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。