解决推荐系统中长短序列建模失衡问题,提升短序列用户预测精度。
Length-Adaptive Interest Network for Balancing Long and Short Sequence Modeling in CTR Prediction
- 通过序列长度条件信号,动态调节注意力机制
- 在三个真实数据集上提升最多1.15% AUC,降低2.25%对数损失
- 特别改善短序列用户表现,适用于工业级推荐系统
现代推荐系统中用户行为序列长度差异显著,从稀疏的短期交互到丰富的长期历史不等。现有点击率(CTR)模型增加最大输入序列长度后,反而导致短序列用户的性能下降,原因在于注意力极化和训练数据长度失衡。为此,我们提出LAIN(Length-Adaptive Interest Network),一个即插即用的框架,显式将序列长度作为条件信号,平衡长、短序列建模。LAIN包含三个轻量组件:谱长度编码器将长度映射为连续表示,长度条件提示向长短行为分支注入全局上下文线索,长度调制注意力根据序列长度自适应调整注意力锐度。在五个强基线模型和三个真实世界基准上的实验表明,LAIN持续提升整体性能,最高实现1.15% AUC增益和2.25%对数损失降低。尤其值得注意的是,该方法显著提升了短序列用户的准确性,同时不牺牲长序列效果。本工作提供了一种通用、高效且可部署的方案,缓解序列长度引发的偏差。
原文摘要 · Abstract (English)
User behavior sequences in modern recommendation systems exhibit significant length heterogeneity, ranging from sparse short-term interactions to rich long-term histories. While longer sequences provide more context, we observe that increasing the maximum input sequence length in existing CTR models paradoxically degrades performance for short-sequence users due to attention polarization and length imbalance in training data. To address this, we propose LAIN(Length-Adaptive Interest Network), a plug-and-play framework that explicitly incorporates sequence length as a conditioning signal to balance long- and short-sequence modeling. LAIN consists of three lightweight components: a Spectral Length Encoder that maps length into continuous representations, Length-Conditioned Prompting that injects global contextual cues into both long- and short-term behavior branches, and Length-Modulated Attention that adaptively adjusts attention sharpness based on sequence length. Extensive experiments on three real-world benchmarks across five strong CTR backbones show that LAIN consistently improves overall performance, achieving up to 1.15% AUC gain and 2.25% log loss reduction. Notably, our method significantly improves accuracy for short-sequence users without sacrificing longsequence effectiveness. Our work offers a general, efficient, and deployable solution to mitigate length-induced bias in sequential recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。