arXiv:2508.20865cs.IR2025-08被引 5

用多级量化压缩长行为序列,提升点击率预测精度与效率

Deep Multiple Quantization Network on Long Behavior Sequence for Click-Through Rate Prediction

  • 通过多码本量化将长行为序列压缩为多个码字序列
  • 在工业数据集上实现CTR提升3.5%、RPM提升2.0%
  • 支持在线服务,缓存中间表示显著降低延迟

在点击率(CTR)预测中,用户长期历史交互行为序列对评估其对候选商品的兴趣至关重要。现有方法采用两阶段范式:先召回数百个相关候选项,再通过目标注意力提取兴趣强度向量。然而,我们指出,召回项与完整长行为序列间目标注意力相关性分布的差异必然导致性能下降。为此,提出深度多级量化网络(DMQN),通过压缩长行为序列实现端到端处理。首先,基于多个独立码本将整个行为序列量化为多组码字序列;引入分层序列转换单元,促进压缩后码字序列的交互;随后,候选项与多组码字序列间的注意力输出兴趣向量。为支持在线服务,缓存码字序列的中间表示,显著降低延迟。在工业及公开数据集上的大量实验验证了DMQN的有效性与高效性。广告系统中的A/B测试显示,该模型使CTR提升3.5%,RPM提升2.0%。

原文摘要 · Abstract (English)

In Click-Through Rate (CTR) prediction, the long behavior sequence, comprising the user's long period of historical interactions with items has a vital influence on assessing the user's interest in the candidate item. Existing approaches strike efficiency and effectiveness through a two-stage paradigm: first retrieving hundreds of candidate-related items and then extracting interest intensity vector through target attention. However, we argue that the discrepancy in target attention's relevance distribution between the retrieved items and the full long behavior sequence inevitably leads to a performance decline. To alleviate the discrepancy, we propose the Deep Multiple Quantization Network (DMQN) to process long behavior sequence end-to-end through compressing the long behavior sequence. Firstly, the entire spectrum of long behavior sequence will be quantized into multiple codeword sequences based on multiple independent codebooks. Hierarchical Sequential Transduction Unit is incorporated to facilitate the interaction of reduced codeword sequences. Then, attention between the candidate and multiple codeword sequences will output the interest vector. To enable online serving, intermediate representations of the codeword sequences are cached, significantly reducing latency. Our extensive experiments on both industrial and public datasets confirm the effectiveness and efficiency of DMQN. The A/B test in our advertising system shows that DMQN improves CTR by 3.5% and RPM by 2.0%.

CTR预测序列建模量化在线服务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。