arXiv:2411.15005cs.IR2024-11KDD被引 31

通过多粒度兴趣检索与精炼,提升长时用户行为建模的点击率预测效果

Multi-granularity Interest Retrieval and Refinement Network for Long-Term User Behavior Modeling in CTR Prediction

  • 构建多时间尺度查询,捕获用户不同粒度的兴趣
  • 引入傅里叶多头变换器,挖掘序列内交互与顺序信息
  • 多头目标注意力自适应加权兴趣影响,适合推荐系统优化

点击率(CTR)预测对在线个性化平台至关重要。近期研究显示,建模丰富的用户行为可显著提升CTR预测性能。现有长时用户行为建模方法通常分为两个阶段:第一阶段从长序列中检索与目标项相关的子序列,第二阶段建模子序列与目标项的关系。然而,现有方法存在两大缺陷:一是检索查询仅包含目标项信息,难以捕捉用户多样兴趣;二是忽略子序列内的顺序和交互信息。为此,我们提出多粒度兴趣检索与精炼网络(MIRRN)。首先,基于不同时间尺度的行为构造查询,获取反映用户多粒度兴趣的子序列;然后,引入新型多头傅里叶变换器,高效学习子序列中的顺序与交互信息,实现更精准的兴趣建模;最后,采用多头目标注意力,自适应评估各粒度兴趣对目标项的影响。大量实验表明,MIRRN显著优于当前最优基线。A/B测试显示,在华为音乐应用上,其使平均听歌数量提升1.32%,平均听歌时长提升0.55%。代码已开源:https://github.com/USTC-StarTeam/MIRRN。

原文摘要 · Abstract (English)

Click-through Rate (CTR) prediction is crucial for online personalization platforms. Recent advancements have shown that modeling rich user behaviors can significantly improve the performance of CTR prediction. Current long-term user behavior modeling algorithms predominantly follow two cascading stages. The first stage retrieves subsequence related to the target item from the long-term behavior sequence, while the second stage models the relationship between the subsequence and the target item. Despite significant progress, these methods have two critical flaws. First, the retrieval query typically includes only target item information, limiting the ability to capture the user's diverse interests. Second, relational information, such as sequential and interactive information within the subsequence, is frequently overlooked. Therefore, it requires to be further mined to more accurately model user interests. To this end, we propose Multi-granularity Interest Retrieval and Refinement Network (MIRRN). Specifically, we first construct queries based on behaviors observed at different time scales to obtain subsequences, each capturing users' interest at various granularities. We then introduce an noval multi-head Fourier transformer to efficiently learn sequential and interactive information within the subsequences, leading to more accurate modeling of user interests. Finally, we employ multi-head target attention to adaptively assess the impact of these multi-granularity interests on the target item. Extensive experiments have demonstrated that MIRRN significantly outperforms state-of-the-art baselines. Furthermore, an A/B test shows that MIRRN increases the average number of listening songs by 1.32% and the average time of listening songs by 0.55% on the Huawei Music App. The implementation code is publicly available at https://github.com/USTC-StarTeam/MIRRN.

CTR预测用户建模多粒度推荐系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。