arXiv:2507.10097cs.IR2025-07被引 9

让推荐系统在检索阶段处理上千条用户行为,提升长期兴趣建模能力。

User Long-Term Multi-Interest Retrieval Model for Recommendation

  • 分层双兴趣学习+指针增强的多级召回架构
  • 在淘宝秒杀场景下点击率提升5.54%,订单量增11.01%
  • 适合需要长序列建模的工业级推荐系统使用

用户行为序列建模对工业推荐系统至关重要,能从丰富的历史交互中捕捉用户兴趣。尽管排序阶段模型已可处理长达数千条的行为序列,现有检索模型仍受限于数百条序列,主要受两大挑战制约:实时服务对低延迟的严格要求,以及缺乏目标感知机制和交叉交互结构,难以借鉴排序阶段技术简化长序列建模。为此,我们提出用户长期多兴趣检索模型(ULIM),首次实现检索阶段千级行为序列建模。ULIM包含两个新组件:1)类别感知的分层双兴趣学习,将长序列划分为多个类别感知子序列以表示多兴趣,并在特定兴趣簇内联合优化长期与短期兴趣;2)指针增强的级联类别到物品召回,通过指针生成兴趣网络(PGIN)预测下一类别,再在前K个预测类别中进行物品召回。在淘宝数据集上的实验表明,ULIM显著优于当前最优方法,在淘宝秒杀场景中带来5.54%点击率、11.01%订单量和4.03%商品交易额提升。

原文摘要 · Abstract (English)

User behavior sequence modeling, which captures user interest from rich historical interactions, is pivotal for industrial recommendation systems. Despite breakthroughs in ranking-stage models capable of leveraging ultra-long behavior sequences with length scaling up to thousands, existing retrieval models remain constrained to sequences of hundreds of behaviors due to two main challenges. One is strict latency budget imposed by real-time service over large-scale candidate pool. The other is the absence of target-aware mechanisms and cross-interaction architectures, which prevent utilizing ranking-like techniques to simplify long sequence modeling. To address these limitations, we propose a new framework named User Long-term Multi-Interest Retrieval Model(ULIM), which enables thousand-scale behavior modeling in retrieval stages. ULIM includes two novel components: 1)Category-Aware Hierarchical Dual-Interest Learning partitions long behavior sequences into multiple category-aware subsequences representing multi-interest and jointly optimizes long-term and short-term interests within specific interest cluster. 2)Pointer-Enhanced Cascaded Category-to-Item Retrieval introduces Pointer-Generator Interest Network(PGIN) for next-category prediction, followed by next-item retrieval upon the top-K predicted categories. Comprehensive experiments on Taobao dataset show that ULIM achieves substantial improvement over state-of-the-art methods, and brings 5.54% clicks, 11.01% orders and 4.03% GMV lift for Taobaomiaosha, a notable mini-app of Taobao.

推荐系统长序列建模多兴趣挖掘工业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。