arXiv:2508.13567cs.IR2025-08中稿 · TKDE被引 8

ENCODE提升长序列用户行为建模效率与精度,打破性能与速度的矛盾。

ENCODE: Breaking the Trade-Off Between Performance and Efficiency in Long-Term User Behavior Modeling

  • 分离离线聚类与在线推理阶段,兼顾信息完整性和相关性。
  • 通过度量学习降维,降低聚类开销,保持行为间相对距离。
  • 端到端使用同一相关性度量,确保兴趣与目标项高度匹配。

长期用户行为序列是提升点击率的重要资源,但准确捕捉长期兴趣并实现实时响应极具挑战。现有方法在建模过程中无意破坏两个基本要求:(R1)充分利用完整序列以保留尽可能多的信息;(R2)从最相关行为中提取信息以保证兴趣与当前目标项的高度相关性。这导致线上服务因兴趣信息不全或不准而性能下降。为此,我们提出一种高效的两阶段长序列建模方法ENCODE,包含离线提取阶段和在线推理阶段。离线阶段通过聚类提取精准兴趣,并设计基于度量学习的降维算法,保留行为间相对距离,降低聚类开销;在线阶段则直接调用预训练的兴趣表示预测与目标项的关联。此外,整个流程统一采用相同的相关性度量,进一步保障相关性。大量实验及与SOTA方法对比验证了ENCODE在效果与效率上的优越性。

原文摘要 · Abstract (English)

Long-term user behavior sequences are a goldmine for businesses to explore users' interests to improve Click-Through Rate. However, it is very challenging to accurately capture users' long-term interests from their long-term behavior sequences and give quick responses from the online serving systems. To meet such requirements, existing methods "inadvertently" destroy two basic requirements in long-term sequence modeling: R1) make full use of the entire sequence to keep the information as much as possible; R2) extract information from the most relevant behaviors to keep high relevance between learned interests and current target items. The performance of online serving systems is significantly affected by incomplete and inaccurate user interest information obtained by existing methods. To this end, we propose an efficient two-stage long-term sequence modeling approach, named as EfficieNt Clustering based twO-stage interest moDEling (ENCODE), consisting of offline extraction stage and online inference stage. It not only meets the aforementioned two basic requirements but also achieves a desirable balance between online service efficiency and precision. Specifically, in the offline extraction stage, ENCODE clusters the entire behavior sequence and extracts accurate interests. To reduce the overhead of the clustering process, we design a metric learning-based dimension reduction algorithm that preserves the relative pairwise distances of behaviors in the new feature space. While in the online inference stage, ENCODE takes the off-the-shelf user interests to predict the associations with target items. Besides, to further ensure the relevance between user interests and target items, we adopt the same relevance metric throughout the whole pipeline of ENCODE. The extensive experiment and comparison with SOTA have demonstrated the effectiveness and efficiency of our proposed ENCODE.

用户建模序列建模高效推理聚类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。