arXiv:2510.11317cs.IR2025-10被引 2

用连续轨迹建模用户兴趣演化,提升推荐系统精准度。

Next Interest Flow: A Generative Pre-training Paradigm for Recommender Systems by Modeling All-domain Movelines

  • 将用户兴趣视为高维潜空间中的连续演化轨迹,引入运动学约束保持平滑性。
  • 在淘宝工业级数据上实现AUC提升0.87个百分点,点击转化率提高11.6%。
  • 适合做推荐系统优化的研究者与工程师,尤其关注兴趣建模的场景。

点击率(CTR)预测长期依赖于判别式范式,仅优化候选集内的局部决策边界,难以捕捉跨领域兴趣流的全局联合分布与连续演化。现有生成式方法因将细粒度电商信号离散化为语言或类别空间,导致信息坍塌,无法保留兴趣轨迹的拓扑结构。为此,我们提出一种新型生成式预训练范式——下一兴趣流(Next Interest Flow, NIF),将用户意图建模为高维潜在兴趣流形上的连续演化轨迹。通过切空间分解实现兴趣多样性,借助测地线正则化保证演化平滑性。为弥合生成预训练与判别微调间的目标差异,提出双向对齐策略同步语义空间;并设计时间序列成对机制(TSP)在判别框架中注入时间因果性。构建了统一框架All-domain Moveline Evolution Network(AMEN)。在包含67亿样本的工业数据集上进行大量实验,并在淘宝线上开展A/B测试,验证了AMEN的优越性:相较基线模型实现+0.87pt AUC提升与+11.6% CTCVR增长。

原文摘要 · Abstract (English)

Click-Through Rate (CTR) prediction has long been dominated by discriminative paradigms that optimize local decision boundaries within candidate-specific subspaces. However, these models often fail to capture the global joint distribution and the continuous structural evolution of user intent across all-domain movelines. While generative approaches attempt to model global transition patterns, existing methods suffer from discretization-induced information collapse by remapping nuanced e-commerce signals into discrete linguistic or categorical spaces, failing to preserve the topological fidelity of interest trajectories. To overcome these limitations, we propose a novel generative pre-training paradigm that models user intent as a continuous evolutionary trajectory on a high-dimensional latent interest manifold, termed the Next Interest Flow (NIF). We introduce kinematic constraints to govern this flow: Interest Diversity is achieved via tangent space decomposition, while Evolution Velocity ensures trajectory smoothness through geodesic regularization. To bridge the objective mismatch between generative pre-training and discriminative fine-tuning, we propose a bidirectional alignment strategy to synchronize semantic spaces. Furthermore, we develop a Temporal Sequential Pairwise (TSP) mechanism to instill temporal causality within the discriminative framework. We present the All-domain Moveline Evolution Network (AMEN), a unified framework implementing this pipeline. Extensive experiments on a 6.7-billion instance industrial dataset and online A/B tests on Taobao validate AMEN's superiority, achieving +0.87pt AUC gain and +11.6\% CTCVR lift.

推荐系统生成模型兴趣演化轨迹建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。