arXiv:2412.20211cs.LGcs.IR2024-12被引 14

将观看时长预测转为序列生成,提升长尾预测精度。

Generative Regression Based Watch Time Prediction for Short-Video Recommendation

  • 把观看时长建模为令牌序列生成,避免传统分桶损失信息。
  • 在两个公开数据集和工业数据上显著优于现有方法。
  • 适合需要精准用户行为建模的短视频推荐系统研发者。

观看时长预测(WTP)已成为短视频推荐系统中量化用户参与度的关键任务,旨在通过连续交互建模来捕捉用户行为。直接应用回归技术常因观看时长范围广、数据分布不均导致显著估计偏差。近期研究尝试将连续预测转化为有序回归任务,但存在两大局限:(1) 分桶划分依赖固定区间,降低预测灵活性与精度;(2) 各分桶间依赖关系未被有效利用,错失纠错机会。受语言建模启发,本文提出一种新型生成式回归(Generative Regression, GR)框架,将WTP重构为序列生成任务。采用结构化离散化实现近乎无损的值重建,同时保持预测保真度。通过精心设计的词表构建与标签编码方案,将每个观看时长双射映射为令牌序列。为缓解教师强制带来的训练-推理差异,引入基于嵌入混搭的课程学习策略,逐步从引导生成过渡至自由生成。我们在两个公开数据集和一个工业数据集上评估该方法,并在快手App上开展在线A/B测试验证其真实效果。结果表明,GR显著优于现有技术。

原文摘要 · Abstract (English)

Watch time prediction (WTP) has emerged as a pivotal task in short video recommendation systems, designed to quantify user engagement through continuous interaction modeling. Predicting users' watch times on videos often encounters fundamental challenges, including wide value ranges and imbalanced data distributions, which can lead to significant estimation bias when directly applying regression techniques. Recent studies have attempted to address these issues by converting the continuous watch time estimation into an ordinal regression task. While these methods demonstrate partial effectiveness, they exhibit notable limitations: (1) the discretization process frequently relies on bucket partitioning, inherently reducing prediction flexibility and accuracy and (2) the interdependencies among different partition intervals remain underutilized, missing opportunities for effective error correction. Inspired by language modeling paradigms, we propose a novel Generative Regression (GR) framework that reformulates WTP as a sequence generation task. Our approach employs \textit{structural discretization} to enable nearly lossless value reconstruction while maintaining prediction fidelity. Through carefully designed vocabulary construction and label encoding schemes, each watch time is bijectively mapped to a token sequence. To mitigate the training-inference discrepancy caused by teacher-forcing, we introduce a \textit{curriculum learning with embedding mixup} strategy that gradually transitions from guided to free-generation modes. We evaluate our method against state-of-the-art approaches on two public datasets and one industrial dataset. We also perform online A/B testing on the Kuaishou App to confirm the real-world effectiveness. The results conclusively show that GR outperforms existing techniques significantly.

推荐系统时长预测生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。