用大模型理解评论,提升短视频评论停留时长预测效果。
Comment Staytime Prediction with LLM-enhanced Comment Understanding
- 用大模型增强评论文本理解,融合细粒度评论排序辅助任务。
- 在自建数据集上显著提升停留时间预测准确率,线上测试有效。
- 适合做推荐系统中用户行为建模与评论分析的研究者参考。
在现代在线流媒体平台中,评论区对提升用户体验至关重要。理解用户在评论区的行为对于全面建模用户兴趣具有重要意义。用户参与度的关键指标之一是停留时间,即用户浏览和发布评论所花费的时间。现有观看时长预测方法难以适配停留时间预测,忽视了用户与单条评论及其相互关系的交互。本文提出一个从快手平台收集的短视频评论数据集KuaiComt,并构建了基于大模型增强评论理解(LCU)的评论停留时间预测框架。该框架利用大语言模型强大的文本理解能力分析评论内容,同时引入细粒度评论排序信号作为辅助任务。框架分为两阶段:第一阶段通过领域特定任务微调大模型,建立视频与评论间的关联;第二阶段将大模型输出融入预测模型,并设计两个评论排序辅助任务以更好捕捉用户偏好。大量离线实验验证了框架的有效性,在评论停留时间预测任务上取得显著提升。此外,线上A/B测试进一步证明其在工业场景中的实际价值。数据集KuaiComt(https://github.com/lyingCS/KuaiComt.github.io)和LCU代码(https://github.com/lyingCS/LCU)已全部开源。
原文摘要 · Abstract (English)
In modern online streaming platforms, the comments section plays a critical role in enhancing the overall user experience. Understanding user behavior within the comments section is essential for comprehensive user interest modeling. A key factor of user engagement is staytime, which refers to the amount of time that users browse and post comments. Existing watchtime prediction methods struggle to adapt to staytime prediction, overlooking interactions with individual comments and their interrelation. In this paper, we present a micro-video recommendation dataset with video comments (named as KuaiComt) which is collected from Kuaishou platform. correspondingly, we propose a practical framework for comment staytime prediction with LLM-enhanced Comment Understanding (LCU). Our framework leverages the strong text comprehension capabilities of large language models (LLMs) to understand textual information of comments, while also incorporating fine-grained comment ranking signals as auxiliary tasks. The framework is two-staged: first, the LLM is fine-tuned using domain-specific tasks to bridge the video and the comments; second, we incorporate the LLM outputs into the prediction model and design two comment ranking auxiliary tasks to better understand user preference. Extensive offline experiments demonstrate the effectiveness of our framework, showing significant improvements on the task of comment staytime prediction. Additionally, online A/B testing further validates the practical benefits on industrial scenario. Our dataset KuaiComt (https://github.com/lyingCS/KuaiComt.github.io) and code for LCU (https://github.com/lyingCS/LCU) are fully released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。