用对齐大模型提升推荐惊喜感,让淘宝猜你喜欢更出乎意料又合口味
Bursting Filter Bubble: Enhancing Serendipity Recommendations with Aligned Large Language Models
- 构建多层级用户画像+大模型对齐判断,让推荐更懂人的意外喜好
- 线上实验显示惊喜内容曝光率提升5.7%,点击和成交分别增29.56%和27.6%
- 已落地淘宝首页,兼顾惊喜感与商业收益,适合追求推荐多样性的平台
推荐系统常受反馈循环影响,导致信息茧房,内容同质化并降低用户满意度。为解决此问题,提出通过提供意外但相关的内容来增强推荐的惊喜感。近期大语言模型(LLMs)因具备广泛世界知识与推理能力,在惊喜感预测中展现潜力,但仍面临判断与人类偏好不一致、难以处理长序列用户行为、以及工业级延迟要求等挑战。为此,本文提出SERAL框架,包含三个阶段:(1) 认知画像生成,将用户行为压缩为多层级画像;(2) SerenGPT对齐,利用丰富训练数据使模型判断更贴近人类偏好;(3) 近线适应,高效集成至工业推荐流水线。在线实验表明,SERAL使惊喜内容的曝光率(PVR)、点击率和交易量分别提升5.7%、29.56%和27.6%,在不影响整体收入的前提下显著提升用户体验。目前该系统已在淘宝App首页“猜你喜欢”功能中全面部署。
原文摘要 · Abstract (English)
Recommender systems (RSs) often suffer from the feedback loop phenomenon, e.g., RSs are trained on data biased by their recommendations. This leads to the filter bubble effect that reinforces homogeneous content and reduces user satisfaction. To this end, serendipity recommendations, which offer unexpected yet relevant items, are proposed. Recently, large language models (LLMs) have shown potential in serendipity prediction due to their extensive world knowledge and reasoning capabilities. However, they still face challenges in aligning serendipity judgments with human assessments, handling long user behavior sequences, and meeting the latency requirements of industrial RSs. To address these issues, we propose SERAL (Serendipity Recommendations with Aligned Large Language Models), a framework comprising three stages: (1) Cognition Profile Generation to compress user behavior into multi-level profiles; (2) SerenGPT Alignment to align serendipity judgments with human preferences using enriched training data; and (3) Nearline Adaptation to integrate SerenGPT into industrial RSs pipelines efficiently. Online experiments demonstrate that SERAL improves exposure ratio (PVR), clicks, and transactions of serendipitous items by 5.7%, 29.56%, and 27.6%, enhancing user experience without much impact on overall revenue. Now, it has been fully deployed in the "Guess What You Like" of the Taobao App homepage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。