通过跨任务知识迁移提升推荐模型转化率
Effective Knowledge Transfer for Multi-Task Recommendation Models
- 设计路由与发射模块,实现多任务间知识高效传递
- 在真实平台测试中使eCPM提升3.93%
- 适合需要提升转化率的工业级推荐系统
转化率(CVR)是衡量平台内容与用户偏好匹配程度的关键指标。然而,用户转化行为数据有限,给排序模型训练带来挑战。本文提出一种面向多任务推荐模型的有效知识迁移方法(EKTM),使排序模型能从多样化用户行为中学习,通过不同但相关的任务间知识迁移提升性能。每个具体CVR任务可直接受益于其他任务的洞察。为此,我们引入一个路由模块,用于整合与分发任务间知识;每个CVR任务配备发射模块,将路由知识转化为自身可用形式。此外,设计增强模块确保迁移知识真正促进原任务学习。在多个基准数据集上的大量实验表明,该方法优于现有最先进方法。在线A/B测试在商业平台上验证了其有效性,实现3.93%的eCPM提升。该算法已全面部署于平台两个主要流量场景。
原文摘要 · Abstract (English)
The conversion rate (CVR) is a crucial metric for evaluating the effectiveness of platforms, as it quantifies the alignment of content with audience preferences. However, the limited nature of customers' conversion actions presents a significant challenge for training ranking models effectively. In this paper, we propose an Effective Knowledge Transfer method for Multi-task Recommendation Models (EKTM). This method enables the ranking model to learn from diverse user behaviors, thereby enhancing performance through the transfer of knowledge across distinct yet related tasks. Each specific CVR task can directly benefit from the insights provided by other tasks. To achieve this, we first introduce a router module that integrates and disseminates knowledge across tasks. Subsequently, each CVR task is equipped with a transmitter module that facilitates the transformation of knowledge from the router. Additionally, we propose an enhanced module to ensure that the transferred knowledge benefit the original task learning. Extensive experiments on several benchmark datasets demonstrate that our proposed method outperforms existing state-of-the-art approaches. Online A/B testing on a commercial platform has validated the effectiveness of the EKTM algorithm in large-scale industrial settings, resulting in a 3.93% uplift in effective Cost Per Mille (eCPM). The algorithm has since been fully deployed across two of the platform's main-traffic scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。