解决推荐系统多目标排序的矛盾,让评分更符合真实排名。
Rethinking Multi-objective Ranking Ensemble in Recommender System: From Score Fusion to Rank Consistency
- 用可微分方式优化评分与标签排名的一致性
- 在两个工业数据集上提升效果,线上带来2.6%购买增长
- 适合处理标签偏斜的工业推荐场景
工业推荐系统常需兼顾多个业务目标,但目标间内在冲突给排序阶段带来挑战。主流方法是构建多目标集成(ME)模型,将多目标预测融合为统一评分。然而现有方法尚未系统界定ME问题的核心要求。本文从单个目标和整体目标两方面重新思考:单个目标下,评分应尽可能与标签排名一致;整体目标下,最优解需反映多数目标共享的共性。现有方法均无法满足这两点。为此,提出新框架HarmonRank:针对排名一致性,将AUC转化为可端到端优化的排名求和问题;针对共性建模,由无关系感知转向关系感知的集成范式。在两个工业数据集上的离线实验及线上测试表明,本方法显著优于现有最先进方法。此外,对标签偏斜具有更强鲁棒性。该方法已在快手直播电商推荐平台部署,服务4亿日活用户,带来2.6%购买率提升。
原文摘要 · Abstract (English)
The industrial recommender systems always pursue more than one business goals. The inherent intensions between objectives pose significant challenges for ranking stage. A popular solution is to build a multi-objective ensemble (ME) model to integrate multi-objective predictions into a unified score. Although there have been some exploratory efforts, few work has yet been able to systematically delineate the core requirements of ME problem. We rethink ME problem from two perspectives. From the perspective of each individual objective, to achieve its maximum value the scores should be as consistent as possible with the ranks of its labels. From the perspective of entire set of objectives, an overall optimum can be achieved only when the scores align with the commonality shared by the majority of objectives. However, none of existing methods can meet these two requirements. To fill this gap, we propose a novel multi-objective ensemble framework HarmonRank to fulfill both requirements. For rank consistency, we formulate rank consistency (AUC) metric as a rank-sum problem and make the model optimized towards rank consistency in an end-to-end differentiable manner. For commonality modeling, we change the original relation-agnostic ensemble paradigm to a relation-aware one. Extensive offline experimental results on two industrial datasets and online experiments demonstrate that our approach significantly outperforms existing state-of-the-art methods. Besides, our method exhibits superior robustness to label skew situations which is common in industrial scenarios. The proposed method has been fully deployed in Kuaishou's live-streaming e-commerce recommendation platform with 400 million DAUs, contributing 2.6% purchase gain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。