通过双向神经交互,从通用用户表示中学习特定分群表示,提升推荐效果。
Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interaction
- 用信息瓶颈学通用表示,再通过双部图交互融合分群特定表示
- 在两个开源数据集和两个真实业务场景中均超越基线模型
- 适合需要分群精准建模的推荐与营销系统
近期,用户表征学习模型被广泛应用于点击率(CTR)和转化率(CVR)预测。通常,模型先学习一个通用的用户表示作为后续任务的输入。然而,在众多工业应用(如推荐与营销)中,业务会针对不同用户分群开展多种在线活动。这些分群通常由领域专家定义。由于用户分布差异和后续任务目标不同,仅依赖通用表示可能损害模型性能与鲁棒性。本文提出一种新学习框架:首先通过信息瓶颈学习通用用户表示,再利用神经交互机制融合生成分群特定或任务特定表示。我们设计了基于双部图架构的交互学习过程,建模上下文聚类与各用户分群间的表示学习与融合。所提方法在两个开源基准、两个离线业务数据集及两个线上营销应用中进行评估,用于预测用户转化率。结果表明,该方法性能显著优于基线模型。
原文摘要 · Abstract (English)
Recently, models for user representation learning have been widely applied in click-through-rate (CTR) and conversion-rate (CVR) prediction. Usually, the model learns a universal user representation as the input for subsequent scenario-specific models. However, in numerous industrial applications (e.g., recommendation and marketing), the business always operates such applications as various online activities among different user segmentation. These segmentation are always created by domain experts. Due to the difference in user distribution (i.e., user segmentation) and business objectives in subsequent tasks, learning solely on universal representation may lead to detrimental effects on both model performance and robustness. In this paper, we propose a novel learning framework that can first learn general universal user representation through information bottleneck. Then, merge and learn a segmentation-specific or a task-specific representation through neural interaction. We design the interactive learning process by leveraging a bipartite graph architecture to model the representation learning and merging between contextual clusters and each user segmentation. Our proposed method is evaluated in two open-source benchmarks, two offline business datasets, and deployed on two online marketing applications to predict users' CVR. The results demonstrate that our method can achieve superior performance and surpass the baseline methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。