arXiv:2508.20400cs.IRcs.AI2025-08被引 5

解决推荐系统多目标检索的对齐难题,实现高效个性化排序。

MPFormer: Adaptive Framework for Industrial Multi-Task Personalized Sequential Retriever

  • 用可学习注意力调节融合用户行为与多任务语义
  • 动态调整权重提升多目标检索效果,支持400万日活用户
  • 适合大规模工业级推荐系统部署,兼顾性能与可扩展性

现代工业推荐系统面临多阶段优化不一致的核心挑战:排名阶段广泛采用多目标优化,而检索阶段仍为单目标建模,导致语义鸿沟。现有主流方案通过并行多路径单目标检索覆盖多目标,但带来训练与服务资源随目标数线性增长的问题,且难以处理松耦合目标。本文提出MPFormer,一种动态多任务Transformer框架,通过三项创新机制系统解决上述问题:第一,目标条件化Transformer,通过可学习注意力调制联合编码用户行为序列与多任务语义;第二,引入个性化目标权重,实现检索结果的动态调整;第三,将用户个性化信息融入标记表示与Transformer结构,增强模型表达能力。该框架已成功集成至快手短视频推荐系统,稳定服务超4亿日活跃用户,显著提升用户日均互动时长与系统运行效率。实际部署验证表明,相比传统方案,其有效优化了多目标检索的迭代范式,同时保持服务响应速度,为工业推荐系统提供可扩展的多目标解决方案。

原文摘要 · Abstract (English)

Modern industrial recommendation systems encounter a core challenge of multi-stage optimization misalignment: a significant semantic gap exists between the multi-objective optimization paradigm widely used in the ranking phase and the single-objective modeling in the retrieve phase. Although the mainstream industry solution achieves multi-objective coverage through parallel multi-path single-objective retrieval, this approach leads to linear growth of training and serving resources with the number of objectives and has inherent limitations in handling loosely coupled objectives. This paper proposes the MPFormer, a dynamic multi-task Transformer framework, which systematically addresses the aforementioned issues through three innovative mechanisms. First, an objective-conditioned transformer that jointly encodes user behavior sequences and multi-task semantics through learnable attention modulation; second, personalized target weights are introduced to achieve dynamic adjustment of retrieval results; finally, user personalization information is incorporated into token representations and the Transformer structure to further enhance the model's representation ability. This framework has been successfully integrated into Kuaishou short video recommendation system, stably serving over 400 million daily active users. It significantly improves user daily engagement and system operational efficiency. Practical deployment verification shows that, compared with traditional solutions, it effectively optimizes the iterative paradigm of multi-objective retrieval while maintaining service response speed, providing a scalable multi-objective solution for industrial recommendation systems.

推荐系统多任务学习Transformer个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。