OneRank统一了Transformer与多任务推荐,提升排序性能与可扩展性。
OneRank: Unified Transformer-Native Ranking Architecture for Multi-Task Recommendation

- 将任务特异性表示学习融入Transformer内部,实现端到端联合优化。
- 在工业级数据集上显著超越现有基线,且保持高效计算开销。
- 适合需要高精度多任务推荐的工业系统,如电商与内容平台。
多任务学习(MTL)在推荐系统中至关重要,可促进多样用户反馈间的互补学习。尽管现代工业实践已从DNN转向以Transformer为中心的架构以增强序列建模和扩展能力,但其仍分离特征编码与多任务预测,将Transformer视为任务无关编码器。这一设计从根本上限制了性能与可扩展性:(1)在异构任务目标下形成信息瓶颈;(2)引发梯度干扰,导致“此消彼长”现象;(3)迫使数据流从基于注意力的上下文自适应表示学习,转变为静态前馈任务预测,信息读写机制不兼容。我们提出OneRank,一种Transformer原生的多任务排序框架,消除编码器-预测器分离,引入任务私有通道用于前向表示学习与后向优化,实现任务专业化学习同时减少任务间干扰。前向传播中,OneRank通过任务条件化信息选择、候选感知上下文建模与可控跨任务交互,自底向上学习任务特定表示。后向传播中,跨任务梯度解耦使任务私有参数更新与共享知识提取模块隔离,防止负迁移。我们进一步用动态匹配式评分替代静态任务专用MLP评分,实现上下文感知个性化排序。通过将多任务推理内置于Transformer堆栈,OneRank建立了统一且可扩展的架构范式。在大规模工业数据集上的离线与在线实验表明,OneRank显著优于当前最优基线,同时保持计算效率。
原文摘要 · Abstract (English)
Multi-task learning (MTL) is essential in recommender systems to enable complementary learning among diverse user feedback. While modern industrial practices have shifted from DNNs to Transformer-centric architectures to strengthen sequence modeling and scaling capacity, they still decouple feature encoding from multi-task prediction, treating the Transformer as a task-agnostic encoder. This design fundamentally limits the performance and scalability by (1) creating an information bottleneck under heterogeneous task objectives, (2) inducing gradient interference that leads to the seesaw phenomenon, and (3) forcing a dataflow transition in which attention-based, context-adaptive representation learning is converted to static feed-forward task prediction with incompatible information read-write dynamics. We propose OneRank, a Transformer-native multi-task ranking framework that eliminates encoder-predictor separation and introduces task-private channels for forward representation learning and backward optimization, enabling task-specialized learning while reducing inter-task interference. In the forward pass, OneRank learns task-specific representations bottom-up through task-conditioned information selection, candidate-aware contextualization, and controlled cross-task interaction. In the backward pass, cross-task gradient detachment isolates task-private parameter updates from shared knowledge extraction modules, preventing negative transfer. We further replace static task-specific MLP scorers with dynamic matching-based scoring for context-aware personalized ranking. By internalizing multi-task reasoning within the Transformer stack, OneRank establishes a unified and scalable architectural paradigm. Offline and online experiments on large-scale industrial datasets show that OneRank significantly outperforms state-of-the-art baselines while maintaining computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。