arXiv:2609.07273cs.IR2026-09

让推荐模型的多任务信息在骨干网络中协同演化,提升效果与效率。

Task-Blind No MORE: Multi-Task Information Flow in Unified Ranking Backbones

论文配图:Task-Blind No MORE: Multi-Task Information Flow in Unified Ranking Backbones
图 1 · 摘自论文原文
  • 在骨干网络中引入锚点令牌,实现跨任务信息流动。
  • 在大规模工业数据集上,多任务效果均优于基线,且模型规模扩展性强。
  • 已在Momo平台上线,显著提升用户使用时长和互动率,延迟降低30%。

工业级推荐系统通常分别扩展特征交互与序列建模;近期架构如HyFormer和MixFormer将二者统一于可堆叠骨干网络。然而,真实推荐系统几乎都需多任务学习,现有统一架构仅将多任务建模置于浅层后处理模块,使骨干网络缺乏任务感知的信息流。本文提出MORE(Multi-task cO-evolving Ranking modEl),将多任务信息流嵌入骨干网络,使任务特定信号与序列及特征表示在每一层共同演进,而非后期融合。其引入锚点令牌(Anchor Tokens),在骨干网络各层持续存在:共享锚点编码跨任务共性,私有锚点捕捉任务特异性先验。每个模块中,锚点令牌(1)读取行为序列的任务条件信号,(2)在任务边界掩码下与非序列特征混合,(3)通过独立分支优化各任务表示;随着模块堆叠,每项任务获得经过所有层优化的差异化表示。大规模工业数据集实验表明,MORE在参数量与计算量相近条件下,各项任务表现均优于基线,且随模型规模增长表现更优。在拥有数千万月活用户的中国社交发现平台Momo上进行在线A/B测试,用户使用时长提升3%,互动率提升3.6%,深度聊天率提升2%。MORE已投入生产,通过请求级共享计算,评分延迟降低约30%。

原文摘要 · Abstract (English)

Industrial ranking models for recommendation have scaled feature interaction and sequence modeling separately; recent architectures such as HyFormer and MixFormer unify both in a stackable backbone. Real-world recommender systems, however, nearly always require multi-task learning, yet existing unified architectures confine multi-task modeling to shallow post-backbone towers, leaving the backbone without task-aware information flow. We propose MORE (Multi-task cO-evolving Ranking modEl), which embeds multi-task information flow inside the backbone, enabling task-specific signals to co-evolve with sequence and feature representations at every layer rather than in a post-hoc fusion. It introduces Anchor Tokens that persist across backbone layers: Shared Anchors encode cross-task commonalities, while Private Anchors capture task-specific priors. In each block, Anchor Tokens (1) read task-conditioned signals from behavior sequences, (2) mix with non-sequential features under a task-boundary mask, and (3) refine per-task representations through independent branches; as blocks stack, each task obtains a differentiated representation refined through all backbone layers. Experiments on large-scale industrial datasets show that MORE consistently outperforms baselines across all tasks under comparable parameter and FLOPs budgets, and scales well with model size. Online A/B tests on Momo, a leading Chinese social discovery platform with tens of millions of monthly active users, yield 3% improvement in usage duration, 3.6% in interaction rate, and 2% in deep-chat rate. MORE is deployed in production with request-level shared computation reducing scoring latency by about 30%.

推荐系统多任务学习骨干网络工业部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。