arXiv:2602.07520cs.IRcs.AI2026-02KDD被引 1

将场景和任务信息当作提示符,激活大模型参数空间,提升推荐系统性能。

MDL: A Unified Multi-Distribution Learner in Large-scale Industrial Recommendation through Tokenization

  • 用特殊令牌表示场景与任务,统一建模多分布信息。
  • 在抖音搜索上实测:长期点击率提升0.0626%,查询变化率下降0.3267%。
  • 适合大规模工业级推荐系统,尤其需兼顾多场景多任务的场景。

工业推荐系统日益采用多场景学习(MSL)和多任务学习(MTL)来处理多样化的用户交互与上下文,但现有方法存在两大缺陷:(1) 大规模模型参数因与复杂特征模块交互不足而利用率低;(2) 难以在统一框架中联合建模场景与任务信息。为此,我们提出统一的多分布学习(MDL)框架,受大语言模型“提示”范式的启发。MDL将场景与任务信息视为专用令牌,而非辅助输入或门控信号。具体地,引入统一的信息令牌化模块,将特征、场景与任务转化为统一的令牌格式。为促进深度交互,设计三种协同机制:(1) 特征令牌自注意力,实现丰富特征交互;(2) 领域-特征注意力,实现场景/任务自适应特征激活;(3) 领域融合聚合,实现联合分布预测。通过堆叠这些交互,MDL使场景与任务信息以自底向上、逐层方式“提示”并激活模型庞大参数空间。在真实工业数据集上的大量实验表明,MDL显著优于当前最优的MSL与MTL基线。在抖音搜索平台为期一个月的线上A/B测试显示,LT30提升0.0626%,查询变化率降低0.3267%。该方案已全量上线,日均服务数亿用户。

原文摘要 · Abstract (English)

Industrial recommender systems increasingly adopt multi-scenario learning (MSL) and multi-task learning (MTL) to handle diverse user interactions and contexts, but existing approaches suffer from two critical drawbacks: (1) underutilization of large-scale model parameters due to limited interaction with complex feature modules, and (2) difficulty in jointly modeling scenario and task information in a unified framework. To address these challenges, we propose a unified \textbf{M}ulti-\textbf{D}istribution \textbf{L}earning (MDL) framework, inspired by the "prompting" paradigm in large language models (LLMs). MDL treats scenario and task information as specialized tokens rather than auxiliary inputs or gating signals. Specifically, we introduce a unified information tokenization module that transforms features, scenarios, and tasks into a unified tokenized format. To facilitate deep interaction, we design three synergistic mechanisms: (1) feature token self-attention for rich feature interactions, (2) domain-feature attention for scenario/task-adaptive feature activation, and (3) domain-fused aggregation for joint distribution prediction. By stacking these interactions, MDL enables scenario and task information to "prompt" and activate the model's vast parameter space in a bottom-up, layer-wise manner. Extensive experiments on real-world industrial datasets demonstrate that MDL significantly outperforms state-of-the-art MSL and MTL baselines. Online A/B testing on Douyin Search platform over one month yields +0.0626\% improvement in LT30 and -0.3267\% reduction in change query rate. MDL has been fully deployed in production, serving hundreds of millions of users daily.

推荐系统多任务学习大模型应用工业部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。