arXiv:2607.27577cs.IRcs.LG2026-07中稿 · ACM RecSys Industr…

针对跨类型内容推荐的复杂性,提出自适应专家混合模型提升工业级系统表现。

Heterogeneous Ranking in Industrial-Scale Recommender Systems: A Case Study

论文配图:Heterogeneous Ranking in Industrial-Scale Recommender Systems: A Case Study
图 1 · 摘自论文原文
  • 设计HA-MoE模型,通过显式建模内容异质性实现专家专业化分工。
  • 在大规模数据上,相比基线模型,双层AUC提升显著,线上测试活跃度与探索率均提高。
  • 配套轻量可观测框架LENS,可实时诊断专家分工与系统异质性演化。

异构推荐场景超越传统同质环境(如仅音乐或视频平台)的挑战。在Google Discover中,统一信息流融合来自开放网络的多样化内容,包括网页文章、长短视频、用户生成内容等,不同内容类型具有差异化的特征密度和用户交互模式。构建一个在异构环境下保持高性能、避免负迁移或多数偏见的统一排序模型,仍是工业界的重大挑战。本文基于真实部署,开展异构信息流多任务排序的端到端案例研究。提出HA-MoE:一种异质性自适应的多门控专家混合架构,将异质性上下文显式引入门控网络与专家表示中,实现有效专业化且不显著增加运行开销。为支持可靠部署,引入LENS——一个轻量级可观测性框架,提供专家专业化可解释诊断,并追踪持续再训练中的功能异质性。采用双层AUC(DL-AUC)这一考虑异质性的评估指标,结合全局排序性能与跨段落排序正确性进行评估。离线实验在大规模工业数据集上显示持续优于基线模型;在线A/B测试进一步验证了在信息流活跃度与探索行为上的提升。离线与线上结果共同证实该方法在管理工业级推荐系统异质性方面的有效性。

原文摘要 · Abstract (English)

Heterogeneous recommendation feeds present complex challenges that extend beyond those found in highly homogeneous environments (e.g., music-only or video-only closed-ecosystem platforms). In Google Discover, a unified feed integrates diverse content sourced from the decentralized open web, including web articles, long-form and short-form videos, user-generated content (UGC), and beyond. Different content types exhibit distinct feature densities and user interaction patterns. Building a unified ranking model that sustains high performance across such heterogeneity, while avoiding negative transfer or majority bias, remains a significant industrial challenge. This paper presents an end-to-end case study on the industrial-scale multi-task ranking of heterogeneous feeds, grounded in real-world deployment. We introduce HA-MoE, a heterogeneity-adaptive multi-gated mixture-of-experts architecture that incorporates explicit heterogeneity context into both gating networks and expert representations. This approach enables effective specialization without significantly increasing operational overhead. To support reliable deployment, we introduce LENS, a lightweight observability framework that provides interpretable diagnostics of expert specialization and tracks this functional heterogeneity across continuous retraining. We evaluate our method using Dual-Level AUC (DL-AUC), a heterogeneity-aware evaluation metric that combines global ranking performance with cross-segment ranking correctness. Offline evaluations on a large-scale industrial dataset demonstrate consistent improvements over baseline models. Furthermore, online A/B testing confirms gains in feed activity and exploration metrics. Together, offline and online results validate the effectiveness of our approach for managing heterogeneity in industrial-scale recommender systems.

推荐系统异质性专家混合工业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。