arXiv:2508.14948cs.LG2025-08被引 4

提出全表示多粒度迁移框架,显著提升广告推荐效果。

Large Foundation Model for Ads Recommendation

  • 同时迁移用户、物品及交叉表示,覆盖更全面的特征
  • 通过多粒度机制实现跨任务高效迁移,整体GMV提升2.45%
  • 已在腾讯大规模广告平台落地,支持千亿级日请求

在线广告依赖精准的推荐模型,近期研究采用预训练大模型(LFM)捕捉用户在多场景下的通用兴趣。然而现有方法仅迁移用户表示(URs),忽略物品表示(IRs)和用户-物品交叉表示(CRs),且简单将用户表示作为下游特征,难以弥合上下游差距,忽视更细粒度的迁移潜力。本文提出LFM4Ads:一个全表示多粒度迁移框架,首次全面迁移URs、IRs与CRs。为有效利用CRs,识别最优提取层并聚合为可迁移的粗粒度形式。进一步设计多粒度机制:非线性适配器实现特征级迁移,同构交互模块实现模块级迁移,独立检索机制实现模型级迁移。LFM4Ads已成功部署于腾讯工业级广告平台,日处理超百亿样本,模型参数达TB级,稀疏嵌入键数超十亿,涵盖约两千个特征。自2024年第四季度上线以来,已在包括微信朋友圈和频道在内的多个核心场景完成10余次生产发布,整体平台GMV提升2.45%,预计年增收达数亿人民币。

原文摘要 · Abstract (English)

Online advertising relies on accurate recommendation models, with recent advances using pre-trained large-scale foundation models (LFMs) to capture users' general interests across multiple scenarios and tasks. However, existing methods have critical limitations: they extract and transfer only user representations (URs), ignoring valuable item representations (IRs) and user-item cross representations (CRs); and they simply use a UR as a feature in downstream applications, which fails to bridge upstream-downstream gaps and overlooks more transfer granularities. In this paper, we propose LFM4Ads, an All-Representation Multi-Granularity transfer framework for ads recommendation. It first comprehensively transfers URs, IRs, and CRs, i.e., all available representations in the pre-trained foundation model. To effectively utilize the CRs, it identifies the optimal extraction layer and aggregates them into transferable coarse-grained forms. Furthermore, we enhance the transferability via multi-granularity mechanisms: non-linear adapters for feature-level transfer, an Isomorphic Interaction Module for module-level transfer, and Standalone Retrieval for model-level transfer. LFM4Ads has been successfully deployed in Tencent's industrial-scale advertising platform, processing tens of billions of daily samples while maintaining terabyte-scale model parameters with billions of sparse embedding keys across approximately two thousand features. Since its production deployment in Q4 2024, LFM4Ads has achieved 10+ successful production launches across various advertising scenarios, including primary ones like Weixin Moments and Channels. These launches achieve an overall GMV lift of 2.45% across the entire platform, translating to estimated annual revenue increases in the hundreds of millions of dollars.

广告推荐大模型多粒度迁移工业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。