arXiv:2411.13789cs.IR2024-11中稿 · VLDB 2025 Industri…被引 7

用大模型提升广告推荐多样性,显著提高用户转化率

LEADRE: Multi-Faceted Knowledge Enhanced LLM Empowered Display Advertisement Recommender System

  • 通过多维度提示工程让大模型理解用户兴趣
  • 引入广告特异性对齐机制,提升推荐精准度
  • 兼顾性能与效果,支持每日百亿级请求

展示广告为广告主、发布者和用户带来重要价值。传统展示广告系统采用多阶段架构,包括召回、粗排和精排。然而,传统召回方法依赖基于ID的学习排序机制,未能充分利用广告内容信息,限制了推荐结果的多样性。为此,本文提出利用大模型(LLM)的广泛世界知识来改进推荐。针对三大挑战——如何捕捉用户兴趣、如何弥合大模型与广告系统的知识鸿沟、如何高效部署大模型——我们提出一种新型大模型增强型展示广告推荐系统LEADRE。该系统包含三个核心模块:(1) 意图感知提示工程,通过多维度知识设计意图感知的<提示, 回答>对,微调大模型生成个性化广告;(2) 广告特异性知识对齐,引入辅助微调任务和直接偏好优化(DPO),使大模型与广告语义及商业价值对齐;(3) 高效系统部署,在线环境中集成延迟容忍与敏感服务。离线实验验证了LEADRE的有效性及各模块贡献。在线A/B测试显示,其在微信公众号和朋友圈分别带来1.57%和1.17%的GMV提升。目前LEADRE已在两个平台上线,每日服务数十亿次请求。

原文摘要 · Abstract (English)

Display advertising provides significant value to advertisers, publishers, and users. Traditional display advertising systems utilize a multi-stage architecture consisting of retrieval, coarse ranking, and final ranking. However, conventional retrieval methods rely on ID-based learning to rank mechanisms and fail to adequately utilize the content information of ads, which hampers their ability to provide diverse recommendation lists. To address this limitation, we propose leveraging the extensive world knowledge of LLMs. However, three key challenges arise when attempting to maximize the effectiveness of LLMs: "How to capture user interests", "How to bridge the knowledge gap between LLMs and advertising system", and "How to efficiently deploy LLMs". To overcome these challenges, we introduce a novel LLM-based framework called LLM Empowered Display ADvertisement REcommender system (LEADRE). LEADRE consists of three core modules: (1) The Intent-Aware Prompt Engineering introduces multi-faceted knowledge and designs intent-aware <Prompt, Response> pairs that fine-tune LLMs to generate ads tailored to users' personal interests. (2) The Advertising-Specific Knowledge Alignment incorporates auxiliary fine-tuning tasks and Direct Preference Optimization (DPO) to align LLMs with ad semantic and business value. (3) The Efficient System Deployment deploys LEADRE in an online environment by integrating both latency-tolerant and latency-sensitive service. Extensive offline experiments demonstrate the effectiveness of LEADRE and validate the contributions of individual modules. Online A/B test shows that LEADRE leads to a 1.57% and 1.17% GMV lift for serviced users on WeChat Channels and Moments separately. LEADRE has been deployed on both platforms, serving tens of billions of requests each day.

广告推荐大模型应用多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。