arXiv:2412.06860cs.LGcs.AI2024-12被引 5

用大模型提升点击率预测,兼顾效果与效率。

Balancing Efficiency and Effectiveness: An LLM-Infused Approach for Optimized CTR Prediction

  • 利用大模型提取深层语义信息并蒸馏到小模型
  • 在美团搜索系统中实现点击率提升且成本更低
  • 适合需要高效精准推荐的广告系统使用

点击率(CTR)预测在在线广告中至关重要,语义信息对用户决策和提升CTR效果起关键作用。传统方法难以捕捉用户与商品层面的细微语义,如用户因健康与高端属性而偏好‘Häagen-Dazs HEAVEN草莓轻冰激凌’。为此,我们提出一种新型端到端深度语义建模方法——基于蒸馏的多层级深度语义注入CTR模型(MSD),利用大语言模型(LLM)提取并蒸馏关键语义信息至小型高效模型,支持无缝训练与推理。框架精心设计以平衡效率与性能,确保高精度的同时优化资源消耗。在美团赞助搜索系统的线上A/B测试显示,该方法在CPM和CTR上显著优于基线模型,验证了其在真实场景中的有效性、可扩展性与平衡性。

原文摘要 · Abstract (English)

Click-Through Rate (CTR) prediction is essential in online advertising, where semantic information plays a pivotal role in shaping user decisions and enhancing CTR effectiveness. Capturing and modeling deep semantic information, such as a user's preference for "Häagen-Dazs' HEAVEN strawberry light ice cream" due to its health-conscious and premium attributes, is challenging. Traditional semantic modeling often overlooks these intricate details at the user and item levels. To bridge this gap, we introduce a novel approach that models deep semantic information end-to-end, leveraging the comprehensive world knowledge capabilities of Large Language Models (LLMs). Our proposed LLM-infused CTR prediction framework(Multi-level Deep Semantic Information Infused CTR model via Distillation, MSD) is designed to uncover deep semantic insights by utilizing LLMs to extract and distill critical information into a smaller, more efficient model, enabling seamless end-to-end training and inference. Importantly, our framework is carefully designed to balance efficiency and effectiveness, ensuring that the model not only achieves high performance but also operates with optimal resource utilization. Online A/B tests conducted on the Meituan sponsored-search system demonstrate that our method significantly outperforms baseline models in terms of Cost Per Mile (CPM) and CTR, validating its effectiveness, scalability, and balanced approach in real-world applications.

CTR预测大模型应用广告推荐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。