用大模型提升电商广告搜索相关性,准确率达89.43%
Enhancement of E-commerce Sponsored Search Relevancy with LLM

- 基于LLAMA2-7B模型,通过低秩适配(LoRA)定制化训练
- 在测试集上广告相关性准确率达89.43%,优于GPT-4等模型
- 适合电商广告系统优化,兼顾精度、成本与隐私
广告搜索是搜索引擎的重要收入来源,但其匹配精度受关键词空间庞大、用户与广告主意图模糊及多语言主题多样性影响。本文在沃尔玛电商平台背景下,构建基于预训练大语言模型的广告相关性模型,采用低秩适配(LoRA)对LLAMA2-7B进行微调,实现对搜索查询与广告标题三类相关性(相关、部分相关、无关)的精准分类。模型在大规模测试数据集上达到89.43%的准确率,显著优于基线模型和GPT-4。该方法在提升搜索精度的同时,兼具成本效益与操作隐私优势,为大规模电商广告系统提供了高效可扩展的解决方案。
原文摘要 · Abstract (English)
Sponsored search plays a crucial role as a revenue stream for search engines, wherein advertisers competitively bid on keywords that align with the users' search queries. The task of matching relevant keywords to these queries is complicated by the vast and ever-evolving space of keywords, the ambiguity of user and advertiser intentions, and the wide range of topics and languages involved. Consequently, ensuring that ads are pertinent to user queries presents significant challenges. In the fast-paced world of e-commerce, the accuracy of sponsored search results is vital for boosting user satisfaction and optimizing business operations. This paper presents the development of an advanced Ad Relevance Model within a sponsored search framework, utilizing the power of a pretrained large language model. We detail a pioneering adaptation of the LLAMA2 7B model through Low-Rank Adaptation (LoRA), which markedly enhances search precision and operational efficiency, thus opening new avenues for improving user interactions in extensive online marketplaces such as Walmart.com. We introduce a novel query and ad title classifier, which discerns the relevance of search interactions across three categories: Relevant, Partially Relevant, and Irrelevant. Our approach involved adapting the pretrained model specifically for the e-commerce sponsored search context, training it on a large dataset. The fine-tuned model demonstrated a marked improvement in ad relevance accuracy, achieving 89.43% accuracy on a comprehensive test dataset -- outperforming both the baseline model and other advanced language models like GPT-4. The integration of LoRA with the based model represents a significant stride in customizing language models for e-commerce applications, resulting in enhanced search accuracy, cost efficiency, and operational privacy -- a triad essential for the modern digital marketplace.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。