用大模型提升汽车销售线索排序,效果比传统方法好
asLLR: LLM based Leads Ranking in Auto Sales
- 用大模型同时处理文本和表格数据,融合点击率与问答损失
- 在30万样本上测试,AUC达0.8127,比传统方法高0.0231
- 线上实测销量提升9.5%,适合做智能销售决策支持
在汽车销售系统中,高质量的线索排序决定了销售工作的优先级,对提升销售效率至关重要。由于客户关系管理系统(CRM)包含大量销售与客户之间的文本交互信息,传统点击率(CTR)预测等方法难以有效处理自然语言中的复杂信息,限制了其在销售线索排序中的应用。为填补这一空白,本文提出asLLR(基于大语言模型的汽车销售线索排序),将CTR损失与问答(QA)损失集成于仅解码器的大语言模型架构中,实现对表格与自然语言特征的联合建模。为验证有效性,我们基于某新势力电动车品牌的客户线索池构建了一个创新数据集,包含30万训练样本和4万测试样本。实验结果表明,asLLR能有效捕捉商业数据中的复杂模式,达到0.8127的AUC,优于传统CTR方法0.0231。此外,当用于提取文本特征时,可使CTR模型性能提升0.0058。在真实销售场景中,经过严格的在线A/B测试,asLLR相比传统方法使销量提升了约9.5%,为业务智能与运营决策提供了有力工具。
原文摘要 · Abstract (English)
In the area of commercial auto sales system, high-quality lead score sequencing determines the priority of a sale's work and is essential for optimizing the efficiency of the sales system. Since CRM (Customer Relationship Management) system contains plenty of textual interaction features between sales and customers, traditional techniques such as Click Through Rate (CTR) prediction struggle with processing the complex information inherent in natural language features, which limits their effectiveness in sales lead ranking. Bridging this gap is critical for enhancing business intelligence and decision-making. Recently, the emergence of large language models (LLMs) has opened new avenues for improving recommendation systems, this study introduces asLLR (LLM-based Leads Ranking in Auto Sales), which integrates CTR loss and Question Answering (QA) loss within a decoder-only large language model architecture. This integration enables the simultaneous modeling of both tabular and natural language features. To verify the efficacy of asLLR, we constructed an innovative dataset derived from the customer lead pool of a prominent new energy vehicle brand, with 300,000 training samples and 40,000 testing samples. Our experimental results demonstrate that asLLR effectively models intricate patterns in commercial datasets, achieving the AUC of 0.8127, surpassing traditional CTR estimation methods by 0.0231. Moreover, asLLR enhances CTR models when used for extracting text features by 0.0058. In real-world sales scenarios, after rigorous online A/B testing, asLLR increased the sales volume by about 9.5% compared to the traditional method, providing a valuable tool for business intelligence and operational decision-making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。