优化搜索转化率预测模型,实现更高精度与低延迟的平衡。
On the Practice of Scaling Search Conversion Rate Prediction
- 通过实验分析模型规模、嵌入参数和数据量对性能的影响。
- 在训练数据扩大2.5倍、推理算力提升8倍下,延迟几乎不变。
- 适合大规模电商场景中追求高精度与低延迟的工程团队。
在高流量环境下扩展搜索转化率(CVR)预测模型面临挑战:需在模型质量与训练成本、服务延迟严格约束间取得平衡。本文详细阐述了一种有效方法来扩展现代搜索CVR预测模型。我们基于一个包含超一年客户交互日志的大规模生产数据集,对多种前沿架构及其集成进行可扩展性评估,分析了模型主干计算、嵌入参数规模和训练数据量三个关键因素的扩展表现。主要发现包括:(1) 选择合适的主干网络和扩展因子至关重要;(2) 主干、嵌入和数据量的扩展影响基本独立且具有叠加性,有助于更高效地探索扩展路径;(3) 简化热启动策略可加速训练迭代并简化更新流程;(4) 采用解耦图执行和动态批处理等推理优化策略,可在高容量模型下实现低延迟GPU服务。相比未扩展的基线生产模型,最终部署的模型使用2.5倍更大的训练数据和8倍的推理算力,延迟影响极小。线上A/B测试显示,新模型在关键搜索转化率指标上实现了+2.6%的联合提升。
原文摘要 · Abstract (English)
Scaling a Search Conversion Rate (CVR) prediction model, especially in high-traffic environments, presents a challenge: superior model quality needs to be balanced with strict constraints on training cost and serving latency. This paper details an effective approach for scaling modern search CVR prediction models. We begin with an empirical study to understand the scaling performance of search CVR models, analyzing how quality improves as we scale three key factors of model backbone computation, the size of embedding parameters, and the volume of training data. We use a large-scale production dataset, comprising over a year of customer interaction logs from a high-traffic e-commerce platform, to evaluate the scalability of several state-of-the-art architectures and their ensembles. Our key findings are: (1) selecting the right backbone and scaling factors is crucial; (2) the impact of scaling backbone, embedding, and data is largely independent and additive, which has implications for more efficient scaling exploration; (3) a streamlined warmstart strategy can accelerate training iterations while simplifying new updates; (4) inference optimization strategies such as decoupled graph execution and dynamic batching can enable low-latency GPU serving even for high-capacity models. Compared to a baseline of a pre-scaling production model, we ultimately deployed a model trained on 2.5x larger training data with 8x more inference compute while having minimal latency impact. Online A/B tests also demonstrate that our launches achieved a combined +2.6% gain in a key metric of search conversion rate.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。