用迁移学习提升跨境电商查询分类准确率,解决低资源市场模型差的问题。
Transfer Learning for E-commerce Query Product Type Prediction
- 跨区域共享模型参数,高资源地区向低资源地区迁移知识。
- 统一的本地化模型在20个全球市场中表现优于独立训练的本地模型。
- 适合需要快速拓展新市场的电商平台使用。
理解用户搜索意图对电商搜索引擎至关重要,其中将查询与正确商品类别匹配是关键任务。查询商品类型分类(Q2PT)因查询短、语义模糊且品类超千种而极具挑战性。国际电商平台还面临语言、方言和文化差异带来的额外难题。本文聚焦全球多地区电商环境下的Q2PT预测问题。传统为每个地区单独训练模型的方法在低资源市场性能显著下降,且难以平滑扩展至新国家。为此,我们提出从高资源地区向低资源地区迁移学习的方案,实现全球范围内性能均衡。通过对比各地区独立模型与统一模型,以及本地感知与无本地感知模型,我们在涵盖20个全球市场的大型电商数据集上进行系统评估,结果表明统一的本地感知模型在性能上全面领先。
原文摘要 · Abstract (English)
Getting a good understanding of the customer intent is essential in e-commerce search engines. In particular, associating the correct product type to a search query plays a vital role in surfacing correct products to the customers. Query product type classification (Q2PT) is a particularly challenging task because search queries are short and ambiguous, the number of existing product categories is extremely large, spanning thousands of values. Moreover, international marketplaces face additional challenges, such as language and dialect diversity and cultural differences, influencing the interpretation of the query. In this work we focus on Q2PT prediction in the global multilocale e-commerce markets. The common approach of training Q2PT models for each locale separately shows significant performance drops in low-resource stores. Moreover, this method does not allow for a smooth expansion to a new country, requiring to collect the data and train a new locale-specific Q2PT model from scratch. To tackle this, we propose to use transfer learning from the highresource to the low-resource locales, to achieve global parity of Q2PT performance. We benchmark the per-locale Q2PT model against the unified one, which shares the training data and model structure across all worldwide stores. Additionally, we compare locale-aware and locale-agnostic Q2PT models, showing the task dependency on the country-specific traits. We conduct extensive quantiative and qualitative analysis of Q2PT models on the large-scale e-commerce dataset across 20 worldwide locales, which shows that unified locale-aware Q2PT model has superior performance over the alternatives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。