arXiv:2409.02856cs.IRcs.LG2024-09被引 5

构建可扩展的实时个性化搜索排序平台,提升电商推荐相关性与收益

Building a Scalable, Effective, and Steerable Search and Ranking Platform

  • 基于Transformer多层架构,融合用户行为序列与会话上下文信息
  • 支持每秒数千请求,覆盖百万级商品与用户,线上实验显著提升点击率与营收
  • 统一平台处理搜索与浏览场景,降低系统复杂度,适合大规模工业部署

现代电商平台商品数量庞大,用户难以快速找到符合兴趣且相关的商品。因此,构建近实时、可扩展且可定制的个性化排序与搜索系统至关重要。尽管学术界已有多种方法,但多数因复杂度高、性能差而难以用于大规模工业场景。当前工业系统常采用计算高效但简单的召回或候选生成方式,忽略实时与异构的用户信号,导致个性化不足。此外,不同用户场景由独立系统支撑,增加维护成本与体验不一致。本文提出一个可复用的个性化、近实时排序平台,适用于浏览与搜索等多种场景,支持数百万商品与用户在高负载(每秒数千请求)下的运行。平台采用基于Transformer的多层模型,能直接从用户行为序列中学习复杂模式,并融合会话内时间与上下文信息。通过在大型电商平台上的离线与在线实证实验,验证了该系统在用户体验与净收入方面均优于现有方案。最后,分享了构建大规模电商排序平台的关键经验。

原文摘要 · Abstract (English)

Modern e-commerce platforms offer vast product selections, making it difficult for customers to find items that they like and that are relevant to their current session intent. This is why it is key for e-commerce platforms to have near real-time scalable and adaptable personalized ranking and search systems. While numerous methods exist in the scientific literature for building such systems, many are unsuitable for large-scale industrial use due to complexity and performance limitations. Consequently, industrial ranking systems often resort to computationally efficient yet simplistic retrieval or candidate generation approaches, which overlook near real-time and heterogeneous customer signals, which results in a less personalized and relevant experience. Moreover, related customer experiences are served by completely different systems, which increases complexity, maintenance, and inconsistent experiences. In this paper, we present a personalized, adaptable near real-time ranking platform that is reusable across various use cases, such as browsing and search, and that is able to cater to millions of items and customers under heavy load (thousands of requests per second). We employ transformer-based models through different ranking layers which can learn complex behavior patterns directly from customer action sequences while being able to incorporate temporal (e.g. in-session) and contextual information. We validate our system through a series of comprehensive offline and online real-world experiments at a large online e-commerce platform, and we demonstrate its superiority when compared to existing systems, both in terms of customer experience as well as in net revenue. Finally, we share the lessons learned from building a comprehensive, modern ranking platform for use in a large-scale e-commerce environment.

推荐系统实时排序Transformer电商应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。